Fly by night
Originally a term for someone who fled secretly at night to avoid paying debts, this phrase dates to the late 18th century. It evolved to describe any untrustworthy or unreliable person or business — especially one that appears suddenly, operates dubiously, and vanishes before being held accountable.