fly-by-night (n.) Look up fly-by-night at Dictionary.com
1796, slang, said to be an old term of reproach to a woman signifying that she was a witch; extended 1823 to "anyone who departs hastily from a recent activity," especially while owing money. The two senses involve the two verbs fly.