Hedge funds and private equity firms may be inching closer to getting their hands on a big pot of money that U.S. regulators have mostly kept out of reach: Cash from mom-and-pop investors.