BC Partners, Varde Partners and Warburg Pincus made bids that fell "substantially short" of the asking price due to concerns about the impact of a possible Brexit, according to Sky News.
Charter Court Financial Services was founded in 2008 and is backed by US investor Elliott Management.
Sources now believe that Elliott will retain ownership of Charter Court and pursue a stock market listing within the next three years.
Charter Court made a profit after tax of £21.4m in 2015 and passed through £2.5 billion of mortgage completions to the end of October.