A private credit firm is a non-bank entity that raises money from wealthy investors, pension funds, etc to loan out to businesses. The funds are generally locked up for several years to match the duration of the loans.
They also borrow money from banks to add leverage to this basic setup.