Funny enough, Anthropic just went GA with 1m context claude that has supposedly solved the lost-in-the-middle problem.

Is it all open? Or is compression algo behind a cloud service?

This company sounds like it has months to live, or until the VC money runs out at most. If this idea is good, Anthropic et. al. will roll it into their own product, eliminating any purpose for it to exist as an independent product. And if it isn't any good, the company won't get traction.

[dead]