Considering the state of the field ( RAG/retrieval/evaluation) I have 0 trust in it, even more if it's closed source with bullshit claim like that.
Everything is vibe sloped to death, and dead after a few months to a couple of years (and not hard to be 100 cheaper than GPT-5.6 sol ... DS is basically free and I guess already 100 times cheaper or more, and here another slope ).
castform founder here. we should have made it more prominent on the blog but here's the full code example: https://github.com/castform-ai/benchmax/tree/main/examples/n...
Thank you for the github link, what is the license? I went briefly over several repo, unless I missed it somewhere the license was often missing.
it's apache 2.0: https://github.com/castform-ai/benchmax/tree/main?tab=Apache...