Kagi employee here. We're actively working on building our own indexes beyond the limited ones we have now, not just a general index but also purpose built indexes for things like programming, etc.
> Teclis is an attempt to surface the less known web, the web of creativity and self expression, the more humane web.
> Teclis includes its own crawl as well as results from Kagi Small Web index and results with permission from Marginalia Search.
> Teclis works best with broad queries such as 'machine learning', 'vegan diet', 'religion' etc..
Is there another crawler doing the general-purpose stuff?
I imagine there is still a whole load of stuff out there on the internet that Google would never surface because it doesn't have enough adsense or whatever. Are you finding that?
I'm not sure antitrust will help you.
Lip service. You'll have some token index of Wikipedia or something so you can say your results are "a blend of our own index and other sources".
https://blog.kagi.com/waiting-dawn-search#:~:text=Wikipedia,...