Hacker News new | past | comments | ask | show | jobs | submit

Show HN: Arch – an intelligent prompt gateway built on Envoy

https://github.com/katanemo/arch
Hi, I'm curious how preventing jailbreaks protects the user?

> Prompt guardrails to prevent jailbreak attempts and ensure safe user interactions [...]

That's a fair point - technically it protects the application from malicious attempts to subvert the desired LLM experience. The more specific language (and I think we could do better here) would be that Arch ensures users remain within the bounds of an intended LLM experience. That at least was the intention behind "ensure safe user interactions"...
Jailbreak ensures a smooth developer experience by controlling what traffic from user make its way to the model. With jailbreak (and other guardrails soon to be added) developers can short-circuit response and with observability developers can get insights on how users are interacting with their APIs.
loading story #41853978
Lately, I have seen few gateways around LLM. Namely, openrouter, portkey.ai, etc.

My key question is, who would be the ideal customer who would need a proxy or a gateway like this? Why couldn't it be an extension or plugin of existing LBs, proxies etc.

loading story #41853757
loading story #41853887
Hey HN - my name is Salman and I am Adil’s Co-Founder. Would love to hear and get feedback. Here is a link to our public roadmap, please lets us know if there are things you’d like for us to work on first

https://github.com/orgs/katanemo/projects/1

You can also see current list of issues at https://github.com/katanemo/arch/issues, and can also post new feature requests and bug fixes there.