This has to be build and takes time.
But this is the major thing were ai will be introduced into every single layer of software we have.
The HR System which might have needed x people? The agent has solved 90% of tickets already before they hit a human. Agents will do the repetitive but not that easy to automate tasks.
Local LLM usage is bouncing across major runtimes, custom runtimes and forks plus custom quants and variations of open models. llama-swap and some other tools integrate those and provide metrics but as the field expands can't keep up even with AI support.
I need to look at tailscales dashboard/etc again. I started on that when it launched but couldn't get my runtimes to go through it. I think the easiest tie in for metrics/etc is grafana + Prometheus but you need that stood up, and then a custom parsing job for each runtime based on metrics it reports and processing that data into useful dash.
I would love to see more standards here like OpenAI endpoints with metrics and information to link into. ./metrics is great but not standardized.
How is that even possible? I thought they already put AI chats into everything. Maybe AI chat inside an AI chat.
The agent will be running 24/7 and be triggered by different things. Chat input, scheduler, actions someone executes inside the software etc.
The SEO campaign tool? You might need to fill out a lot of different things, configure stuff then execute. In the future you will start the SEO campaign tool, the agent will ask you missing information, it then fills out everything, gets a budget and runs it. It will adjust the campaign based on feedback from the SEO tools.
Kind of a workflow engine but smart, so smart that it will handle A LOT more than what an traditional workflow engine could ever do.