@SalvagedTechnic@mastodon.social
2026-04-26 22:04 UTC
@mikeyp@hachyderm.io @nholzschuch@piaille.fr Very cool! I’m keenly waiting for this sort of thing to become a properly maintained app (with guardrails).
I don’t suppose porting Ollama over would be a fun exercise too? There’s a few ‘Ollama’ local chat apps popping up on the store but none which expose their models via APIs like this Foundation one… 🙏
a-Shell doesn’t seem to allow making non-localhost insecure connections either. So close! 🤦
OpenRouter seems cool, but no chance I’m trusting it with personal data.
Replies (1)
-
@mikeyp@hachyderm.io 2026-04-26 23:16
@SalvagedTechnic@mastodon.social Thanks! I'm keeping an eye on ai-local https://ai-local.brunowernimont.me/, which exposes on-device models via OpenAI API. a-agent can connect, but ai-local doesn't like the a-agent tools, so we'll see if the developer fixes it. If so, we could have a completely on-device agent running something like Gemma4. In the meantime, a-agent should work with any LLM provider that exposes OpenAI API, so maybe you could find one you trust. But don't expect safer guardrails... ;-)