carlos / platform Public

An LLM gateway per app Idea open

Hosted builders ship model calls as a built-in. A platform-side gateway would let an app call a model without holding a provider key:

  • an app-scoped endpoint;
  • a per-app key the platform holds;
  • metering per instance;
  • logs of what was sent and returned, readable by the owner.

For an app like ips, where every automation is a proposal a named person accepts, the log is as valuable as the call: it's the record of what the system suggested and on what input.

--- Filed from the ips repository (Turnkey's insolvency practice system, built on rastrillo v0.26.0 and deployed on CARLOS), where this was worked around. Paths without a repository prefix are in ips.