Settings
Org configuration β grouped in tabs; every change is saved to the database.
π’ Organization name β
π Reset cycle β
Provider billing is monthly β allocation runs show this month vs funded so weekly slices reconcile against the monthly invoice.
π± Credits & allocationthe global defaults β per-provider values above override them
Credit unit (default) β
Allocation step β
β 10,000 tokens per click. Managers' buttons now show Β±10.
ROI pricing β
New seat defaults β
Grant a seat β auto-gets β60 now.
π‘ Policy & guardrailsenforcement, visibility and who may move credits
Enforcement β
β Gateway is in MOCK mode. The console demo works, but no real employee AI traffic is intercepted yet β minting a key won't enforce anything live. To go live: add provider keys to
.env, set LAB_GATEWAY=litellm, run docker compose up -d β then mint keys for everyone with the Mint for all seat-holders button on Gateway Keys (or headless: docker compose exec console node --import tsx lab/web.ts --mint-all-seats).β½ Reserve (fuel light) β
π Pool visibility for staff β
Identity source β
π€ Peer credit transfers β who may send credits wallet β wallet
Admins can always move credits. This only limits employee/manager peer gifts & sends.
π Gatewayadd-ons, machine setup and app pools
π Gateway add-ons
mock gatewayLatency impact per message β so you know the cost before turning each one on.
Exact cache (Redis) premiumβ
hit: β100sβ1000s ms (faster) Β· miss: +1β5ms
β‘ Cache marker premiumβ
β0ms Β· display flag only
!fresh bypass premiumβ
β0ms Β· skips the cache on demand
Smart model routing premiumβ
β0β2ms heuristic Β· +100β300ms if a classifier model is used
Per-user limits & budgetsβ
Always onAlways on β enforced at the gateway on every minted key
Real-time attributionβ
Always onAlways on β every minted key carries the person's handle
Configured in the gateway, not here
These are settings of your LiteLLM gateway (
install/litellm-config.yaml), not of this console β so there is no switch for them here.Provider fallbacks
litellm_settings.fallbacks β deliberately unsetNot shipped, on purpose: an OpenAI request must never be silently served and billed by Anthropic (or the reverse). That spends one provider's credits on another β breaking "credits are NOT fungible between providers" β and bills a person who holds no seat there. Per-key model scoping, set at mint, enforces the same rule.
Semantic cache
litellm_settings.cache_params.type: redis-semanticNeeds an embedding model. Set the cache type, similarity threshold and embedding model in the gateway config; this console neither enables nor measures it.
PII guardrails
guardrails: presidio-pii (mode: pre_call)Runs in a Presidio sidecar beside the gateway and is configured there. Nothing in this console scans, redacts or blocks prompt content β the console never sees prompt content.
Export to New Relic
litellm_settings.success_callback: ["newrelic"]Set the callback plus NEW_RELIC_LICENSE_KEY on the gateway container. The console exports metrics nowhere.
π₯ Employee machine setup β
Self-serve download in My Wallet
each employee can download a file with their own key
Employees can mint their own key
from My Wallet β budget auto-set to their wallet balance; spend debits their own wallet
π€ App pools (service accounts) β
Enable app pools premium
managers can create Application pools + mint their app API keys
π Providerswho supplies the AI + what a credit is worth, per vendor
Connected providers β
| Provider | tokens per β1 | $ per β1 | API key | |
|---|---|---|---|---|
| OpenAI openai Β· openai |
from env |
|||
| Anthropic (Claude) anthropic Β· anthropic |
from env |
Removal requires typing the provider id (written confirmation) β data stays intact.
π― Provider truth & auto-trackingmatch the company pool to the real provider account; fund empty departments
π― Provider-truth reconciliation β
nightly Β· 02:45 UTCConfig completeness per provider β the nightly job runs only the β ready ones and skips the rest (never blocks the others). "Check now" applies it on demand for one provider.
OpenAI β key not set
openai
not set π» End-of-day empty-department top-up β
fund empty department pools from an abundant company pool
Anthropic (Claude) β key not set
anthropic
not set π» End-of-day empty-department top-up β
fund empty department pools from an abundant company pool
β€ Auto-sweep knobs β
Forecast + reserve run β manual, at most once per reset cycle.