mirror of
https://github.com/Routstr/routstr-core.git
synced 2026-08-09 19:04:47 +00:00
Jeroen UbbinkandClaude Opus 4.8
2a27fb239e
A generic (OpenAI-compatible) upstream whose /models response omits pricing was silently defaulting to $0.001/M tokens and a 4096 context window. For a provider like DeepSeek that reports no price, this undercharged real usage by ~280x — a direct money leak — while presenting a plausible-looking price. Resolve each model through trust-ordered sources instead: the provider's native schema (Venice's model_spec) first, then litellm's bundled cost map (curated list prices), then the OpenRouter feed. Capture the richer metadata those sources carry (cache rates, modalities, max output tokens, context) rather than only price and context. When no source knows the model, import it disabled with a warning rather than invent a number, so an operator can price it before it serves traffic. Context has no trustworthy source of last resort, but it is not a billing input, so a model priced without a reported context window falls back to an id-based estimate. The whole source-incomplete fallback (price chain + context estimate) lives in one pricing_resolver module so it can later be hoisted into the base provider unchanged. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Routstr Payment Proxy
Routstr is a decentralized protocol for permissionless, private, and censorship-resistant AI inference. It combines Nostr for discovery and Cashu for private Bitcoin micropayments.
This repo contains Routstr Core: a FastAPI-based reverse proxy that sits in front of OpenAI-compatible APIs and handles pay-per-request billing.
Start Here
- Overview: https://docs.routstr.com/overview/
- Provider Guide: https://docs.routstr.com/provider/quickstart/
- User Guide: https://docs.routstr.com/user-guide/introduction/
Basic Usage
If you are a user/developer, you just point an OpenAI-compatible SDK at a Routstr node and pay with a Cashu token.
OpenAI SDK
from openai import OpenAI
client = OpenAI(
base_url="https://api.routstr.com/v1",
api_key="cashuBo2FteCJodHRwczovL21...",
)
response = client.chat.completions.create(
model="gpt-5-nano",
messages=[{"role": "user", "content": "hello"}],
)
print(response.choices[0].message.content)
cURL
curl https://api.routstr.com/v1/chat/completions \
-H "Content-Type: application/json" \
-H "x-cashu: cashuBo2FteCJodHRwczovL21..." \
-d '{
"model": "gpt-5-nano",
"messages": [{"role": "user", "content": "hello"}]
}'
Quick Start (Docker)
If you are a node runner, start a Routstr Core instance using Docker Compose:
-
Prepare your
.env:ADMIN_PASSWORD=mysecretpassword NAME="My AI Node" DESCRIPTION="Fast access to models" NSEC=yournsec RECEIVE_LN_ADDRESS=yourname@wallet.com -
Start the services:
docker compose up -d -
Configure: Open http://localhost:8000/admin/ to connect your AI providers and set pricing.
For full instructions, see the Provider Quick Start Guide.
Development
make setup
cp .env.example .env
fastapi run routstr