thefux 2efbc3783c fix: inject full cost breakdown including cache msats into all response paths
Three issues fixed in the balance-mode (apikeys) and x-cashu cost paths:

1. inject_cost_metadata: usage.cost was set to a plain USD float instead
   of the full cost object. The SDK's extractUsageFromResponseBody expects
   an object with total_msats/input_msats/output_msats/cache fields.
   Now writes a complete cost_obj with all fields including cache_read_msats
   and cache_creation_msats.

2. _calculate_from_usd_cost: cache_read_msats and cache_creation_msats
   were hardcoded to 0. Now allocates them proportionally from the input
   portion based on cache_read_tokens vs regular input_tokens.

3. Balance-mode non-streaming response paths (chat completions + litellm
   messages): now inject X-Routstr-Cost-Msats/X-Routstr-Input-Cost-Msats/
   X-Routstr-Output-Cost-Msats/X-Routstr-Cost-Usd headers so the SDK's
   extractUsageFromResponseHeaders can populate the breakdown.

4. _inject_cost_into_usage: was missing cache_read_input_tokens,
   cache_creation_input_tokens, cache_read_msats, cache_creation_msats
   from the injected cost object. Now includes all fields.

Verified with streaming x-cashu + long context (10080 cached tokens):
  cache_read_input_tokens: 10080
  cache_read_msats: 3330
  cache_creation_msats: 0
  input_msats: 1 (regular input after cache subtraction)
  output_msats: 165
  total_msats: 3496
2026-07-24 16:38:50 +00:00
2026-07-24 01:10:57 +02:00
2025-10-22 12:18:00 +08:00
2025-11-23 21:51:16 +00:00
2025-10-27 12:38:55 +08:00
2025-06-09 23:46:19 +02:00
2025-08-12 15:02:22 -03:00
2026-07-07 17:22:48 +02:00
2025-04-08 21:42:32 +08:00
2026-01-24 17:55:45 +08:00
2025-08-01 22:31:18 -03:00

Routstr Payment Proxy

License Stars Issues Release

Routstr is a decentralized protocol for permissionless, private, and censorship-resistant AI inference. It combines Nostr for discovery and Cashu for private Bitcoin micropayments.

This repo contains Routstr Core: a FastAPI-based reverse proxy that sits in front of OpenAI-compatible APIs and handles pay-per-request billing.

Start Here

Basic Usage

If you are a user/developer, you just point an OpenAI-compatible SDK at a Routstr node and pay with a Cashu token.

OpenAI SDK

from openai import OpenAI

client = OpenAI(
    base_url="https://api.routstr.com/v1",
    api_key="cashuBo2FteCJodHRwczovL21...",
)

response = client.chat.completions.create(
    model="gpt-5-nano",
    messages=[{"role": "user", "content": "hello"}],
)

print(response.choices[0].message.content)

cURL

curl https://api.routstr.com/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "x-cashu: cashuBo2FteCJodHRwczovL21..." \
  -d '{
    "model": "gpt-5-nano",
    "messages": [{"role": "user", "content": "hello"}]
  }'

Quick Start (Docker)

If you are a node runner, start a Routstr Core instance using Docker Compose:

  1. Prepare your .env:

    # Optional: encrypts node secrets at rest. If unset, the node generates a key
    # on first start, writes it to routstr_secret.key, and prints it once — back
    # up that file. Set it explicitly to manage the key yourself (recommended in
    # production).
    ROUTSTR_SECRET_KEY=<generated-key>
    NAME="My AI Node"
    DESCRIPTION="Fast access to models"
    RECEIVE_LN_ADDRESS=yourname@wallet.com
    

    Your Nostr identity (nsec) is not set in .env — configure it from the admin UI after first start, where it's stored encrypted in the database. (NSEC in .env is still read once as a legacy seed for existing deployments.)

    If you don't set one, a key is generated and printed on first start — save it somewhere safe (losing it makes previously encrypted secrets unreadable). To supply your own, generate it once and keep it stable:

    uv run python -c "from cryptography.fernet import Fernet; print(Fernet.generate_key().decode())"
    
  2. Start the services:

    docker compose up -d
    
  3. Get your admin password: On first start the node generates an admin password and logs it once with the /admin URL. Read it from the logs:

    docker compose logs routstr | grep -i admin
    

    (Lost it? Reset with docker compose exec routstr /.venv/bin/python scripts/reset_admin_password.py --regenerate.)

  4. Configure: Open http://localhost:8000/admin/ to connect your AI providers and set pricing.

For full instructions, see the Provider Quick Start Guide.

Development

make setup
cp .env.example .env
fastapi run routstr
S
Description
Routstr is a decentralized protocol for permissionless, private, and censorship-resistant AI inference.
Readme GPL-3.0
11 MiB
Languages
Python 68.8%
TypeScript 29%
HTML 1.5%
Makefile 0.3%
Shell 0.2%
Other 0.1%