mirror of
https://github.com/Routstr/routstr-core.git
synced 2026-10-06 12:38:23 +00:00
redshift
71c8ae3c84
The Responses API reports usage in its own dialect: input_tokens: 9434 (inclusive grand total) input_tokens_details.cached_tokens: 8704 (cached subset) normalize_usage only knew prompt_tokens_details (chat completions), Anthropic top-level fields, and DeepSeek hit/miss. For /v1/responses payloads it found no cache fields and, seeing no prompt_tokens key, fell into the Anthropic-native branch that treats input_tokens as excluding cache — so cached tokens were billed at the full input rate and cache_read_input_tokens was recorded as 0. Two changes: * _extract_cache_tokens also reads input_tokens_details.cached_tokens and input_tokens_details.cache_write_tokens. * normalize_usage treats input_tokens as an inclusive grand total when input_tokens_details is present (Anthropic native never sends that object, so it safely disambiguates the field-name collision). Fixes both streaming and non-streaming /v1/responses billing, which share calculate_cost -> normalize_usage.
FastAPI Async Unit Tests
This directory contains async unit tests for the Routstr proxy FastAPI application.
Installation
First, ensure you have the development dependencies installed:
uv pip install -e ".[dev]"
Running Tests
To run all tests:
pytest
To run tests with coverage:
pytest --cov=routstr --cov-report=html
To run specific test files:
pytest tests/test_main.py
pytest tests/test_models.py
pytest tests/test_proxy.py
To run only async tests:
pytest -m asyncio
Test Structure
conftest.py- Pytest fixtures and configurationtest_main.py- Tests for main app endpointstest_account.py- Tests for wallet/account management endpointstest_proxy.py- Tests for the proxy functionality with mocked upstreamtest_models.py- Tests for model pricing and data structures
Key Fixtures
async_client- Async HTTP client for testing FastAPI endpointstest_session- In-memory SQLite database session for teststest_api_key- Pre-configured API key with balanceapi_key_with_balance- API key with sufficient balance for proxy tests
Environment Variables
The tests automatically set up required environment variables in conftest.py. No manual configuration needed.
Writing New Tests
- Use
@pytest.mark.asynciofor async tests - Use the provided fixtures for database and client access
- Mock external dependencies (like upstream API calls)
- Test both success and error cases
- Verify database state changes when applicable