mirror of
https://github.com/Routstr/routstr-core.git
synced 2026-10-05 20:28:23 +00:00
redshift
bc8172783d
_fold_cache_into_input_tokens rolled cache_read/cache_creation tokens into the visible prompt_tokens for every dialect. In the OpenAI family (Venice, OpenAI, DeepSeek, OpenRouter, litellm) prompt_tokens already includes the cached portion, so the client-visible prompt count double-counted cache hits (Venice: 14075-token prompt shown as 27997 after a 13922-token cache read). Billing was unaffected — normalize_usage already subtracts cache exactly once and the fold runs after cost calculation. The fold now mirrors normalize_usage: only Anthropic-native input_tokens (which excludes cache) gets the roll-up; prompt_tokens is left untouched. Adds dict-based regression tests for the Venice/OpenAI, Anthropic-native and litellm-mirror shapes (existing Mock tests never exercised the logic).
FastAPI Async Unit Tests
This directory contains async unit tests for the Routstr proxy FastAPI application.
Installation
First, ensure you have the development dependencies installed:
uv pip install -e ".[dev]"
Running Tests
To run all tests:
pytest
To run tests with coverage:
pytest --cov=routstr --cov-report=html
To run specific test files:
pytest tests/test_main.py
pytest tests/test_models.py
pytest tests/test_proxy.py
To run only async tests:
pytest -m asyncio
Test Structure
conftest.py- Pytest fixtures and configurationtest_main.py- Tests for main app endpointstest_account.py- Tests for wallet/account management endpointstest_proxy.py- Tests for the proxy functionality with mocked upstreamtest_models.py- Tests for model pricing and data structures
Key Fixtures
async_client- Async HTTP client for testing FastAPI endpointstest_session- In-memory SQLite database session for teststest_api_key- Pre-configured API key with balanceapi_key_with_balance- API key with sufficient balance for proxy tests
Environment Variables
The tests automatically set up required environment variables in conftest.py. No manual configuration needed.
Writing New Tests
- Use
@pytest.mark.asynciofor async tests - Use the provided fixtures for database and client access
- Mock external dependencies (like upstream API calls)
- Test both success and error cases
- Verify database state changes when applicable