Shroominic
dc0f7d7f3b
fix max_cost discount
2025-10-22 11:54:17 +08:00
Shroominic
0da08fb945
refactor pricing, provider fees, realtime model map updates
2025-10-20 12:45:02 +08:00
Shroominic
61a0559f8e
Add upstream providers management and model integration
...
- Created migration scripts to establish the `upstream_providers` table and integrate it with the `models` table.
- Enhanced the proxy functionality to support dynamic upstream provider initialization and model resolution.
- Implemented API endpoints for managing upstream providers, including CRUD operations and model fetching.
- Refactored pricing calculations to accommodate upstream provider overrides and ensure accurate cost estimation.
- Updated the admin interface to allow for easy management of upstream providers and their associated models.
2025-10-13 17:17:54 +08:00
Shroominic
123353bf60
first step for multi upstream, subclassing
2025-10-07 11:36:52 +08:00
Shroominic
8beab0e28b
move functions into class to be overwritten by subclasses
2025-10-06 16:40:36 +08:00
Shroominic
f657859249
refactor upstream functions into UpstreamProvider class
2025-10-04 17:38:00 +08:00
Shroominic
d4e1715613
improved upstream error message handling
2025-09-22 16:36:52 +01:00
Shroominic
4cdbf23ec0
fixes
2025-09-10 13:28:48 +01:00
Shroominic
73d3613301
move MODELS to DB
2025-09-10 13:28:43 +01:00
Shroominic
2e42af61bb
rm tolerance percentage args
2025-09-09 14:00:39 +01:00
Shroominic
7dfc2f4056
max cost discount
2025-09-09 13:58:52 +01:00
Shroominic
15e61d1760
refactor(proxy): use settings for upstream base; integrate new pricing flow and header prep
2025-09-08 10:53:02 +01:00
shroominic and GitHub
f499be5c15
Merge pull request #160 from Routstr/azure-openai-compatibility
...
Azure OpenAI compatibility
2025-09-04 21:41:05 +01:00
Shroominic
b28aa20257
fix: always finalize reserved_balance; robust streaming finalization without usage or interruptions
2025-09-04 15:59:53 +01:00
Shroominic
207cafe285
azure openai compatibility
2025-09-04 15:29:06 +01:00
Shroominic
d7e35887de
fix max_cost race contition when price changes
2025-08-22 17:22:48 -03:00
Shroominic
6d46f86964
Apply proxy.py changes from reserved-balance-and-fixes branch
2025-08-22 15:29:20 -03:00
Shroominic
de5c2bd502
feat: add comprehensive logging to proxy endpoints
...
- Log complete request flow from entry to completion
- Add detailed bearer token validation logging
- Track payment processing with balance changes
- Log streaming vs non-streaming response detection
- Add categorized error logging (connection, timeout, network)
- Use key hash for secure tracking without exposing full keys
- Log response type analysis for chat completions
- Track failed request payment reversals
2025-08-12 15:29:45 -03:00
Shroominic
503e861621
change dir 'router' -> 'routstr'
2025-08-09 14:55:26 -03:00
Shroominic
shroominicandGitHub