Shroominic
320cfe82fd
auto populate providers from available classes
2025-11-11 16:10:42 +08:00
Shroominic
d9d2e17e5d
refactor upstream files and classes
2025-11-06 17:23:37 +08:00
9qeklajc
c49da9bf84
ignore error
2025-11-04 23:50:55 +01:00
9qeklajc
c2b97f8e3b
use enabled flag
2025-11-04 23:48:38 +01:00
9qeklajc
88fbefbd18
fmt
2025-11-04 23:29:07 +01:00
9qeklajc
ded82cd729
fix model endpoint & filter query
2025-11-04 23:16:08 +01:00
9qeklajc
1e90b223cf
fix model filter
2025-11-04 22:45:18 +01:00
Shroominic
44286067ae
fix typing
2025-11-03 22:24:46 +08:00
9qeklajc
4859dbd163
fix models filtering
2025-11-02 23:42:03 +01:00
9qeklajc
a3d9022e2b
add generic upstream
2025-11-02 11:50:13 +01:00
Shroominic
dc4dbb4cff
max_tokens must be an integer
2025-11-02 15:47:26 +08:00
Shroominic
39047361d6
model/provider selection based on pricing
2025-11-01 13:47:23 +08:00
Shroominic
db0f6e65ef
fix typing issue
2025-10-30 12:47:04 +08:00
9qeklajc
b6fbe3b810
do not response with disabled models
2025-10-29 22:48:09 +01:00
Shroominic
862df136d6
Merge v0.1.4 changes from 'origin/main' into v0.2.0-final
2025-10-27 14:07:37 +08:00
Shroominic
a72653a401
fix alias precedence so glm-4.6 maps to normal model, not glm-4.6:exacto
2025-10-27 13:21:10 +08:00
9qeklajc
c3c4e886c8
fix proxy x-cashu model forwarding
2025-10-24 22:20:03 +02:00
9qeklajc
2ed72d16da
fix to request correct model
2025-10-24 21:13:18 +02:00
Shroominic
8950cc5b7f
rm redundant try except
2025-10-22 12:07:27 +08:00
Shroominic
dc0f7d7f3b
fix max_cost discount
2025-10-22 11:54:17 +08:00
Shroominic
0da08fb945
refactor pricing, provider fees, realtime model map updates
2025-10-20 12:45:02 +08:00
Shroominic
6d6651acbe
fix: max_tokens as string should not work
2025-10-18 13:10:09 +08:00
Shroominic
61a0559f8e
Add upstream providers management and model integration
...
- Created migration scripts to establish the `upstream_providers` table and integrate it with the `models` table.
- Enhanced the proxy functionality to support dynamic upstream provider initialization and model resolution.
- Implemented API endpoints for managing upstream providers, including CRUD operations and model fetching.
- Refactored pricing calculations to accommodate upstream provider overrides and ensure accurate cost estimation.
- Updated the admin interface to allow for easy management of upstream providers and their associated models.
2025-10-13 17:17:54 +08:00
Shroominic
123353bf60
first step for multi upstream, subclassing
2025-10-07 11:36:52 +08:00
Shroominic
8beab0e28b
move functions into class to be overwritten by subclasses
2025-10-06 16:40:36 +08:00
Shroominic
f657859249
refactor upstream functions into UpstreamProvider class
2025-10-04 17:38:00 +08:00
Shroominic
d4e1715613
improved upstream error message handling
2025-09-22 16:36:52 +01:00
Shroominic
4cdbf23ec0
fixes
2025-09-10 13:28:48 +01:00
Shroominic
73d3613301
move MODELS to DB
2025-09-10 13:28:43 +01:00
Shroominic
2e42af61bb
rm tolerance percentage args
2025-09-09 14:00:39 +01:00
Shroominic
7dfc2f4056
max cost discount
2025-09-09 13:58:52 +01:00
Shroominic
15e61d1760
refactor(proxy): use settings for upstream base; integrate new pricing flow and header prep
2025-09-08 10:53:02 +01:00
shroominic and GitHub
f499be5c15
Merge pull request #160 from Routstr/azure-openai-compatibility
...
Azure OpenAI compatibility
2025-09-04 21:41:05 +01:00
Shroominic
b28aa20257
fix: always finalize reserved_balance; robust streaming finalization without usage or interruptions
2025-09-04 15:59:53 +01:00
Shroominic
207cafe285
azure openai compatibility
2025-09-04 15:29:06 +01:00
Shroominic
d7e35887de
fix max_cost race contition when price changes
2025-08-22 17:22:48 -03:00
Shroominic
6d46f86964
Apply proxy.py changes from reserved-balance-and-fixes branch
2025-08-22 15:29:20 -03:00
Shroominic
de5c2bd502
feat: add comprehensive logging to proxy endpoints
...
- Log complete request flow from entry to completion
- Add detailed bearer token validation logging
- Track payment processing with balance changes
- Log streaming vs non-streaming response detection
- Add categorized error logging (connection, timeout, network)
- Use key hash for secure tracking without exposing full keys
- Log response type analysis for chat completions
- Track failed request payment reversals
2025-08-12 15:29:45 -03:00
Shroominic
503e861621
change dir 'router' -> 'routstr'
2025-08-09 14:55:26 -03:00
Shroominic
9qeklajc
shroominicandGitHub