Commit Graph
50 Commits
Author SHA1 Message Date
shroominicandGitHub 0d07dd0cdb Merge pull request #303 from Routstr/ignore-disabled-provider
ignore disabled provider
2026-01-15 11:12:16 +08:00
Shroominic 24015ebec1 Revert "Merge remote-tracking branch 'origin/mock-upstream-with-testnut-mint' into v0.2.2"
This reverts commit 5a4ba60072, reversing
changes made to eed5bc5b04.
2026-01-13 06:31:24 +08:00
9qeklajc 3bc38937e8 ignore disabled provider 2026-01-10 18:39:24 +01:00
9qeklajc bdf0e2c192 #282 more filter options 2026-01-03 22:49:35 +01:00
Shroominic 5a4ba60072 Merge remote-tracking branch 'origin/mock-upstream-with-testnut-mint' into v0.2.2 2025-12-28 11:18:08 +01:00
9qeklajc 4418d87664 Merge branch 'v0.2.1' into openai-responses-api 2025-12-26 22:37:07 +01:00
Shroominic ea655b748b optimize startup time 2025-12-26 12:33:42 +01:00
9qeklajc a6d0bd1a19 update aliases 2025-12-23 23:43:16 +01:00
Shroominic ec0fcfb48b mock-upstream-with-testnut-mint 2025-12-20 13:54:14 +01:00
9qeklajc 82d2627c60 added reponse api 2025-12-15 21:11:43 +01:00
9qeklajc 8df0c17bc3 embedding integration 2025-12-03 22:20:31 +01:00
Shroominic 320cfe82fd auto populate providers from available classes 2025-11-11 16:10:42 +08:00
Shroominic d9d2e17e5d refactor upstream files and classes 2025-11-06 17:23:37 +08:00
9qeklajc c49da9bf84 ignore error 2025-11-04 23:50:55 +01:00
9qeklajc c2b97f8e3b use enabled flag 2025-11-04 23:48:38 +01:00
9qeklajc 88fbefbd18 fmt 2025-11-04 23:29:07 +01:00
9qeklajc ded82cd729 fix model endpoint & filter query 2025-11-04 23:16:08 +01:00
9qeklajc 1e90b223cf fix model filter 2025-11-04 22:45:18 +01:00
Shroominic 44286067ae fix typing 2025-11-03 22:24:46 +08:00
9qeklajc 4859dbd163 fix models filtering 2025-11-02 23:42:03 +01:00
9qeklajc a3d9022e2b add generic upstream 2025-11-02 11:50:13 +01:00
Shroominic dc4dbb4cff max_tokens must be an integer 2025-11-02 15:47:26 +08:00
Shroominic 39047361d6 model/provider selection based on pricing 2025-11-01 13:47:23 +08:00
Shroominic db0f6e65ef fix typing issue 2025-10-30 12:47:04 +08:00
9qeklajc b6fbe3b810 do not response with disabled models 2025-10-29 22:48:09 +01:00
Shroominic 862df136d6 Merge v0.1.4 changes from 'origin/main' into v0.2.0-final 2025-10-27 14:07:37 +08:00
Shroominic a72653a401 fix alias precedence so glm-4.6 maps to normal model, not glm-4.6:exacto 2025-10-27 13:21:10 +08:00
9qeklajc c3c4e886c8 fix proxy x-cashu model forwarding 2025-10-24 22:20:03 +02:00
9qeklajc 2ed72d16da fix to request correct model 2025-10-24 21:13:18 +02:00
Shroominic 8950cc5b7f rm redundant try except 2025-10-22 12:07:27 +08:00
Shroominic dc0f7d7f3b fix max_cost discount 2025-10-22 11:54:17 +08:00
Shroominic 0da08fb945 refactor pricing, provider fees, realtime model map updates 2025-10-20 12:45:02 +08:00
Shroominic 6d6651acbe fix: max_tokens as string should not work 2025-10-18 13:10:09 +08:00
Shroominic 61a0559f8e Add upstream providers management and model integration
- Created migration scripts to establish the `upstream_providers` table and integrate it with the `models` table.
- Enhanced the proxy functionality to support dynamic upstream provider initialization and model resolution.
- Implemented API endpoints for managing upstream providers, including CRUD operations and model fetching.
- Refactored pricing calculations to accommodate upstream provider overrides and ensure accurate cost estimation.
- Updated the admin interface to allow for easy management of upstream providers and their associated models.
2025-10-13 17:17:54 +08:00
Shroominic 123353bf60 first step for multi upstream, subclassing 2025-10-07 11:36:52 +08:00
Shroominic 8beab0e28b move functions into class to be overwritten by subclasses 2025-10-06 16:40:36 +08:00
Shroominic f657859249 refactor upstream functions into UpstreamProvider class 2025-10-04 17:38:00 +08:00
Shroominic d4e1715613 improved upstream error message handling 2025-09-22 16:36:52 +01:00
Shroominic 4cdbf23ec0 fixes 2025-09-10 13:28:48 +01:00
Shroominic 73d3613301 move MODELS to DB 2025-09-10 13:28:43 +01:00
Shroominic 2e42af61bb rm tolerance percentage args 2025-09-09 14:00:39 +01:00
Shroominic 7dfc2f4056 max cost discount 2025-09-09 13:58:52 +01:00
Shroominic 15e61d1760 refactor(proxy): use settings for upstream base; integrate new pricing flow and header prep 2025-09-08 10:53:02 +01:00
shroominicandGitHub f499be5c15 Merge pull request #160 from Routstr/azure-openai-compatibility
Azure OpenAI compatibility
2025-09-04 21:41:05 +01:00
Shroominic b28aa20257 fix: always finalize reserved_balance; robust streaming finalization without usage or interruptions 2025-09-04 15:59:53 +01:00
Shroominic 207cafe285 azure openai compatibility 2025-09-04 15:29:06 +01:00
Shroominic d7e35887de fix max_cost race contition when price changes 2025-08-22 17:22:48 -03:00
Shroominic 6d46f86964 Apply proxy.py changes from reserved-balance-and-fixes branch 2025-08-22 15:29:20 -03:00
Shroominic de5c2bd502 feat: add comprehensive logging to proxy endpoints
- Log complete request flow from entry to completion
- Add detailed bearer token validation logging
- Track payment processing with balance changes
- Log streaming vs non-streaming response detection
- Add categorized error logging (connection, timeout, network)
- Use key hash for secure tracking without exposing full keys
- Log response type analysis for chat completions
- Track failed request payment reversals
2025-08-12 15:29:45 -03:00
Shroominic 503e861621 change dir 'router' -> 'routstr' 2025-08-09 14:55:26 -03:00