redshift b15ab59fcd fix(ehbp): raise upstream timeout to 60s and return 504 on timeout ...

EHBP (Tinfoil) forwarding buffered responses through an h11 client with a
hard-coded 30-second inactivity timeout. Slow first-token latency or
queueing on larger models would trip it, surfacing a bare 500 instead of a
meaningful timeout.

- Bump the default EHBP timeout from 30s to 60s.
- Introduce EhbpTimeoutError (subclass of UpstreamError, code
  UPSTREAM_TIMEOUT, status 504) raised from connect/send/read timeouts.
- Bearer auth now surfaces a proper 504 via the existing UpstreamError
  handler instead of a generic 500.
- X-Cashu requests refund the redeemed amount and return a 504 with the
  refund token.

Adds tests for timeout conversion, exception metadata, and the X-Cashu
refund-on-timeout path.

2026-08-29 15:37:08 +01:00

..

clients

fix: switch openai NOT_GIVEN to omit for openai 2.x compat

2026-04-26 22:42:39 +02:00

__init__.py

feat: add Tinfoil direct blind-upstream integration

2026-06-21 13:16:01 +08:00

anthropic.py

refactor(upstream): resolve a provider's own row by primary key

2026-07-01 12:53:31 +02:00

auto_topup.py

chore: trim redundant comments

2026-08-26 22:51:09 +02:00

azure.py

revert: remove unrelated repository formatting

2026-07-26 20:12:12 +02:00

base.py

display correct provider

2026-08-27 13:23:27 +02:00

cache_breakpoints.py

explicit cache

2026-06-13 23:40:39 +02:00

count_tokens.py

better price estimation

2026-08-27 00:41:26 +02:00

deepseek_v4_pricing_shim.py

update-pricing

2026-06-27 16:01:45 +02:00

ehbp.py

fix(ehbp): raise upstream timeout to 60s and return 504 on timeout

2026-08-29 15:37:08 +01:00

fireworks.py

refactor(upstream): resolve a provider's own row by primary key

2026-07-01 12:53:31 +02:00

gemini_messages.py

revert: remove unrelated repository formatting

2026-07-26 20:12:12 +02:00

gemini.py

revert: remove unrelated repository formatting

2026-07-26 20:12:12 +02:00

generic.py

fix(upstream): validate native model_spec prices before trusting them

2026-07-07 12:24:01 +02:00

groq.py

revert: remove unrelated repository formatting

2026-07-26 20:12:12 +02:00

helpers.py

Merge branch 'main' of https://github.com/Routstr/routstr-core into ehbp-proxy-refactor

2026-07-13 11:14:15 +08:00

litellm_routing.py

revert: remove unrelated repository formatting

2026-07-26 20:12:12 +02:00

messages_dispatch.py

allow only anthropic fields

2026-08-22 21:55:07 +02:00

model_paths.py

clean up

2026-08-02 23:16:01 +02:00

ollama.py

revert: remove unrelated repository formatting

2026-07-26 20:12:12 +02:00

openai.py

refactor(upstream): resolve a provider's own row by primary key

2026-07-01 12:53:31 +02:00

openrouter.py

fix: address follow-up model path review

2026-07-27 23:17:13 +02:00

perplexity.py

refactor(upstream): resolve a provider's own row by primary key

2026-07-01 12:53:31 +02:00

ppqai.py

fix: address review findings on cooldowns, melt sizing, and stream finalization

2026-08-26 23:15:40 +02:00

pricing_resolver.py

fix(pricing): a rate spelled as a boolean is not a rate

2026-08-26 15:44:29 +02:00

rate_limit.py

revert: remove unrelated repository formatting

2026-07-26 20:12:12 +02:00

request_correction.py

guard spend-shaping params from strip to prevent overcharge

2026-08-23 14:27:31 +02:00

routstr.py

revert: remove unrelated repository formatting

2026-07-26 20:12:12 +02:00

tinfoil_trailer.py

fix(ehbp): raise upstream timeout to 60s and return 504 on timeout

2026-08-29 15:37:08 +01:00

tinfoil.py

Fix mypy: move type: ignore onto ASGITransport line

2026-07-16 16:43:52 +08:00

xai.py

revert: remove unrelated repository formatting

2026-07-26 20:12:12 +02:00