mirror of
https://github.com/vitorpamplona/amethyst.git
synced 2026-08-11 08:47:33 +00:00
Vitor PamplonaandClaude Opus 4.8
3cba102a09
Speeds up a from-scratch GrapeRank crawl ~25-30% at equal completeness on a drift-controlled A/B, by: - lowering the per-relay concurrent-sub cap 100→16 — the old 100 drowned popular relays (damus/nos.lol) in concurrent giant REQs, driving them to time out; 16 restores their responsiveness (damus yield 0%→14%) and is still generous for the single-user fetches other amy commands do, - shedding proven-dead relays from the kind:10002 discovery sweep instead of re-hammering refusing indexers every round, - trimming the sharded backbone sweep 6→2 rotations (Phase A was ~36% of the crawl at half Phase B's per-list efficiency; 2 clears the bulk with no completeness loss). Also adds relay observability under --diagnose to document how relays reply to our queries: per-relay telemetry (outcome mix, yield, latency, worst time-sinks), a LIVE / THROTTLED / UNREACHABLE classification table with the limits we settled on per relay, and per-round Phase-A/Phase-B timing; plus contact_lists_by_hop in the sync result for per-hop completeness. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>