USearch v3 is designed for 1B+, 10B+, 100B+ scales and reaches ~100K QPS on ~100M bit-vectors with 99%+ recall on a single outdated CPU. It also fixes the weakest modes of operation from v2.
Key points
Scale: supports 1B+, 10B+, 100B+ scales.
Performance: ~100K QPS over ~100M bit-vectors at 99%+ recall on a single outdated CPU.
Sources
HiCache Distributed Serving – Cache hit rate up to 95%
HiCache enables reuse of long prefixes across parallel model calls, achieving a cache hit rate of 95% on multi-turn agentic workloads. Median time-to-first-token drops below 3 seconds.
Key points
Cache hit rate: 30% → 95% on multi-turn agentic workloads with inputs typically 30K-200K tokens, up to 1M.
Median TTFT: below 3 seconds, down from previous unusable delays.
Sources
- Original post
- lmsys.org - Linked in the post
Photon migration to Vercel, 3x faster load
Photon moved from Framer to Vercel, achieving a three-times faster initial load. The migration used Next.js and AI and was completed in one week.
Key points
Migration: moved from Framer to Vercel
Performance: initial load is now 3x faster
Timeline: migration took one week using Next.js and AI
Sources
Data Bot launch gives on-demand data scientist access
Data Bot gives everyone at the company on-demand access to a data scientist. It is used by PMs, marketers, and other teams for product usage, campaign results, dashboards, and metric tracking.
Key points
Feature: Team Bot gives everyone at the company on-demand access to a data scientist.
Use cases: PMs investigate product usage, marketers measure campaign results, teams build dashboards and track key metrics.
Sources
USDG launch on Arbitrum, Robinhood Earn rollout
USDG went live on Arbitrum One and Robinhood Earn was rolled out to all eligible users in October. The post lists partners that shipped this month, including Arbitrum joining GDN.
Key points
USDG live on Arbitrum One
Robinhood Earn rolled out to all eligible users
Sources
Atomic Agent – generate images and videos locally
Atomic Agent lets you generate images and videos on your hardware. It offers prompt enhancement, editing, restyling, extending, upscaling, and adding sound to videos.
Key points
Feature: generate images locally
Feature: turn images into videos with sound locally
Sources
- Original post
- atomicagent.io - Linked in the post
RSI reading poll results show top votes for Jerry Tworek and Jun Park
RSI reading poll lists top voted contributors. Jerry Tworek received 5 votes and Jun Park received 4 votes. John Schulman and Rohan each received 3 votes.
Key points
Jerry Tworek, Core Automation: 5 votes
Jun Park, Hillclimb: 4 votes
Sources
GetContextDev integration adds scrape search monitor
GetContextDev integration adds scrape, search, monitor, and collect data for every account. It can be used in any harness or through the chat UI.
Key points
Integration: first integration in the tools marketplace, @getcontextdev.
Access: every account gets scrape, search, monitor, and collect data, usable in any harness or chat UI.
