π Vector Search Tuning: The Hidden Knobs
Vector search has a lot of tuning knobs, but which one should you change first when search quality isn't where you want it to be? Key Points:
- Vector Search Tuning Knobs:
hnsw_ef, candidate depth, RRFk, quantization, reranking, and more. Each knob affects search quality, but understanding their interplay is crucial. - Tuning Strategy: Start with the most impactful knobs, such as
hnsw_efand candidate depth, and iteratively refine other parameters to achieve optimal search quality. - Actionable Takeaway: Regularly monitor search quality and adjust tuning knobs accordingly to ensure optimal performance.
π Resources:
- Original post β
- Qdrant Engine
- Vector Search Tuning Knobs
- Brief description: Vector search tuning knobs
π GSAP Agent Skills Demo
Made this crazy demo to show off the GSAP agent skills I've been iterating on. It got a little out of hand. Powered by @greensock inspired by the old glory days of Flash Key Points:
- GSAP Agent Skills: GSAP agent skills are a powerful tool for creating complex animations and interactions. This demo showcases their capabilities.
- Agent Skills: Agent skills are a set of pre-built animations and interactions that can be easily combined to create complex behaviors.
- Actionable Takeaway: Use GSAP agent skills to create engaging and interactive experiences.
π Resources:
- Original post β
- Greensock
- GSAP Agent Skills Demo
- Brief description: GSAP agent skills demo
π¨ Cache Hits and GPU Waiting
A cache is only worth what it hits. The community's having a KV cache moment. Here's the corner we work in: In long-context serving, a cache hit can still leave the GPU waiting for data. When KV lives outside GPU memory, how you bring it back matters. That's the problem we set Key Points:
- Cache Hits and GPU Waiting: Cache hits are crucial, but they can also lead to GPU waiting if the data is not readily available.
- GPU Waiting: GPU waiting occurs when the GPU is waiting for data to be fetched from memory or other sources.
- Actionable Takeaway: Optimize cache hits to minimize GPU waiting and improve overall performance.
π Resources:
- Original post β
- Tencent AI News
- Cache Hits and GPU Waiting
- Brief description: Cache hits and GPU waiting
π€ AI Agents at Scale
One month = 130,000 engineering tasks done by AI agents. @DoorDash is already operating Agents at serious scale. Once you reach that point, the model isnβt the only thing that matters. You need: β Agent identity β Tool access β Permissions β Communication β Key Points:
- AI Agents at Scale: AI agents can perform a large number of tasks, but they require careful management and optimization.
- Agent Identity: Agent identity is crucial for ensuring that AI agents are properly authenticated and authorized.
- Actionable Takeaway: Establish clear agent identity and access controls to ensure secure and efficient operation.
π Resources:
- Original post β
- Fetch.ai
- AI Agents at Scale
- Brief description: AI agents at scale
ποΈ reSpeaker Clip: Open Wearable AI Recorder
Meet reSpeaker Clip β an Open Wearable AI Recorder built for real-world conversations. Clip it. Wear it. Capture it. Build with it. But itβs more than a recorder. π Open SDK & Firmware ποΈ Dual-Mic Audio Capture π‘ Wi-Fi 6 + Bluetooth 5.3 πΎ 2GB Onboard Storage From Key Points:
- reSpeaker Clip: reSpeaker Clip is an open-source wearable AI recorder designed for real-world conversations.
- Open SDK & Firmware: The device comes with an open SDK and firmware, allowing developers to customize and extend its capabilities.
- Actionable Takeaway: Explore the reSpeaker Clip's features and capabilities for building innovative AI-powered applications.
π Resources:
- Original post β
- Seeed Studio
- reSpeaker Clip
- Brief description: reSpeaker Clip
π οΈ Site of the Day: IKEA βTaking Apart the 30β
Site of the Day - IKEA βTaking Apart the 30β (30th Anniversary) MRM Spain β @mrmspain /nk.studio β @NKStudio Mach Studio β @StudioMach βοΈ ScrollTrigger, SplitText, useGSAP π οΈ React site β https:// family.ikea.es/demos/desmonta ndo-los-30/ β¦ showcase β https:// gsap.com/showcase Key Points:
- Site of the Day: IKEA's "Taking Apart the 30" website showcases innovative use of GSAP and ScrollTrigger.
- GSAP and ScrollTrigger: The website utilizes GSAP and ScrollTrigger to create engaging animations and interactions.
- Actionable Takeaway: Explore the website's code and learn from its implementation of GSAP and ScrollTrigger.
π Resources:
- Original post β
- Greensock
- Site of the Day
- Brief description: Site of the day
π Browserbase vs Obscura
okay, this is genuinely impressive. browserbase charges $99 a month for 500 browser hours. obscura runs unlimited, free, on your own machine. β 30mb memory vs 200mb+ chrome β native rendering, no chromium needed β real js via v8 engine β puppeteer and playwright compatible Key Points:
- Browserbase vs Obscura: Browserbase and Obscura are two tools for browser automation, but they have different pricing models and features.
- Obscura: Obscura is a free, open-source tool that runs on your own machine, offering unlimited browser hours and native rendering.
- Actionable Takeaway: Consider using Obscura for browser automation tasks, especially for large-scale or long-running tasks.
π Resources:
- Original post β
- The Whizz AI
- Browserbase vs Obscura
- Brief description: Browserbase vs Obscura
π The Digitized World
If you think about it... Our world is at the verge of becoming 100% digitised. We already spend a huge part of our lives behind screens. AI is bringing intelligence into the digital realm. Crypto is bringing ownership, money and coordination into it. And weβre quickly Key Points:
- The Digitized World: The world is rapidly becoming digitized, with AI and crypto playing key roles in shaping this new reality.
- AI and Crypto: AI is bringing intelligence to the digital realm, while crypto is enabling ownership, money, and coordination.
- Actionable Takeaway: Stay informed about the latest developments in AI and crypto to navigate this rapidly changing world.
π Resources:
- Original post β
- Ivaav Music
- The Digitized World
- Brief description: The digitized world
π Monad API Hub
Introducing Monad API Hub One place for developers and agents to access data, search, and AI APIs. No API keys. No subscriptions. Pay per request with USDC on Monad. Explore API Hub: https:// app.monad.xyz/agents/api-hub Key Points:
- Monad API Hub: Monad API Hub is a platform that provides access to data, search, and AI APIs, with a pay-per-request model.
- No API Keys or Subscriptions: Monad API Hub eliminates the need for API keys and subscriptions, making it easier to access APIs.
- Actionable Takeaway: Explore Monad API Hub for accessing a wide range of APIs.
π Resources:
- Original post β
- Monad
- Monad API Hub
- Brief description: Monad API hub
π€ FLOP and GenLayer
AI agents need three things to operate at scale: food (compute) to power them, memory to keep them running, and a place to settle disputes when things go wrong. This is the thesis behind FLOP and GenLayer. Great take from the godfather of crypto derivatives, @CryptoHayes . Key Points:
- FLOP and GenLayer: FLOP and GenLayer are two concepts that aim to address the challenges of operating AI agents at scale.
- Compute, Memory, and Dispute Resolution: AI agents require compute power, memory, and a mechanism for resolving disputes to operate effectively.
- Actionable Takeaway: Explore FLOP and GenLayer for insights into operating AI agents at scale.
π Resources:
- Original post β
- GenLayer
- FLOP and GenLayer
- Brief description: FLOP and GenLayer