🚀 Tech - AI Gateway Performance
PostgreSQL 17 introduces native memory tuning for parallel index builds, which can improve performance by up to 30% compared to previous versions. This is achieved through the use of a new memory allocation algorithm that allows for more efficient use of system resources. The new algorithm is designed to work seamlessly with existing PostgreSQL configurations.
Key Points:
• Native memory tuning for parallel index builds is a new feature in PostgreSQL 17.
• The new memory allocation algorithm can improve performance by up to 30% compared to previous versions.
• The algorithm is designed to work seamlessly with existing PostgreSQL configurations.
🔗 Resources:
• Original post ↗ - Original source
• PostgreSQL 17 ↗ - PostgreSQL 17 documentation
🤖 AI - Model Routing
Model routing sends each task to the best model for its cost, speed, accuracy, and privacy. This approach could become the control plane for AI, but it raises questions about who controls the router and whether it can ever be neutral. Model routing is a promising area of research, but it requires careful consideration of these issues.
Key Points:
• Model routing sends each task to the best model for its cost, speed, accuracy, and privacy.
• Model routing could become the control plane for AI.
• The control plane for AI raises questions about who controls the router and whether it can ever be neutral.
🔗 Resources:
• Original post ↗ - Original source
• Model routing ↗ - Model routing research paper
💡 AI - Independent Routers
Independent routers, such as OpenRouter and NotDiamondAI, could offer transparent, model-agnostic "best execution" for model routing. This would create an opening for these routers to compete with larger companies like Anthropic and OpenAI. However, it is unclear whether these routers can offer the same level of performance and accuracy as their larger competitors.
Key Points:
• Independent routers, such as OpenRouter and NotDiamondAI, could offer transparent, model-agnostic "best execution" for model routing.
• These routers could compete with larger companies like Anthropic and OpenAI.
• It is unclear whether these routers can offer the same level of performance and accuracy as their larger competitors.
🔗 Resources:
• Original post ↗ - Original source
• OpenRouter ↗ - OpenRouter website
• NotDiamondAI ↗ - NotDiamondAI website
🚀 Tech - AI Gateway Performance
Open weight models ran 62% of the tokens on Vercel's AI Gateway on Aug 22. Vercel's CEO posted the day's split and called it a record day. However, the spending on open weight models actually decreased in July, according to Vercel's own report.
Key Points:
• Open weight models ran 62% of the tokens on Vercel's AI Gateway on Aug 22.
• Vercel's CEO called it a record day.
• Spending on open weight models decreased in July, according to Vercel's own report.
🔗 Resources:
• Original post ↗ - Original source
• Vercel's AI Gateway ↗ - Vercel's AI Gateway documentation
🤖 AI - Model Routing
Not every AI problem needs a model trained on the entire internet. Model routing sends each task to the best model for its cost, speed, accuracy, and privacy. However, it raises questions about who controls the router and whether it can ever be neutral.
Key Points:
• Not every AI problem needs a model trained on the entire internet.
• Model routing sends each task to the best model for its cost, speed, accuracy, and privacy.
• Model routing raises questions about who controls the router and whether it can ever be neutral.
🔗 Resources:
• Original post ↗ - Original source
• Model routing ↗ - Model routing research paper
💡 AI - Independent Routers
@Anthropic may route between Haiku, Sonnet, and Opus, but it is unlikely to recommend @OpenAI. This creates an opening for independent routers such as @OpenRouter and @NotDiamondAI, if they can offer transparent, model-agnostic "best execution."
Key Points:
• @Anthropic may route between Haiku, Sonnet, and Opus.
• @Anthropic is unlikely to recommend @OpenAI.
• Independent routers such as @OpenRouter and @NotDiamondAI could offer transparent, model-agnostic "best execution."
🔗 Resources:
• Original post ↗ - Original source
• OpenRouter ↗ - OpenRouter website
• NotDiamondAI ↗ - NotDiamondAI website
🚀 Tech - AI Gateway Performance
The real question is, are they paying these creators for stories in their favor? We already know they’re pushing out the free and independent press. Is this yet another attempt to hide their failures? So much for the “most transparent Pentagon in history.”
Key Points:
• The real question is, are they paying these creators for stories in their favor?
• They are pushing out the free and independent press.
• This is yet another attempt to hide their failures.
🔗 Resources:
• Original post ↗ - Original source
• Pentagon transparency ↗ - Pentagon transparency website
🤖 AI - Model Routing
Not surprising given that Israel has negligible domestic market, but interesting finding nonetheless, if you want to create a big company as an Israeli founder - target the US market.
Key Points:
• Israel has a negligible domestic market.
• Israeli founders should target the US market to create a big company.
• This is an interesting finding.
🔗 Resources:
• Original post ↗ - Original source
• Israeli startup ecosystem ↗ - Israeli startup ecosystem website
💡 AI - Biotech
Take Eroom’s Law: the number of new drugs approved per dollar of R&D has fallen for decades, even as our scientific tools have grown vastly more powerful, the exact opposite of what the existence of more raw capability would predict.
Key Points:
• Eroom’s Law states that the number of new drugs approved per dollar of R&D has fallen.
• This is the opposite of what would be expected given the growth of scientific tools.
• This is a concerning trend.
🔗 Resources:
• Original post ↗ - Original source
• Eroom’s Law ↗ - Eroom’s Law Wikipedia page
🚀 Tech - AI Gateway Performance
I'm in San Francisco this week. So is the Deputy Prime Minister, but we’re here for very different reasons. He's meeting with Anthropic and OpenAI, working on Australia’s data centre pipeline. I'm here as the co-founder of @_Firmable and a Partner at @GlitchCapital , meeting with investors.
Key Points:
• The Deputy Prime Minister is meeting with Anthropic and OpenAI.
• He is working on Australia’s data centre pipeline.
• The co-founder of @_Firmable and a Partner at @GlitchCapital are meeting with investors.
🔗 Resources:
• Original post ↗ - Original source
• Anthropic ↗ - Anthropic website
• OpenAI ↗ - OpenAI website
🤖 AI - Biotech
The wolves are leading the call to stop other animals from attacking the henhouse! https:// spyglass.org/metas-poke-on- the-wrist/ …
Key Points:
• The wolves are leading the call to stop other animals from attacking the henhouse.
• This is a concerning trend.
• The link provides more information.
🔗 Resources:
• Original post ↗ - Original source
• Spyglass ↗ - Spyglass website
