Skip to content
Drix10 Blog

Tech - AI Gateway Performance

, 11 items in Investors and Venture Capital, 7 min read

In this digest (11 items)

PostgreSQL 17 introduces native memory tuning for parallel index builds, which can improve performance by up to 30% compared to previous versions. This is achieved through the use of a new memory allocation algorithm that allows for more efficient use of system resources. The new algorithm is designed to work seamlessly with existing PostgreSQL configurations.

Key points

• Native memory tuning for parallel index builds is a new feature in PostgreSQL 17. • The new memory allocation algorithm can improve performance by up to 30% compared to previous versions. • The algorithm is designed to work seamlessly with existing PostgreSQL configurations.

Sources

AI - Model Routing

Model routing sends each task to the best model for its cost, speed, accuracy, and privacy. This approach could become the control plane for AI, but it raises questions about who controls the router and whether it can ever be neutral. Model routing is a promising area of research, but it requires careful consideration of these issues.

Key points

• Model routing sends each task to the best model for its cost, speed, accuracy, and privacy. • Model routing could become the control plane for AI. • The control plane for AI raises questions about who controls the router and whether it can ever be neutral.

Sources

AI - Independent Routers

Independent routers, such as OpenRouter and NotDiamondAI, could offer transparent, model-agnostic "best execution" for model routing. This would create an opening for these routers to compete with larger companies like Anthropic and OpenAI. However, it is unclear whether these routers can offer the same level of performance and accuracy as their larger competitors.

Key points

• Independent routers, such as OpenRouter and NotDiamondAI, could offer transparent, model-agnostic "best execution" for model routing. • These routers could compete with larger companies like Anthropic and OpenAI. • It is unclear whether these routers can offer the same level of performance and accuracy as their larger competitors.

Sources

Tech - AI Gateway Performance

Open weight models ran 62% of the tokens on Vercel's AI Gateway on Aug 22. Vercel's CEO posted the day's split and called it a record day. However, the spending on open weight models actually decreased in July, according to Vercel's own report.

Key points

• Open weight models ran 62% of the tokens on Vercel's AI Gateway on Aug 22. • Vercel's CEO called it a record day. • Spending on open weight models decreased in July, according to Vercel's own report.

Sources

AI - Model Routing

Not every AI problem needs a model trained on the entire internet. Model routing sends each task to the best model for its cost, speed, accuracy, and privacy. However, it raises questions about who controls the router and whether it can ever be neutral.

Key points

• Not every AI problem needs a model trained on the entire internet. • Model routing sends each task to the best model for its cost, speed, accuracy, and privacy. • Model routing raises questions about who controls the router and whether it can ever be neutral.

Sources

AI - Independent Routers

@Anthropic may route between Haiku, Sonnet, and Opus, but it is unlikely to recommend @OpenAI. This creates an opening for independent routers such as @OpenRouter and @NotDiamondAI, if they can offer transparent, model-agnostic "best execution."

Key points

• @Anthropic may route between Haiku, Sonnet, and Opus. • @Anthropic is unlikely to recommend @OpenAI. • Independent routers such as @OpenRouter and @NotDiamondAI could offer transparent, model-agnostic "best execution."

Sources

Tech - AI Gateway Performance

The real question is, are they paying these creators for stories in their favor? We already know they’re pushing out the free and independent press. Is this yet another attempt to hide their failures? So much for the “most transparent Pentagon in history.”

Key points

• The real question is, are they paying these creators for stories in their favor? • They are pushing out the free and independent press. • This is yet another attempt to hide their failures.

Sources

AI - Model Routing

Not surprising given that Israel has negligible domestic market, but interesting finding nonetheless, if you want to create a big company as an Israeli founder - target the US market.

Key points

• Israel has a negligible domestic market. • Israeli founders should target the US market to create a big company. • This is an interesting finding.

Sources

AI - Biotech

Take Eroom’s Law: the number of new drugs approved per dollar of R&D has fallen for decades, even as our scientific tools have grown vastly more powerful, the exact opposite of what the existence of more raw capability would predict.

Key points

• Eroom’s Law states that the number of new drugs approved per dollar of R&D has fallen. • This is the opposite of what would be expected given the growth of scientific tools. • This is a concerning trend.

Sources

Tech - AI Gateway Performance

I'm in San Francisco this week. So is the Deputy Prime Minister, but we’re here for very different reasons. He's meeting with Anthropic and OpenAI, working on Australia’s data centre pipeline. I'm here as the co-founder of @_Firmable and a Partner at @GlitchCapital , meeting with investors.

Key points

• The Deputy Prime Minister is meeting with Anthropic and OpenAI. • He is working on Australia’s data centre pipeline. • The co-founder of @_Firmable and a Partner at @GlitchCapital are meeting with investors.

Sources

AI - Biotech

The wolves are leading the call to stop other animals from attacking the henhouse! https:// spyglass.org/metas-poke-on- the-wrist/ …

Key points

• The wolves are leading the call to stop other animals from attacking the henhouse. • This is a concerning trend. • The link provides more information.

Sources