Neural texturing faces a fundamental problem: low per-neuron computation density. Traditional ReLU neurons perform a dot product, one activation, and output a single scalar, making them inefficient for complex functions. Purpose-built kernels can often compute the same structure more efficiently.
Key points
Neuron Computation Density: Traditional ReLU neurons have low per-neuron computation density, making them inefficient for complex functions.
Kernel Efficiency: Purpose-built kernels can often compute the same structure more efficiently than traditional ReLU neurons.
MLP Scaling: MLP solutions don't scale well with the number of channels stored in each latent texture and the number of desired decoded output RGB channels.
Sources
AI/ML - NNTC Weight Scaling
NNTC's total number of weights scales based on the number of channels stored in each of the two latent textures and the number of desired decoded output RGB channels. MLP solutions don't scale well this way, making their decoders "lobotomized".
Key points
Weight Scaling: NNTC's total number of weights scales based on the number of channels stored in each latent texture and the number of desired decoded output RGB channels.
MLP Scaling Limitations: MLP solutions don't scale well with the number of channels and desired decoded output RGB channels.
Decoder Limitations: MLP decoders are "lobotomized" due to poor scaling.
Sources
Music - Chaos EP Idea
The author is struggling to find a decent rapper who loves Tzeentch, a chaos god, to collaborate on their EP. Two potential collaborators dropped out after waiting for six months each, leaving the demo over a year old.
Key points
Collaboration Challenges: The author is struggling to find a decent rapper who loves Tzeentch.
Collaborator Dropouts: Two potential collaborators dropped out after waiting for six months each.
Demo Age: The demo is over a year old.
Sources
AI/ML - Jev and TabFM
If you're blown away by Jev from a philosophical perspective, the author recommends looking into Google's TabFM and its credited lineage, aka intelligence in spreadsheet.
Key points
Jev and TabFM: Jev is related to TabFM, which is a form of intelligence in spreadsheet.
TabFM Lineage: TabFM has a credited lineage in the field of intelligence in spreadsheet.
Philosophical Implications: Jev has philosophical implications that are worth exploring.
Sources
Art - Video Analyzer
The author has released a video-analyzer tool that creates prompts for MiniMax H3 or LTX-2.5. The tool is available for use.
Key points
Video Analyzer: The author has released a video-analyzer tool.
Prompt Generation: The tool generates prompts for MiniMax H3 or LTX-2.5.
Tool Availability: The tool is available for use.
Sources
AI/ML - Clairvoyance Guided Tour
The author has created a guided tour of Clairvoyance, a tool for creators. The tour is available for use.
Key points
Clairvoyance Tour: The author has created a guided tour of Clairvoyance.
Creator Tool: Clairvoyance is a tool for creators.
Tour Availability: The tour is available for use.
Sources
Politics - Bengaluru Taxation
The author is criticizing the Bengaluru government's taxation policies, which they claim are opaque and unfair. The author is advocating for transparency and accountability in taxation.
Key points
Taxation Criticism: The author is criticizing the Bengaluru government's taxation policies.
Transparency and Accountability: The author is advocating for transparency and accountability in taxation.
Taxation Opacity: The author claims that the taxation policies are opaque.
Sources
AI/ML - Cooperative Vectors
Cooperative Vectors is an upcoming extension that exposes neural-inference hardware to shaders. This does not require developers to use MLPs (neural nets with activations).
Key points
Cooperative Vectors: Cooperative Vectors is an upcoming extension.
Neural-Inference Hardware: The extension exposes neural-inference hardware to shaders.
MLP Independence: The extension does not require developers to use MLPs.
Sources
AI/ML - Jev Performance
Jev performs well in some evals, but its local equivalent, Gemma, is worse and bloats the local app. The author is exploring shipping Jev locally.
Key points
Jev Performance: Jev performs well in some evals.
Gemma Comparison: Gemma is worse and bloats the local app.
Local Shipping: The author is exploring shipping Jev locally.
Sources
Art - Moodboard Chat
The author has built a tiny Pinterest for AI, called Moodboard Chat, with @AdamSvystun. The tool allows users to explore moodboards, remix images, and feed their taste to their LLM.
Key points
Moodboard Chat: The author has built a tiny Pinterest for AI.
Collaboration: The tool was built with @AdamSvystun.
Tool Features: The tool allows users to explore moodboards, remix images, and feed their taste to their LLM.