🤖 Bitcoin 2025 - Conference Highlights
This article summarizes observations from the build-up to Bitcoin 2025 in Las Vegas, highlighting the positive reception of The Smarter Web Company.
Key Points:
• Significant attention garnered from global attendees.
• Opportunity to speak alongside leading industry companies.
🔗 Resources:
• Titor_Tt0 ↗ - Twitter account
• asjwebley ↗ - Twitter account
Image
Image
💡 Life Lessons - The Burden of Foresight
This article uses the metaphor of Noah's Ark to illustrate the challenges of being right too early.
Key Points:
• The difficulties of being ahead of one's time.
• The lack of recognition and validation for early adopters.
🤖 Scaling Laws - Architectural Optimizations
This article discusses the limited impact of architectural and optimization changes on the scaling exponent (b) in scaling laws, referencing findings from Streaming DiLoCo.
Key Points:
• Architectural changes have minimal effect on scaling exponent (b).
• Data-parallel, DiLoCo, and Streaming DiLoCo show similar results for b.
🔗 Resources:
• Arxiv preprint ↗ - Streaming DiLoCo results
✨ Quantum Computing - Societal Impact
This article highlights IonQ's belief in the transformative potential of quantum computing, similar to the internet and smartphones.
Key Points:
• Quantum computing's potential to revolutionize problem-solving.
• The technology's capacity to drive societal change.
🔗 Resources:
Image
🤖 Machine Learning - Layerwise Learning Rate Scaling
This article discusses a paper explaining multiplicative update rules (MUP) as a layerwise learning rate scaling method (m^c), where MUP predicts c or scales the initialization. The mathematical complexities are noted.
Key Points:
• MUP explained as layerwise learning rate scaling.
• Mathematical complexity is highlighted, but an intuitive understanding is also possible.
🔗 Resources:
• Slides ↗ - Explanation of MUP
• alex_damian_ ↗ - Twitter Account
• hayou_soufiane ↗ - Twitter Account
🤖 Retrocomputing - GPT2 on 486 Hardware
This article discusses a project that rewrites computing using transformer models (GPT2) on 486 hardware, presenting a hypothetical scenario where the AI revolution happened much earlier.
Key Points:
• GPT2 implementation on 486 hardware.
• Exploration of an alternate timeline in computing.
🔗 Resources:
• GitHub repository ↗ - GPT2-BASIC project
Image
🤖 Quantum Cryptography - Shor's Algorithm Experiment
This article describes an experiment that successfully breaks a 3-bit elliptic curve cryptographic key using Shor's algorithm on a 133-qubit quantum computer.
Key Points:
• Successful execution of Shor's algorithm on a 133-qubit quantum computer.
• Breaking a 3-bit elliptic curve key using a 9-qubit quantum circuit.
🔗 Resources:
• IBM ↗ - Quantum computing provider
• Qiskit ↗ - Quantum computing software
Image
Image
Image
Image
💡 Biology - Auxin and Serotonin as Biological Helpers
This article draws a parallel between auxin in plants and serotonin in humans, highlighting their roles in helping organisms find essential resources.
Key Points:
• Auxin's role in plant growth and resource acquisition.
• Serotonin's function in human well-being.
🔗 Resources:
Image
🚀 Video Processing - QuickVideo for VideoLLM Inference
This article introduces QuickVideo, a tool designed to accelerate end-to-end video processing for VideoLLM inference.
Key Points:
• Significantly reduces processing time for hour-long videos.
• Optimized for single 40GB GPU.
🔗 Resources:
Image
🤖 Probability - Sub-Gaussian Norm Concentration Inequality
This article discusses a new proof of a classical sub-Gaussian norm concentration inequality, highlighting the use of an average moment generating function.
Key Points:
• New proof of a classical sub-Gaussian norm concentration inequality.
• Utilizes a generalization of the moment generating function (MGF).
🔗 Resources:
• Arxiv preprint ↗ - New proof
⭐️ Support
If you liked reading this report, please star ⭐️ this repository and follow me on Github ↗, 𝕏 (previously known as Twitter) ↗ to help others discover these resources and regular updates.