🤖 Sparse Attention - Reverse Engineering
This article discusses the findings of reverse-engineering sparse attention mechanisms in machine learning, focusing on their performance and novel attention patterns.
Key Points:
• Sparse attention models train faster than full attention models.
• Sparse attention reveals novel attention patterns previously unknown.
• Sparse attention exhibits hidden "attention sinks" impacting performance.
• Reverse-engineering provides a better understanding of sparse attention's operation.
🔗 Resources:
• Gu Xiangming ↗ - Researcher in Sparse Attention
• Tilde Research ↗ - Research Organization
Image
✨ Film - Dream of Walnut Palaces
This article announces the Grand Prix win of the CGI film "Dream of Walnut Palaces" at Hyundai's 6th VH Award. The film reimagines the historical exchange of knowledge between China and Europe.
Key Points:
• Won Grand Prix at Hyundai's 6th VH Award.
• 10-minute CGI film.
• Reimagines 18th-century knowledge exchange between China and Europe.
🔗 Resources:
• Joanne Z Peng ↗ - Filmmaker
• Wendi Yan ↗ - Related to the film
Image
Image
Image
Image
💡 Public Lands - US National Parks
This article discusses the importance of US public lands and national parks, highlighting their value and the tiered management system used to balance protection and diverse use.
Key Points:
• US public lands, including national parks, are a vital resource.
• Tiered management system allows for diverse use and adaptation to changing needs.
🔗 Resources:
• C4 Computation ↗ - Source of the Tweet
Image
💡 Academic Conferences - AAIM 2025 Concerns
This article raises concerns about the timing of the AAIM 2025 conference in relation to the submission deadline, questioning potential underlying power structures.
Key Points:
• AAIM 2025 conference held before full submissions are due.
• Concerns raised about potential power structures and their influence.
🔗 Resources:
• Rupei Xu ↗ - Source of the Tweet
• UTD CompSci ↗ - Mentioned organization
• UTD Jonsson ↗ - Mentioned organization
Image
Image
Image
Image
💡 Academic Community - COCOON and Professor Ming Li
This article discusses the departure of Professor Ming Li from the COCOON PC Chairs mailing list, noting the context of a potentially challenging academic environment.
Key Points:
• Professor Ming Li's departure from COCOON PC Chairs mailing list.
• Departure possibly related to the current academic climate.
🔗 Resources:
• Rupei Xu ↗ - Source of the Tweet
• UTD CompSci ↗ - Mentioned organization
• UTD Jonsson ↗ - Mentioned organization
• UT Dallas ↗ - Mentioned organization
• UM News ↗ - Mentioned organization
🤖 Neural Network Scaling - LMO Approach
This article highlights Tony's LMO approach for neural network scaling, emphasizing the significance of hyperparameter transferability.
Key Points:
• Tony's LMO approach is praised for its brilliance.
• Hyperparameter transferability is a key feature.
🔗 Resources:
• Aniervs ↗ - Source of the Tweet
• Oliver AI Music ↗ - Source of the Tweet
• Cohere Labs ↗ - Mentioned organization
• Tony Silveti ↗ - Mentioned individual
💡 Institute Remediation - Offer Withdrawn
This article explains the withdrawal of an offer to help reset an institute due to the board's inaction regarding corruption.
Key Points:
• Offer to help reset the institute is withdrawn.
• Board's failure to address known corruption is cited as the reason.
🔗 Resources:
• C4 Computation ↗ - Source of the Tweet
💡 Team Management - Elon Musk's Approach
This article summarizes Elon Musk's approach to team meetings, focusing on weekly progress reports and future planning.
Key Points:
• Weekly meetings to discuss completed tasks and future plans.
• Circular discussion format around the table.
🔗 Resources:
• Joaquim Kelo ↗ - Source of the Tweet
• Elon Clips X ↗ - Source of the Tweet
Image
🚀 Community-Backed Research - Midjourney
This article highlights Midjourney's unique funding model, emphasizing its reliance on a large community of supporters rather than investors.
Key Points:
• Entirely supported by a community of everyday people.
• Represents a novel community-backed research lab model.
🔗 Resources:
• Joaquim Kelo ↗ - Source of the Tweet
• Midjourney ↗ - Source of the Tweet
💡 Political Campaign - Eric Adams and Christopher J. "Chris" Mamdani
This article observes the rapid rise of Chris Mamdani in the New York City mayoral race.
Key Points:
• Chris Mamdani's unexpected rise in the NYC mayoral race.
• Significant increase in support and momentum within a short timeframe.
🔗 Resources:
• Dr. Eric Ding ↗ - Source of the tweet
Image
⭐️ Support
If you liked reading this report, please star ⭐️ this repository and follow me on Github ↗, 𝕏 (previously known as Twitter) ↗ to help others discover these resources and regular updates.
