Scaling Laws

Research and analysis of neural scaling laws — the empirical relationships between model size, dataset size, compute budget, and performance (e.g., Chinchilla scaling, Kaplan laws, compute-optimal training).

Reading List

Products & Announcements

Alibaba Announces Qwen3.8: A 2.4T Parameter Open-Weight Powerhouse

Jul 19, 2026579

Alibaba announces Qwen3.8, a 2.4T parameter open-weight model that rivals top frontier AI.

Open-Weight Models Foundation Models AI Benchmarks Alibaba Scaling Laws

Agentic Systems

Sakana AI Launches RSI Lab to Engineer Autonomous Self-Improving Intelligence

Jun 5, 2026

Sakana AI's new RSI Lab aims to create autonomous, self-improving AI systems that thrive on efficiency rather than massive computational power.

Self-Modifying AI Autonomous Research Agents AI Architecture Scaling Laws AI Safety

Under the Hood

The Bitter Lesson Was About Data, Not Compute

Sep 3, 2025369

In a data-constrained era, the real lever isn’t more GPUs but better data and architectures that maximize each token’s value.

Scaling Laws AI Training Data AI Architecture Synthetic Data & Simulation Corporate AI Strategy