S3 Vectors Won’t Kill Vector Databases—They Enable a Tiered Future
280
S3 Vectors is a low-cost cold/warm tier that complements—rather than replaces—specialized vector databases in a tiered vector storage future.
Reading List
A Skeptic’s Guide to Running Local LLMs on macOS
388
A pragmatic, privacy-first guide to running and choosing small local LLMs on macOS—what to use, how to pick, and how to stay safe and sane.
Analog 3D-Optical Fixed-Point Computing for AI and Optimization
101
An analog, 3D-optical fixed-point computer co-designed with iterative models accelerates both AI inference and real-world optimization with high robustness and projected 100× energy-efficiency gains over GPUs.
Why Embeddings Got Bigger—and Where Efficiency Pulls Them Next
113
Embeddings got bigger with Transformers and APIs, but new efficiency techniques and infrastructure mean the future is about smarter—not just larger—dimensions.
Inside a Tiny GPT: A Visual Walkthrough of Autoregressive Prediction
640
A visual, end-to-end demo of a tiny GPT that turns tokens into embeddings, runs them through transformers, and autoregressively predicts the next token to solve a simple sorting task.
CauseNet: An Open 11M-Relation Causality Graph from the Web
231
An open, large-scale graph of web-extracted causal claims—complete with provenance—released to power causal QA and reasoning.
The Bitter Lesson Was About Data, Not Compute
369
In a data-constrained era, the real lever isn’t more GPUs but better data and architectures that maximize each token’s value.
HunyuanWorld-Voyager: World-Consistent RGB-D Video and 3D from a Single Image
322
An open-source, world-consistent RGB-D video generator that turns a single image into controllable, long-range 3D scene explorations with state-of-the-art performance.
Sharing Early Diffusion Steps Across Similar Prompts for Efficient Text-to-Image Generation
Share early diffusion steps across similar prompts to generate image sets faster and better, without retraining.
Why AI Is Chasing World Models Again
211
AI is chasing coherent internal world models to move beyond brittle heuristics and achieve robust, reliable reasoning.
LLMs Are Lossy Encyclopedias: Give Them Facts to Work With
512
Use LLMs to act on provided facts, not as lossless sources of exact details.
Bandit-Based, Budget-Aware LLM Routing with Preference-Informed LinUCB (PILOT)
206
Treat LLM routing as a contextual bandit and use a preference-informed LinUCB plus a knapsack budget policy to adaptively, cost-effectively pick the right model per query.
The Dimensional Ceiling of Single-Vector Embedding Retrieval
151
Embedding-based retrieval hits a hard top-k capacity ceiling set by embedding dimension, and real systems already run into it.