Turning BERT’s MLM Into a Text Diffusion Generator
455
BERT-style MLM is a single-step text diffusion process, and extending it to multiple masking steps turns RoBERTa into a workable text generator.
Why Embeddings Got Bigger—and Where Efficiency Pulls Them Next
113
Embeddings got bigger with Transformers and APIs, but new efficiency techniques and infrastructure mean the future is about smarter—not just larger—dimensions.
CauseNet: An Open 11M-Relation Causality Graph from the Web
231
An open, large-scale graph of web-extracted causal claims—complete with provenance—released to power causal QA and reasoning.