Topic
A machine-learning technique that trains smaller "student" models to mimic larger "teacher" models' outputs, transferring capability cheaply.
Distilling AuditBench's secret-keeping Llama fine-tunes into their instruct base yields students that admit hidden quirks far more often than the originals. The paper finds the method works poorly when the student comes from a different pretrained base.
Reality
PewDiePie says OpenAI banned him twice while he used GPT-5.6 Sol outputs to train Ajax, a 9-billion-parameter model for home PCs. OpenAI has not commented publicly, but his account shows that a team training its own model on a frontier lab's answers can lose API access partway through the build.
Perspective Coverage
4 publishersReality
Researchers from five institutions lifted a student model 5.34 points over a control on HumanEval+ using 5,664 one-word answers from a code-tuned teacher. None of those answers contained code, so a filter that screens outputs for task content would have passed every one.
Reality
The conduct described is authorised API traffic at scale rather than an intrusion, the detection asked for is billing telemetry providers already hold, and on Beijing's role the advisory goes no further than likely government awareness.
Perspective Coverage
8 publishersReality
Sony and UMG argue that a licensed retrain does not clear what Suno's older models left behind in user preference data and distilled behavior. A Massachusetts federal court now has to rule on that.
Reality
An arXiv defense adds Gaussian noise to a served model's logits and solves for the scale that hits a chosen accuracy target, and it bounds how many repeated queries an attacker needs to average that noise away.
Reality
iOS 27 shipped Monday with a Siri built by distilling Gemini's answers into Apple's own on-device models, gated behind an English-only waitlist and unavailable in the EU and China. Paid cloud limits come later.
Perspective Coverage
3 publishersReality
A proposed scaling law for distillation says the winner flips on two things: whether you already own a teacher, and how many students you intend to serve.
Reality
A custom SGLang framework feeds teacher outputs into the loss while training runs. The reported eightfold speedup comes from a stack of separate optimizations, and the named multipliers reach about 5.5x on their own.
Reality
CISA, the NSA and the FBI want US model providers to catch industrial-scale distillation hiding inside traffic that looks like a busy enterprise customer, then quietly degrade the answers, which makes false positives a product decision.
Reality
The joint NSA, CISA and FBI advisory names six China-based companies and describes billions of tokens taken through paid APIs, cloud resellers and proxy transfer stations, which turns billing telemetry into a detection surface.
Reality
Latent Space dates five flips from human-made to model-made since 2022. The order they happened in predicts more than the annual cadence the essay claims for it.
Reality