MIT introduces Self-Distillation Fine-Tuning to reduce catastrophic forgetting; it uses student-teacher demonstrations and needs 2.5x compute.

Microsoft researchers have developed On-Policy Context Distillation (OPCD), a training method that permanently embeds enterprise system prompt instructions into model weights, reducing inference ...

Researchers have developed a new explainable artificial intelligence (AI) model to reduce bias and enhance trust and accuracy in machine learning-generated decision-making and knowledge organization.

In recent years, knowledge graphs have become an important tool for organizing and accessing large volumes of enterprise data in diverse industries — from healthcare to industrial, to banking and ...

Researchers warn model collapse when AI trains on AI text; “photocopying a photocopy” leads to less varied outputs.