MIT introduces Self-Distillation Fine-Tuning to reduce catastrophic forgetting; it uses student-teacher demonstrations and needs 2.5x compute.
Roland Polzin is a former Army officer and the cofounder and CMO at Wing Assistant, a tech-powered outsourcing company for SMBs. As an Army officer, providing training was one of my main ...