Search Tech Bulletin

Explore the library

Research paper

Prompt-Level Distillation: A Non-Parametric Alternative to Model Fine-Tuning for Efficient Reasoning

Research from GooglePublished by Association for Computational LinguisticsPDF

Study whether distilling useful reasoning instructions into a prompt can reduce the need for fine-tuning.

Prompt-Level Distillation: A Non-Parametric Alternative to Model Fine-Tuning for Efficient Reasoning cover