Distilling Wisdom: A Review on Optimizing Learning From Massive Language Models
<p dir="ltr">In the era of Large Language Models (LLMs), Knowledge Distillation (KD) enables the transfer of capabilities from proprietary LLMs to open-source models. This survey provides a detailed discussion of the basic principles, algorithms, and implementation methods of knowled...
Saved in:
| Main Author: | Dingzong Zhang (23275066) (author) |
|---|---|
| Other Authors: | Devi Listiyani (23275069) (author), Priyanka Singh (256412) (author), Manoranjan Mohanty (23275072) (author) |
| Published: |
2025
|
| Subjects: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
-
Self-Distillation for Randomized Neural Networks
by: Minghui Hu (2457952)
Published: (2023) -
When geoscience meets generative AI and large language models: Foundations, trends, and future challenges
by: Hadid, Abdenour
Published: (2024) -
Large Language Model Enhanced Particle Swarm Optimization for Hyperparameter Tuning for Deep Learning Models
by: Saad Hameed (6488738)
Published: (2025) -
Large Language Models in Medical Education: Opportunities, Challenges, and Future Directions
by: Alaa Abd-alrazaq (17058018)
Published: (2023) -
The use of large language models for program repair
by: Fida Zubair (20482610)
Published: (2024)