Distillation Experiments
· 2 min read
Weaviate Paper Reviews
Language Model Distillation
· 3 min read
LoRA: Low-Rank Adaptation of Large Language Models
· 3 min read
LoRA: Low-Rank Adaptation of Large Language Models
Tuning LLMs by only learning a fraction of weight updates!
· 3 min read
Prover-verifier Games Improve Legibility of LLM Outputs
· 3 min read
Prover-verifier Games Improve Legibility of LLM Outputs
Optimizing to improve legibility of an LLMs output!
· 2 min read
RouteLLM: Learning to Route LLMs with Preference Data
· 3 min read
RouteLLM: Learning to Route LLMs with Preference Data
Route between LLMs to optimize cost and quality!
· 2 min read
Adaptive Retrieval and Scalable Indexing for k-NN Search with Cross-Encoders
· 2 min read
Adaptive Retrieval and Scalable Indexing for k-NN Search with Cross-Encoders
The quality of a reranked retreiver and the speed of a bi-encoder retreiver!
· 2 min read