Sidhant Sundrani

[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support Llama-3/3.1, Llama-2, LLaMA, BLOOM, Vicuna, Baichuan, TinyLlama, etc.

Activation-aware Singular Value Decomposition for Compressing Large Language Models

A framework for few-shot evaluation of language models.

Build a Jekyll blog in minutes, without touching the command line.