Aravinda Kumar

Training library for Megatron-based models with bi-directional Hugging Face conversion capability

The official code of LM-Debugger, an interactive tool for inspection and intervention in transformer-based language models.

Scalable toolkit for efficient model reinforcement

This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?