David Schnurr

Unified framework for comparing model architectures in in-context learning on the tabular domains. Includes modular pretraining pipelines, shared priors, and evaluations of Transformers, Linear Attention variants, and Mamba.

No description.

Understand and test language model architectures on synthetic tasks.

No description.