Yuanpu

Robust recipes to align language models with human and AI preferences

Code of NAACL 2024 paper "Stealthy and Persistent Unalignment on Large Language Models via Backdoor Injections".

Personalized Steering of Large Language Models: Versatile Steering Vectors Through Bi-directional Preference Optimization

Inference code for LLaMA models