LoreonLabsPlatform

Overview

Intelligence

Markets
Builders
Research
Narratives
Ecosystems
Launchpads

Discover

Search
Sources

Python

FuseLink-Megatron

renzh1998/FuseLink-Megatron

PythonEmerging

Stars

—

Forks

—

Contributors

8

Last push

26mo ago

Recent commits

Latest commits.

Merge branch 'main' of https://github.com/renzh1998/FuseLink-Megatron
195bb67Ren Zhenghang26mo ago
fix megatron error
d4e6134Ren Zhenghang26mo ago
update megatron for superpod
108da75Ubuntu26mo ago
Supervised Fine-tuning for HugginFace pretrained weight. (#318)
11f2d93inkcherry29mo ago
fix rms norm import on non cuda device (#341)
f9323e3NR Wu29mo ago

use fused_adam in deepspeed (#335)

b09c6a6YiSheng529mo ago

Align variable before all_reduce with other files (#340)

141bfbeKamil Kaczor29mo ago

Add worker option for preprocess_data.py (#339)

a3635adXu Song29mo ago

Top contributors

Builders behind this project.