LoreonLabsPlatform
DocsHome
  • Overview

Intelligence

  • Markets
  • Builders
  • Research
  • Ecosystems
  • Launchpads
  • Search
Ecosystems

Python

Megatron-LM

Ongoing research training transformer models at scale

PythonEmerging
GitHubWebsite
Stars
—
Forks
—
Contributors
8
Last push
1mo ago

Recent commits

Latest commits.

  • remove legacy GPT code (#4322)
    39ec5ebDmytro Pykhtar1mo ago
  • chore: rotate oncall schedule
    fd443f2github-actions[bot]1mo ago
  • test: mark TestFusedApplyMLARope::test_forward_backward_for_q flaky_in_dev (#4639)
    c325855oliver könig1mo ago
  • Fix gradient corruption with layerwise param all-gather overlap (#4609)
    b25a76eDeepak Narayanan1mo ago
  • mmiranda working on another set of broken links (#4534)
    6e5fb47megnvidia1mo ago
Siddharth/fix ep sync (#4607)
190c833wdykas1mo ago
  • convert tokenizer args to config (#4406)
    40d024bDmytro Pykhtar1mo ago
  • Single commit for main2dev nightly (#4614)
    b819ac7Philip Petrakian1mo ago

    • Top contributors

    Builders behind this project.

    ko3n1g
    1.8K commits
    jaredcasper
    1K commits
    lmcafee-nvidia
    407 commits
    shanmugamr1992
    392 commits
    shoeybi
    339 commits
    deepakn94
    324 commits
    ericharper
    282 commits
    mikolajblaz
    242 commits