LoreonLabsPlatform

Overview

Intelligence

Markets
Builders
Research
Narratives
Ecosystems
Launchpads

Discover

Search
Sources

Python

nanoGPT-MHLA

Implementation of Multi Head Latent Attention in nanoGPT

PythonEmerging

Stars

—

Forks

—

Contributors

8

Last push

13mo ago

Recent commits

Latest commits.

add kvcache
e0ac616MalumaDev13mo ago
add mhla
404e954MalumaDev13mo ago
Merge pull request #578 from devin-open-source/devin/1733728337-fix-warmup-lr
93a43d9Andrej19mo ago
fix: ensure non-zero learning rate during warmup at iteration 0
dc81cb3Devin AI19mo ago
Merge pull request #463 from goswamig/test1
9755682Andrej25mo ago

Merge branch 'master' into test1

3ab86ceAndrej25mo ago

Merge pull request #487 from jellehak/patch-1

7c7e627Andrej25mo ago

Update README.md

5cb16feJelle Hak25mo ago

Top contributors

Builders behind this project.