LoreonLabsPlatform

Overview

Intelligence

Markets
Builders
Research
Narratives
Ecosystems
Launchpads

Discover

Search
Sources

Other

LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

OtherEmerging

Stars

—

Forks

—

Contributors

8

Last push

23d ago

Recent commits

Latest commits.

Add Deepseek Sparse Attention (DSA) implementation (ch04/09_dsa) (#1014)
768fc57Tarun kumar26d ago
Muon optimizer (#1029)
0ab8b81Sebastian Raschka1mo ago
Fix TensorFlow dependency marker for Linux ARM (#1028)
df7968fSebastian Raschka1mo ago
Tips on forking and updating this repo locally (#1027)
f1b4d0dSebastian Raschka1mo ago
Unique names to improve automerge if all tests pass (#1026)
71dd614Sebastian Raschka1mo ago

Add cross-layer KV sharing (#1025)

d9693f0Sebastian Raschka1mo ago

Add troubleshooting guide for common questions (#1024)

afec22fSebastian Raschka1mo ago

Fix typo in README for KV-cache totals (#1023)

d12a5daAnthony Chan1mo ago

Top contributors

Builders behind this project.

Intelligence-Manifesto