LoreonLabsPlatform
DocsHome
  • Overview

Intelligence

  • Markets
  • Builders
  • Research
  • Ecosystems
  • Launchpads
  • Search
Ecosystems

Other

tiny-llm

(🚧 WIP) a course of LLM inference serving on Apple Silicon for systems engineers.

OtherEmerging
GitHubWebsite
Stars
—
Forks
—
Contributors
2
Last push
7d ago

Recent commits

Latest commits.

  • fixing the pdm test command wk1 (#2)
    67c38dbShivang Sharma14mo ago
  • add def of flash_attention
    b39ebc9Alex Chi Z14mo ago
  • Update README.md
    a20bb45Alex Chi Z.14mo ago
  • fix detokenizer extra tokens
    c64e9efAlex Chi Z14mo ago
  • update roadmap
    7a05e22Alex Chi14mo ago
implement matrix kernel; wait for mlx bug fix
a8eaa52Alex Chi14mo ago
  • integrate quantized linear with the model
    b416219Alex Chi Z14mo ago
  • update roadmap
    2f2196dAlex Chi Z14mo ago

    • Top contributors

    Builders behind this project.

    skyzh
    52 commits
    shivangsharma1
    1 commits