LoreonLabsPlatform

Overview

Intelligence

Markets
Builders
Research
Narratives
Ecosystems
Launchpads

Discover

Search
Sources

Other

tiktoken-rs

Ready-made tokenizer library for working with GPT and tiktoken

OtherEmerging

Stars

—

Forks

—

Contributors

8

Last push

35mo ago

Recent commits

Latest commits.

minor change
bcb3e71kojix235mo ago
chore: Update Dependabot schedule for weekly runs.
9decafbRoger Zurawicki36mo ago
Bump version minor to "0.5.0"
b5cafdeRoger Zurawicki36mo ago
Initialize TikTok token Rust app and add async-openai as default.
42d94e1Davirain36mo ago
Update async-openai to v0.12.0 and refactor ChatCompletionRequestMessage to include an optional function_call field.
53b3554Davirain36mo ago

Bump version patch to "0.4.5"

8c9ba8bRoger Zurawicki36mo ago

test: Add unicode test cases

375de7aRoger Zurawicki36mo ago

chore: Update dependencies in Cargo.toml file.

61ab95cRoger Zurawicki36mo ago

Top contributors

Builders behind this project.

dependabot[bot]