marcelroed/gigatoken

Language model tokenization at GB/s

4.1k stars · 221 forks · Rust

Caution

Caution: one person wrote most of the recent commits.

Why

What would change this

Maintenance

Complete

Steady

Human commits, 30 days
0
Human commits, 90 days
68
Human commits, 365 days
318
Bot share of commits, 365 days
0%
Last commit
Aug 6, 2026 (2 months ago)
Last human commit
Aug 6, 2026 (2 months ago)
Authors, 90 days
1
Last release
none found
Median PR merge time
under an hour

Responsiveness: of 24 recent issues, 58% got a maintainer reply. Median first response: 5 hours.

Sources: Commits, Releases, Merged pull requests, Issues

People

Complete
Owner
Personal account
Commits sampled
318 since Oct 15, 2025
Authors for half of commits
1
Authors for 80% of commits
1
Contributors
1

Top committers

Sources: Commits, Contributors

Stars

Complete

Not enough data, confidence medium

Stars per week, 2025-11-09 to 2026-10-11. 0 weeks overlap a burst.Peak 3.3k a week2025-11-092026-10-11
Bars show stars gained each week. Orange bars overlap a burst.

Anyone can buy stars for any repo; bursts alone don't prove the owner did.

Sources: How star history is analyzed

Risk

Complete

Flags

No risk flags.

License

Now
MIT (OSI-approved)
A year ago
Not known

Packages

Package and advisory data: deps.dev and OSV.

Sources: GitHub: marcelroed/gigatoken, deps.dev: PyPI gigatoken

Badge

Add this to a README to show the current verdict:

[![RepoRadar](https://reporadar.ai/marcelroed/gigatoken/badge.svg)](https://reporadar.ai/marcelroed/gigatoken)

Earlier verdicts

Computed 3 hours ago · method 2026.10.2