marcelroed/gigatoken
Language model tokenization at GB/s
4.1k stars · 221 forks · Rust
Caution
Caution: one person wrote most of the recent commits.
Why
- One person wrote 100% of human commits in the last year, so the project depends on them continuing. (source 1, source 2)
What would change this
- A second person takes a substantial share of commits.
Maintenance
CompleteSteady
- Human commits, 30 days
- 0
- Human commits, 90 days
- 68
- Human commits, 365 days
- 318
- Bot share of commits, 365 days
- 0%
- Last commit
- Aug 6, 2026 (2 months ago)
- Last human commit
- Aug 6, 2026 (2 months ago)
- Authors, 90 days
- 1
- Last release
- none found
- Median PR merge time
- under an hour
Responsiveness: of 24 recent issues, 58% got a maintainer reply. Median first response: 5 hours.
Sources: Commits, Releases, Merged pull requests, Issues
People
Complete- Owner
- Personal account
- Commits sampled
- 318 since Oct 15, 2025
- Authors for half of commits
- 1
- Authors for 80% of commits
- 1
- Contributors
- 1
Top committers
- marcelroed: 100% of commits
Sources: Commits, Contributors
Stars
CompleteNot enough data, confidence medium
- The star history was reset at some point, so earlier stars aren't counted.
- Engagement is low for a repo this size (forks, watchers, issues, contributors).
Anyone can buy stars for any repo; bursts alone don't prove the owner did.
- Not enough star history yet to judge the star count.
- The star history has a zero run of 26 weeks or more, so the analysis starts after it.
Sources: How star history is analyzed
Risk
CompleteFlags
No risk flags.
License
- Now
- MIT (OSI-approved)
- A year ago
- Not known
Packages
- gigatoken (PYPI): latest 0.10.0, published Jul 25, 2026
Advisories for the latest version: none listed
Package and advisory data: deps.dev and OSV.
Sources: GitHub: marcelroed/gigatoken, deps.dev: PyPI gigatoken
Badge
Add this to a README to show the current verdict:
[](https://reporadar.ai/marcelroed/gigatoken)Earlier verdicts
- Oct 15, 2026: Caution
- Oct 14, 2026: Caution
Computed 3 hours ago · method 2026.10.2