DL-08

Tokenizer Engineering Suite

Implement BPE, train on domain corpora, inspect fertility and edge cases, and compare vocabulary, speed, and compression.

• Status: planned
• Proof: code
• Tier: focused-exhibit
• Roles: ai-engineer

← All projects