GitHub Trending repo Repositories Jul 8

Kshao09/Pruned-BPE-Tokenizer: A Python/Cython implementation of Pruned BPE, a Byte Pair Encoding tokenizer that improves visible vocabulary efficiency by pruning low-exposure tokens while preserving internal merge structure.

by Kshao09

A Python/Cython implementation of Pruned BPE, a Byte Pair Encoding tokenizer that improves visible vocabulary efficiency by pruning low-exposure tokens while preserving internal merge structure.

Read Original

Metadata

Stars
16
Language
Python
Watchers
16
Open Issues
1
License
Apache-2.0

Related

GitHub Trending repo 4h ago

ramyadharshinimurugaprakash-commits/Titanic-Survival-Prediction-Random-Forest: A machine learning project that predicts passenger survival on the Titanic using the Random Forest Classifier. The project includes data preprocessing, label encoding, feature scaling, model training, prediction, and performance evaluation using Python and Scikit-learn.

A machine learning project that predicts passenger survival on the Titanic using the Random Forest Classifier. The project includes data preprocessing, label encoding, feature scal...

39