Similar repositories to mingruimingrui/FastTokenizer:

• mingruimingrui/FastTokenizer github similar
• mingruimingrui/fast-mosestokenizer github similar
• naver-ai/MetricMT github similar
• prajdabre/yanmtt github similar
• bitextor/bicleaner github similar
• dalab/hyperbolic_nn github similar
• yuantiku/fairseq-gec github similar
• fastnlp/CPT github similar
• google-research/bleurt github similar
• chrisjbryant/errant github similar
• google-research/deduplicate-text-datasets github similar
• alvations/sacremoses github similar
• clab/fast_align github similar
• mjpost/sacrebleu github similar
• mhagiwara/github-typo-corpus github similar
• nipunsadvilkar/pySBD github similar
• neuspell/neuspell github similar
• facebookresearch/flores github similar
• google/cld3 github similar
• nlp-uoregon/trankit github similar
• cresset-template/cresset github similar
• ZhuiyiTechnology/simbert github similar
• grammarly/gector github similar
• pytorch/functorch github similar
• guillaume-be/rust-bert github similar
• microsoft/MASS github similar
• awslabs/sockeye github similar
• PrithivirajDamodaran/Gramformer github similar
• NVIDIA/FasterTransformer github similar
• Mimino666/langdetect github similar
• tomgoldstein/loss-landscape github similar
• bytedance/lightseq github similar
• marcotcr/checklist github similar
• facebookresearch/fairscale github similar
• tomohideshibata/BERT-related-papers github similar
• kpu/kenlm github similar
• facebookresearch/MUSE github similar
• facebookresearch/LASER github similar
• dmlc/gluon-nlp github similar
• LiyuanLucasLiu/RAdam github similar