Text Generation
fastText
Toki Pona
wikilangs
nlp
tokenizer
embeddings
n-gram
markov
wikipedia
feature-extraction
sentence-similarity
tokenization
n-grams
markov-chain
text-mining
babelvec
vocabulous
vocabulary
monolingual
family-constructed_auxlang
Instructions to use wikilangs/tok with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- fastText
How to use wikilangs/tok with fastText:
from huggingface_hub import hf_hub_download import fasttext model = fasttext.load_model(hf_hub_download("wikilangs/tok", "model.bin")) - Notebooks
- Google Colab
- Kaggle

- Xet hash:
- 4b5888df7f4744385d40cec582ee8825500a2a9571178db1edaf75cea9c36184
- Size of remote file:
- 100 kB
- SHA256:
- 4279e7225b10a60529c2e4b231937fa04e05fd25426f5bc8104f029a0618671a
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.