Hacking Transformers with Hugging Face

Knowledge here. But in short:

pip install huggingface_hub

pip install --upgrade huggingface_hub

To test the install, you can try the below:

 python -c "import huggingface_hub; print(huggingface_hub.__version__)"

 python3 -c "import huggingface_hub; print(huggingface_hub.__version__)"

pip install transformers tensorflow (if you are using tensorflow, else type torch)

pip install transformers tensorflow datasets 

To test bring up Python CLI and do:

from transformers import AutoTokenizer.