This directory contain guides to help users to train NLP models. 1. [Training guide](train.md) explain the steps to follow for training NLP models on GPU and TPU. 2. [Pretrained_models guide](pretrained_models.md) explain how to load pre-trained NLP models (baselines and checkpoints) that can be finetuned further depending on application. 3. [TF-Hub guide](tfhub.md) explain how to use TF-NLP's [export_tfhub](https://github.com/tensorflow/models/blob/master/official/nlp/tools/export_tfhub.py) tool to export pre-trained Transformer encoders to SavedModels format that are suitable for publication on TF Hub.