This directory contains binaries and utils required for input preprocessing, tokenization, etc that can be used with model building blocks available in NLP modeling library [nlp/modelling](https://github.com/tensorflow/models/tree/master/official/nlp/modeling) to train custom models and validate new research ideas.