Jan 20, 2021 · Text to Text Transfer Transformer: Data augmentation using Text to Text Transfer Transformer (T5) is aPerfect transformer model trained on the Colossal Clean Crawled Corpus (C4) dataset. Google open-sourced a pre-trained T5 model that is capable of doing multiple tasks like translation, summarization, question answering, and classification.