Clement Delangue describes the evolution of Transformer models, which have generated unprecedented excitement in academia and industry, enabling huge advances in NLP such as next sentence prediction, question answering, and text summarization. He also shares why it’s important to ensure they are used in an ethical and transparent manner, and how we can operationalize ethics within the ML development pipeline to minimize their harms.
