IS&T RCS Tutorial - Natural Language Processing with Python (Hands-on)

Human communication is rich and complex, and one of the main ways we encode it computationally is through Natural Language Processing (NLP). In this tutorial, we'll explore recent advances in NLP. First, we'll look at generating random first names of people using a simple character level "bigram" model. Then we'll dive into word embeddings, a technique for encoding words as vectors that capture their semantic meaning. We'll look at the popular word2vec method and explore how to perform linguistic operations using simple vector arithmetic. Finally, we'll look at transformer models and see how we can use a pre-trained SentenceTransformer model to do a range of classification on real-world data.