NLP Fundamentals

Working with Embeddings

In this repository, you'll find code and resources for a group of workshops designed to help you grasp the fundamentals of embeddings in their use for Natural Language Processing.

[!TIP] The sessions are designed to be as practical as possible. All the necessary theoretical background that could be needed has been covered in a comprehensive course, available online here: Understanding Embeddings for Natural Language Processing - OpenHPI

Slides

• Introduction to Embeddings

Introduction

• Overview
• Metrics
• Visualization tools

Session 1

• Text normalization
• Bag of Words
• TF-IDF

Session 2

• Using Word2Vec
• Word2Vec from scratch

Session 3

• GloVe
• FastText
• Doc2Vec

Session 4

• Embeddings with Bert
• Sentence transfvormers
• Indexing the embeddings

Session 5

• Vector databases

Installation

You can find instructions on how to prepare everything for the workshop here.

Contributing

Contributions are always welcome!

See contributing.md for ways to get started.

Please adhere to this project's code of conduct.

Roadmap

• Adding references
• Improving and expanding test suite
• Installation instructions for all platforms
• Installation inscructions with venv and pip
• 2D UMAP Embeddings from Word2Vec model

Authors

• Mario Tormo Romero
• Joaquin Gomez Prats

License

GNU GENERAL PUBLIC LICENSE, V.3