08-embeddings

Embeddings

Word Vectors and the Universal Sentence Encoder

• 📝 Understanding word vectors
• 🚂 What is word2vec, 🚂 Color Vectors
• 📚 2013 paper Efficient Estimation of Word Representations in Vector Space
• 🔢 GloVe: Global Vectors for Word Representation
• 📚 2018 Universal Sentence Encoder paper

Embeddings

• 🎥 What are Word Embeddings? from IBM
• 🎨 Embeddings Projector and Visualizing High Dimensional Space, Atlas
• 📝 Embeddings tutorial from Cohere
• 📚 What are embeddings? by Vicki Boykis
• 📚 Embeddings: What they are and why they matter
• 📚 Using open-source models for faster and cheaper text embeddings

Semantic Search and "Similarity"

• 📚 What is Semantic Search?
• 🎥 Cosine Similarity from StatQuest

Retrieval Augmented Generation (RAG)

• 📚 How to use retrieval augmented generation

Code Examples with Replicate + Transformers.js

• 🔢 All embeddings models on Replicate, All embeddings models for transformers.js
• 💻 Making your own Embeddings "Database", uses all-mpnet-base-v2 on Replicate and mixedbread-ai/mxbai-embed-large-v1 with transformers.js
• 💻 Retrieval Augmented Generation (RAG) with p5.js + Replicate
• 💻 Embeddings with Transformers.js

Clustering with UMAP dimensionality reduction

• Sentence Embeddings with transformers.js and UMAP
• Understanding UMAP
• umap-js
• UMAP p5.js examples
  • Simple clustering 3D colors -> 2D
  • Simple clustering random data, adjusting umap parameters
  • Animated UMAP process + Clustering sentence embeddings from a database!

Assignment

• 🎨 Prepare to present a final project proposal.