Engineering AI Agents
BOOK
Foundations
Training Deep Networks
Perception
State Estimation
Large Language Models
Multimodal Reasoning
Planning
Markov Decision Processes
Reinforcement Learning
COURSES
Introduction to AI
AI for Robotics
Deep Learning for Computer Vision
DATA MINING - BEING PORTED
ABOUT ME
Large Language Models
LLM Inference
Large Language Models
Introduction to NLP Pipelines
Text Tokenization
Word2Vec Embeddings {#sec-word2vec}
Word2Vec from scratch
Word2Vec Tensorflow Tutorial
Introduction to Recurrent Neural Networks (RNN)
Simple RNN
Time Series Prediction using RNNs
The Long Short-Term Memory (LSTM) Architecture
Language Models
RNN Language Models
Example of an RNN Language Model
RNN-based Neural Machine Translation
Character-level recurrent sequence-to-sequence model
The BLEU Score
Attention in RNN-based NMT
Transformers and Self-Attention
Single-head self-attention
Multi-head self-attention
Positional Embeddings
LLM Inference
Large Language Models
LLM Inference
LLM Inference
Understanding its Complexity
Back to top
Positional Embeddings