Engineering AI Agents
BOOK
Foundations
Training Deep Networks
Perception
State Estimation
Large Language Models
Multimodal Reasoning
Planning
Markov Decision Processes
Reinforcement Learning
COURSES
Introduction to AI
AI for Robotics
Deep Learning for Computer Vision
DATA MINING - BEING PORTED
ABOUT ME
Examples
The recycling robot.
Bellman Equations
Markov Decision Processes
Introduction to MDP
Bellman Expectation Backup
Policy Evaluation (Prediction)
Bellman Optimality Backup
Policy Improvement (Control)
Dynamic Programming Algorithms
Policy Iteration
Value Iteration
Examples
Cleaning Robot - Deterministic MDP
Cleaning Robot - Stochastic MDP
The recycling robot.
On this page
Problem statement
Solution
Edit this page
View source
Report an issue
Examples
The recycling robot.
The recycling robot.
Problem statement
Finite State Machine of a a recycling robot and MDP dynamics LUT
Solution
solution
Back to top
Cleaning Robot - Stochastic MDP