Artin Kavoosi
← Back to all posts
Seminar Note
February 2025MDP series · Part 1/2

An introduction to MDP

Abstract

In February 2025, I presented at the University of Tehran about MDP, the literature on MDP (mostly before RL!), the Bellman optimality equation, and classical MDP examples.

Markov Decision Processes Seminar ~1 min read
Contents

    The Markov decision processes (MDPs) represent beautiful mathematical aspects for solving probabilistic decision-making problems. Considering the complex relationship between parameters and different creative methods of solving made MDP a powerful approach to problem-solving in the literature, for example in inventory control, supply chain, financial analysis problems, etc.

    In February 2025, I presented at the University of Tehran about MDP, the literature on MDP (mostly before RL!), the Bellman optimality equation, and classical MDP examples.

    Attachments

    MDP

    Cite this note

    Kavoosi, A. (2025). “An introduction to MDP.” Research notes. https://akavosi.github.io/blog/posts/mdp.html

    @misc{kavoosi2025mdp,
  author = {Kavoosi, Artin},
  title  = {An introduction to MDP},
  year   = {2025},
  note   = {Personal research notes, informal, not peer-reviewed},
  url    = {https://akavosi.github.io/blog/posts/mdp.html}
}

    Informal research notes — not peer-reviewed.

    Continue reading

    Seminar Note · MDP series, Part 2/2 On average reward criterion Research Note Stochastic Queens Elimination