What This Document Is
This is an introductory set of lecture notes focused on Markov Chains, a core topic within Probability Theory. Developed for a graduate-level course (STAT C205B) at the University of California, Berkeley, these notes lay the foundational groundwork for understanding stochastic processes where future states depend solely on the present state. It delves into the mathematical definitions and theoretical underpinnings of Markov Chains, setting the stage for more advanced explorations.
Why This Document Matters
These notes are invaluable for students of probability, statistics, mathematics, and related fields who are seeking a rigorous understanding of Markov Chains. They are particularly useful for those enrolled in a graduate-level probability course or preparing for further study in stochastic processes, queuing theory, or statistical inference. This resource is best utilized as a companion to lectures and problem sets, providing a detailed reference for key concepts and theorems.
Topics Covered
* The fundamental Markov Property and its implications
* Definition and properties of Markov Kernels
* Transition Probability Functions (t.p.f.) and their characteristics
* The Jonescu-Tulcca Theorem regarding the existence and uniqueness of Markov Chains
* Coordinate processes and their relationship to Markov Chains
* General facts about the distribution of states in a Markov Chain
* Introduction to harmonic functions within the context of Markov Chains
What This Document Provides
* Formal definitions of key concepts related to Markov Chains.
* A theoretical framework for understanding the behavior of these stochastic processes.
* Mathematical notation and terminology commonly used in the field.
* A discussion of how Markov kernels operate on measures.
* An introduction to the use of matrix notation for countable state spaces.
* A foundation for further study of continuous and discrete-time Markov processes.
