EE-604 Estimation Theory

General Information

Instructor: Dr. Alireza Karimi, MER, Room MEC2 397, tél: 35925.

Objectives: Estimation theory is widely used in many branches of science and engineering and there exists a rich collection of estimation methods and algorithms from which to choose. The objective of this course is to describe many of the important estimation methods and to show how they are interrelated. Because of the importance of digital technology, estimation is presented from a discrete-time viewpoint. Moreover, recursive algorithms, the most important one being the Kalman filter, are covered in depth. Applications are drawn from various fields, such as control, signal processing, and communications.


– Classical estimation
    – Minimum Variance Unbiased Estimator (MVU)
    – Cramer-Rao Lower Bound (CRLB)
    – Best Linear Unbiased Estimator (BLUE)
    – Maximum Likelihood Estimator (MLE)
    – Least Squares Estimator (LSE)

– Bayesian estimation
    – Minimum Mean Square Error Estimator (MMSE)
    – Maximum A Posteriori Estimator (MAP)
    – Linear MMSE Estimator
    – Kalman Filter

Reference: Fundamentals of statistical signal processing – Estimation Theory. By Steven. M. Kay

Required prior knowledge: Linear Algebra, Probability, Random Variables and Stochastic Processes, State Space Theory.