Prof. Susan Murphy

 We used Reinforcement Learning; but did it work?

13 December 2021 at 3h15pm (CET)
Susan Murphy

Reinforcement Learning provides an attractive suite of online learning methods for personalizing interventions  in a Digital Health.  However after an reinforcement learning algorithm has been run in a clinical study, how do we assess whether personalization occurred? We might find users for whom it appears that the algorithm has indeed learned in which contexts the user is more responsive to a particular intervention. But could this have happened completely by chance? We discuss some first approaches to addressing these questions.  

Susan A. Murphy, Professor of Statistics, Professor of Computer Science at the Harvard John A. Paulson School of Engineering and Applied Sciences and Radcliffe Alumnae Professor at the Radcliffe Institute, Harvard University

Susan Murphy’s research focuses on improving sequential, individualized, decision making in health, in particular, clinical trial design and data analysis to inform the development of just-in-time adaptive interventions in digital health. She developed the micro-randomized trial for use in constructing digital health interventions; this trial design is in use across a broad range of health-related areas. Her lab works on online learning algorithms for developing personalized digital health interventions.  Dr. Murphy is a member of the National Academy of Sciences and of the National Academy of Medicine, both of the US National Academies.  In 2013 she was awarded a MacArthur Fellowship for her work on experimental designs to inform sequential decision making.  She is a Past-President of IMS and of the Bernoulli Society and a former editor of the Annals of Statistics.