Semester Projects

List of Projects – Autumn 2021

 
 
The Geometry of the Global Minima Manifold in Overparameterized Neural Networks (NNs)- assigned
 

Project supervisor- Berfin Simsek, co-supervised with François Ged.


What are we curious about? An empirical study – assigned

Humans not only seek external rewards such as money or food but also like to solve puzzles, try new activities, watch series, and do many other tasks that are not directly related to their primary needs and survival. In neuroscience and psychology, these activities are often interpreted as curiosity-driven activities. In the reinforcement learning (RL) framework, the curiosity-driven decisions of humans are modeled as actions towards maximizing an “internal reward” or “intrinsic motivation”. Seeking such intrinsic motivations can help an artificial agent to efficiently explore its environment (for example in Atari games [1,2]) and can explain human exploratory behavior [3].

In this project, you will compare the effect of seeking different intrinsic motivations on the performance of an RL agent in different types of environments. We will stick to tabular settings and use classic model-based RL algorithms augmented with intrinsic motivations. The hope is to find better intuitions about the potential answers to “Why are humans curious?” and “What are they curious about?”.

Requirements:

– You should be familiar with RL theory and different RL algorithms; it would be ideal if you have passed the Artificial Neural Network course by Prof. Wulfram Gerstner.

– You need to be able to code efficiently and comfortably in either Python or Julia (preferred) language.

[1] https://arxiv.org/abs/1808.04355

[2] https://arxiv.org/abs/1606.01868

[3] https://doi.org/10.1101/2020.09.24.311084

————————————————————————————————————–

Interested students should send an email with their CV and grades to [email protected].