Animal-robot interactions

Our research develops and uses robotic devices that interact with animal groups to observe and modulate their behaviour, in order to better understand them, e.g. their collective decision making.

This work has goals in behavioural sciences, collective dynamics and systems modelling; and employs tools and techniques from mobile robotics, microengineering, machine learning, computer vision, and complex systems.


Honeybees and robots

 

photograph by ArtLifeLab Graz. Hardware by MOBOTS-EPFL
     

We are developing robotic devices that live inside beehives and continually interact with entire honeybee colonies. The robots modulate the internal hive environment with vibrations and heat; these are used to explore how behaviours can be steered at individual and colony levels (Ilgun et al, 2021). We have recently demonstrated the capacity of our robotic system to interact with an intact winter cluster, comprising thousands of animals (Barmak et al, 2023; see also our press release). This research is part of the FET-EU project HIVEOPOLIS, in which we also contribute to core systems (e.g., Komasilovs et al, 2024) and educational activities. Overall a main aim is to better understand how our long-term live-in robotics (Barmak et al, 2024) can support honeybees in an increasingly hostile environment for these crucial pollinators. 

Our previous work studied collective behaviours in honeybee-robot interactions in laboratory conditions (Schmickl et al 2021Halloy et al 2013Zahadat et al 2014), investigating how reactive thermal environments influence decision-making.


Fish and robots

Photographer: Catherine Leutenegger, EPFL
     

We are developing systems comprising of multiple mobile robots interacting with small groups of fish such as zebrafish (Danio rerio) and rummy-nose tetra (Hemigramus rhodostomus). The robotic agents (Bonnet et al 2017, Bonnet et al 2016, Papaspyros et al 2019, Papaspyros et al, 2023) were controlled via a closed-loop system using computer vision analysis (Bonnet et al 2017), and have been shown to be capable of integrating into groups of fish (Bonnet et al 2018) and modulating collective decisions (Bonnet et al 2018, Chemtob et al 2020). More generally, we work on modelling the dynamics of fish (Escodebo et al 2020), so to design robotic interactions with increased bio-acceptance (Papaspyros et al 2019). Most recently we have shown that  deep learning models of fish social interactions  are competitive with analytical approaches (Papaspyros et al, 2024) as well as being generalisable. 

 


Interspecies interactions mediated by bio-hybrid robots

Our research within the FET-EU project ASSISIbf included the
breakthrough of developing inter-species interactions between
honeybees and zebrafish, mediated via robots (Bonnet et al, 2019).

Our press release includes a further summary of this research:


Animals and robots – other research

 

 
     
  • The LEURRE project constructed the first robots that were shown to infiltrate an animal group – being accepted like conspecifics – and, through acting as “agent provocateur”, were able to modulate group decisions from within. (Halloy et al 2007). Here, our robots interacted with cockroaches.
  • We developed mobile robots that interacted with domestic chickens, (Gribovskiy et al 2018, 2008, 2012). This system made use of visual and auditory channels for both observation (animals ⇒ robots) and modulation (robots ⇒ animals). 
  • Across all animal-robot interaction studies, the robotic devices must be capable of transmitting cues or signals that are relevant to the animal, of sensing the animal’s response to the presented information, and finally of reacting to it. The design of such animal-interacting robots is highly non-trivial, depending on understanding the animals, modelling, robot design, and embodiment. We developed a general methodology to address these interconnected challenges (Mondada et al 2013).

Related publications