E2CNN: ensembles of CNN


Keywords
Edge AI, ensembles, embedded systems

Team

  Ansaloni Giovanni
  Atienza Alonso David
  Ponzina Flavio

Sources of Funding

SNF ML-edge
Compusapien
WiPLASH H2020
Fvllmonti


Ensembles of CNNs represent an effective aggregation strategy to improve accuracy. Nevertheless, The use of multiple CNN models increases memory and computing requirements, thus limiting the applicability of this approach in edge devices. We hence propose a methodology to address this challenge by constructing Embedded Ensembles of CNNs (E2CNN). Our proposal combines pruning and replication to transform an input single-instance CNN into an equivalent ensemble-based architecture. The resulting model benefits the higher accuracy and robustness of state-of-the-art ensembles, without increasing the initial memory and computing requirements.



Related Publications

Using Algorithmic Transformations and Sensitivity Analysis to Unleash Approximations in CNNs at the Edge
Ponzina, Flavio; Ansaloni, Giovanni; Peon Quiros, Miguel; Atienza Alonso, David
2022-07-19MDPI Micromachines - Special Issue "Hardware-Friendly Machine Learning and Its Applications"Publication funded by Compusapien (Next-gen computing systems inspired by the human brain)Publication funded by WiPLASH H2020 (New on-chip wireless communication plane)Publication funded by SNF ML-edge (ML-edge: Enabling Machine-Learning-Based Health Monitoring in Edge Sensors via Architectural Customization)Publication funded by Fvllmonti ((FETPROACT))
Error Resilient In-Memory Computing Architecture for CNN Inference on the Edge
Rios, Marco Antonio; Ponzina, Flavio; Ansaloni, Giovanni; Levisse, Alexandre Sébastien Julien; Atienza Alonso, David
2022-06-07Proceedings of the Great Lakes Symposium on VLSI 2022 Publication funded by Compusapien (Next-gen computing systems inspired by the human brain)Publication funded by WiPLASH H2020 (New on-chip wireless communication plane)Publication funded by SNF ML-edge (ML-edge: Enabling Machine-Learning-Based Health Monitoring in Edge Sensors via Architectural Customization)Publication funded by Fvllmonti ((FETPROACT))
An Accuracy-Driven Compression Methodology to Derive Efficient Codebook-Based CNNs
Ponzina, Flavio; Ansaloni, Giovanni; Peon Quiros, Miguel; Atienza Alonso, David
2022Conference PaperPublication funded by WiPLASH H2020 (New on-chip wireless communication plane)Publication funded by Compusapien (Next-gen computing systems inspired by the human brain)Publication funded by SNF ML-edge (ML-edge: Enabling Machine-Learning-Based Health Monitoring in Edge Sensors via Architectural Customization)
A hardware/software co-design vision for deep learning at the edge
Ponzina, Flavio; Machetti, Simone; Rios, Marco Antonio; Denkinger, Benoît Walter; Levisse, Alexandre Sébastien Julien; Ansaloni, Giovanni; Peon Quiros, Miguel; Atienza Alonso, David
2022IEEE Micro - Special Issue on Artificial Intelligence at the EdgePublication funded by SNF ML-edge (ML-edge: Enabling Machine-Learning-Based Health Monitoring in Edge Sensors via Architectural Customization)Publication funded by Compusapien (Next-gen computing systems inspired by the human brain)Publication funded by WiPLASH H2020 (New on-chip wireless communication plane)
A Flexible In-Memory Computing Architecture for Heterogeneously Quantized CNNs
Ponzina, Flavio; Rios, Marco Antonio; Ansaloni, Giovanni; Levisse, Alexandre Sébastien Julien; Atienza Alonso, David
2021-07-072021 IEEE Computer Society Annual Symposium on VLSI (ISVLSI)Publication funded by Compusapien (Next-gen computing systems inspired by the human brain)Publication funded by WiPLASH H2020 (New on-chip wireless communication plane)Publication funded by SNF ML-edge (ML-edge: Enabling Machine-Learning-Based Health Monitoring in Edge Sensors via Architectural Customization)
E2CNN: Ensembles of Convolutional Neural Networks to Improve Robustness Against Memory Errors in Edge-Computing Devices
Ponzina, Flavio; Peon Quiros, Miguel; Burg, Andreas Peter; Atienza Alonso, David
2021IEEE - Transactions on ComputersPublication funded by Compusapien (Next-gen computing systems inspired by the human brain)Publication funded by WiPLASH H2020 (New on-chip wireless communication plane)Publication funded by SNF ML-edge (ML-edge: Enabling Machine-Learning-Based Health Monitoring in Edge Sensors via Architectural Customization)