E2CNN: ensembles of CNN


Keywords
Edge AI, ensembles, embedded systems

Team

  Ansaloni Giovanni
  Atienza Alonso David
  Ponzina Flavio

Sources of Funding

SNF ML-edge
Compusapien
WiPLASH H2020
Fvllmonti


Ensembles of CNNs represent an effective aggregation strategy to improve accuracy. Nevertheless, The use of multiple CNN models increases memory and computing requirements, thus limiting the applicability of this approach in edge devices. We hence propose a methodology to address this challenge by constructing Embedded Ensembles of CNNs (E2CNN). Our proposal combines pruning and replication to transform an input single-instance CNN into an equivalent ensemble-based architecture. The resulting model benefits the higher accuracy and robustness of state-of-the-art ensembles, without increasing the initial memory and computing requirements.



Related Publications

Using Algorithmic Transformations and Sensitivity Analysis to Unleash Approximations in CNNs at the Edge
Ponzina, Flavio; Ansaloni, Giovanni; Peon Quiros, Miguel; Atienza Alonso, David
2022-07-19MDPI Micromachines - Special Issue "Hardware-Friendly Machine Learning and Its Applications"Publication funded by Compusapien (European Research Council – Consolidator Grant (ERC CoG) Project: Computing Server Architecture with Joint Power and Cooling Integration at the Nanoscale.)Publication funded by WiPLASH H2020 (WiPLASH H2020: Architecting More Than Moore – Wireless Plasticity for Heterogeneous Massive Computer Architectures)Publication funded by SNF ML-edge (Enabling Machine-Learning-Based Health Monitoring in Edge Sensors via Architectural Customization: Swiss NSF Research Project (Div. II))Publication funded by Fvllmonti (Ferroelectric Vertical Low energy Low latency low volume Modules fOr Neural network Transformers In 3D)
Error Resilient In-Memory Computing Architecture for CNN Inference on the Edge
Rios, Marco Antonio; Ponzina, Flavio; Ansaloni, Giovanni; Levisse, Alexandre Sébastien Julien; Atienza Alonso, David
2022-06-07Proceedings of the Great Lakes Symposium on VLSI 2022 Publication funded by Compusapien (European Research Council – Consolidator Grant (ERC CoG) Project: Computing Server Architecture with Joint Power and Cooling Integration at the Nanoscale.)Publication funded by WiPLASH H2020 (WiPLASH H2020: Architecting More Than Moore – Wireless Plasticity for Heterogeneous Massive Computer Architectures)Publication funded by SNF ML-edge (Enabling Machine-Learning-Based Health Monitoring in Edge Sensors via Architectural Customization: Swiss NSF Research Project (Div. II))Publication funded by Fvllmonti (Ferroelectric Vertical Low energy Low latency low volume Modules fOr Neural network Transformers In 3D)
An Accuracy-Driven Compression Methodology to Derive Efficient Codebook-Based CNNs
Ponzina, Flavio; Ansaloni, Giovanni; Peon Quiros, Miguel; Atienza Alonso, David
2022Conference PaperPublication funded by WiPLASH H2020 (WiPLASH H2020: Architecting More Than Moore – Wireless Plasticity for Heterogeneous Massive Computer Architectures)Publication funded by Compusapien (European Research Council – Consolidator Grant (ERC CoG) Project: Computing Server Architecture with Joint Power and Cooling Integration at the Nanoscale.)Publication funded by SNF ML-edge (Enabling Machine-Learning-Based Health Monitoring in Edge Sensors via Architectural Customization: Swiss NSF Research Project (Div. II))
A hardware/software co-design vision for deep learning at the edge
Ponzina, Flavio; Machetti, Simone; Rios, Marco Antonio; Denkinger, Benoît Walter; Levisse, Alexandre Sébastien Julien; Ansaloni, Giovanni; Peon Quiros, Miguel; Atienza Alonso, David
2022IEEE Micro - Special Issue on Artificial Intelligence at the EdgePublication funded by SNF ML-edge (Enabling Machine-Learning-Based Health Monitoring in Edge Sensors via Architectural Customization: Swiss NSF Research Project (Div. II))Publication funded by Compusapien (European Research Council – Consolidator Grant (ERC CoG) Project: Computing Server Architecture with Joint Power and Cooling Integration at the Nanoscale.)Publication funded by WiPLASH H2020 (WiPLASH H2020: Architecting More Than Moore – Wireless Plasticity for Heterogeneous Massive Computer Architectures)
A Flexible In-Memory Computing Architecture for Heterogeneously Quantized CNNs
Ponzina, Flavio; Rios, Marco Antonio; Ansaloni, Giovanni; Levisse, Alexandre Sébastien Julien; Atienza Alonso, David
2021-07-072021 IEEE Computer Society Annual Symposium on VLSI (ISVLSI)Publication funded by Compusapien (European Research Council – Consolidator Grant (ERC CoG) Project: Computing Server Architecture with Joint Power and Cooling Integration at the Nanoscale.)Publication funded by WiPLASH H2020 (WiPLASH H2020: Architecting More Than Moore – Wireless Plasticity for Heterogeneous Massive Computer Architectures)Publication funded by SNF ML-edge (Enabling Machine-Learning-Based Health Monitoring in Edge Sensors via Architectural Customization: Swiss NSF Research Project (Div. II))
E2CNN: Ensembles of Convolutional Neural Networks to Improve Robustness Against Memory Errors in Edge-Computing Devices
Ponzina, Flavio; Peon Quiros, Miguel; Burg, Andreas Peter; Atienza Alonso, David
2021IEEE - Transactions on ComputersPublication funded by Compusapien (European Research Council – Consolidator Grant (ERC CoG) Project: Computing Server Architecture with Joint Power and Cooling Integration at the Nanoscale.)Publication funded by WiPLASH H2020 (WiPLASH H2020: Architecting More Than Moore – Wireless Plasticity for Heterogeneous Massive Computer Architectures)Publication funded by SNF ML-edge (Enabling Machine-Learning-Based Health Monitoring in Edge Sensors via Architectural Customization: Swiss NSF Research Project (Div. II))