A tutorial on ensembles and deep learning fusion with MNIST as guiding thread: A complex heterogeneous fusion scheme reaching 10 digits error

  1. Siham Tabik
  2. Fabian Alvear
  3. María Del Mar Ruiz
  4. José Luis Sancho-Gómez 1
  5. A. R. Figueiras-Vidal
  6. Francisco Herrera
  1. 1 Universidad Politécnica de Cartagena
    info

    Universidad Politécnica de Cartagena

    Cartagena, España

    ROR https://ror.org/02k5kx966

Journal:
ArXiv

ISSN: 2331-8422

Year of publication: 2020

Type: Article

More publications in: ArXiv

Abstract

Ensemble methods have been widely used for improving the results of the best single classification model. Indeed, a large body of works have achieved better results mainly by applying one specific ensemble method. However, very few works analyze complex fusion schemes using heterogeneous ensemble strategies. This paper is three-fold: 1) It provides a tutorial of the most popular ensemble methods, 2) analyzes the best ensembles using MNIST as guiding thread and 3) shows that complex fusion architectures based on heterogeneous ensembles can be considered as a mode of taking benefit from diversity. We introduce a complex fusion design that achieves a new record in MNIST with only 10 misclassified images.