A tutorial on ensembles and deep learning fusion with MNIST as guiding thread: A complex heterogeneous fusion scheme reaching 10 digits error

  1. Siham Tabik
  2. Fabian Alvear
  3. María Del Mar Ruiz
  4. José Luis Sancho-Gómez 1
  5. A. R. Figueiras-Vidal
  6. Francisco Herrera
  1. 1 Universidad Politécnica de Cartagena
    info

    Universidad Politécnica de Cartagena

    Cartagena, España

    ROR https://ror.org/02k5kx966

Revista:
ArXiv

ISSN: 2331-8422

Año de publicación: 2020

Tipo: Artículo

GOOGLE SCHOLAR lock_openAcceso abierto editor

Otras publicaciones en: ArXiv

Resumen

Ensemble methods have been widely used for improving the results of the best single classification model. Indeed, a large body of works have achieved better results mainly by applying one specific ensemble method. However, very few works analyze complex fusion schemes using heterogeneous ensemble strategies. This paper is three-fold: 1) It provides a tutorial of the most popular ensemble methods, 2) analyzes the best ensembles using MNIST as guiding thread and 3) shows that complex fusion architectures based on heterogeneous ensembles can be considered as a mode of taking benefit from diversity. We introduce a complex fusion design that achieves a new record in MNIST with only 10 misclassified images.