Investigating ensemble weight and the certainty distributions for indicating structural diversity

Lesedi Melton Masisi, Fulufhelo Nelwamondo, Tshilidzi Marwala

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review


In this paper an investigation of the distribution of the weights and the biases of the Multilayered Perceptron is conducted, in particular the variance of the weight vector (weights and biases) with the aim of indicating the existence of the structural diversity within the ensemble. This will indicate how well the weight vector samples are distributed from the mean and this will be used to serve as an indicator of the structural diversity of the classifiers within the ensemble. This is inspired by the fact that many measures of ensemble diversity are focused on the outcomes and not the classifier's structure and hence may lose out in diversity measures that correlate well with ensemble performance. Three ensembles were compared, one non-diverse and the other two ensembles made diverse. The generalization across all the ensembles was approximately the same (74 % accuracy). This could be attributed to the data used. Certainty measures were also conducted and indicated that the non-diverse ensemble was biased, even though the performance across the ensembles was the same.

Original languageEnglish
Title of host publicationAdvances in Neuro-Information Processing - 15th International Conference, ICONIP 2008, Revised Selected Papers
Number of pages8
EditionPART 2
Publication statusPublished - 2009
Externally publishedYes
Event15th International Conference on Neuro-Information Processing, ICONIP 2008 - Auckland, New Zealand
Duration: 25 Nov 200828 Nov 2008

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
NumberPART 2
Volume5507 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Conference15th International Conference on Neuro-Information Processing, ICONIP 2008
Country/TerritoryNew Zealand

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science


Dive into the research topics of 'Investigating ensemble weight and the certainty distributions for indicating structural diversity'. Together they form a unique fingerprint.

Cite this