Estimating missing data and determining the confidence of the estimate data

Jaisheel Mistry; Fulufhelo Nelwamondo; Tshlidzi Marwala

doi:10.1109/ICMLA.2008.71

Estimating missing data and determining the confidence of the estimate data

Jaisheel Mistry
, Fulufhelo Nelwamondo
, Tshlidzi Marwala

University of the Witwatersrand

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

11 Citations (Scopus)

Abstract

A Computational Intelligence approach to estimate missing data makes use of Autoassociative Neural Networks (ANN) and a stochastic optimization technique. The ANN captures interrelationships within data and the optimization technique estimates probable values that are used as inputs to the ANN. The optimum estimate is one that has a minimum influence on the output of the ANN. A method to determine the confidence of this estimate is presented in this paper. An ensemble of ANNs with a Multi Layer Perceptron architecture is collected using Bayesian training methods. The percentage of the most dominant estimate values is used as a confidence measure. The South African antenatal seroprevalence survey data is used and the HIV status of the patients is estimated. It was found that the missing data could be estimated with an overall accuracy of 68% and the confidence ranges between 50% and 97%. Estimates that have a confidence exceeding 70% have 88% estimation accuracy.

Original language	English
Title of host publication	Proceedings - 7th International Conference on Machine Learning and Applications, ICMLA 2008
Pages	752-755
Number of pages	4
DOIs	https://doi.org/10.1109/ICMLA.2008.71
Publication status	Published - 2008
Externally published	Yes
Event	7th International Conference on Machine Learning and Applications, ICMLA 2008 - San Diego, CA, United States Duration: 11 Dec 2008 → 13 Dec 2008

Publication series

Name	Proceedings - 7th International Conference on Machine Learning and Applications, ICMLA 2008

Conference

Conference	7th International Conference on Machine Learning and Applications, ICMLA 2008
Country/Territory	United States
City	San Diego, CA
Period	11/12/08 → 13/12/08

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

SDG 3 Good Health and Well-being

ASJC Scopus subject areas

Artificial Intelligence
Computer Science Applications
Software

Access to Document

10.1109/ICMLA.2008.71

Cite this

Mistry, J., Nelwamondo, F., & Marwala, T. (2008). Estimating missing data and determining the confidence of the estimate data. In Proceedings - 7th International Conference on Machine Learning and Applications, ICMLA 2008 (pp. 752-755). Article 4725060 (Proceedings - 7th International Conference on Machine Learning and Applications, ICMLA 2008). https://doi.org/10.1109/ICMLA.2008.71

@inproceedings{fd4fafd5c75f4924b859868193fff934,

title = "Estimating missing data and determining the confidence of the estimate data",

abstract = "A Computational Intelligence approach to estimate missing data makes use of Autoassociative Neural Networks (ANN) and a stochastic optimization technique. The ANN captures interrelationships within data and the optimization technique estimates probable values that are used as inputs to the ANN. The optimum estimate is one that has a minimum influence on the output of the ANN. A method to determine the confidence of this estimate is presented in this paper. An ensemble of ANNs with a Multi Layer Perceptron architecture is collected using Bayesian training methods. The percentage of the most dominant estimate values is used as a confidence measure. The South African antenatal seroprevalence survey data is used and the HIV status of the patients is estimated. It was found that the missing data could be estimated with an overall accuracy of 68\% and the confidence ranges between 50\% and 97\%. Estimates that have a confidence exceeding 70\% have 88\% estimation accuracy.",

author = "Jaisheel Mistry and Fulufhelo Nelwamondo and Tshlidzi Marwala",

year = "2008",

doi = "10.1109/ICMLA.2008.71",

language = "English",

isbn = "9780769534954",

series = "Proceedings - 7th International Conference on Machine Learning and Applications, ICMLA 2008",

pages = "752--755",

booktitle = "Proceedings - 7th International Conference on Machine Learning and Applications, ICMLA 2008",

note = "7th International Conference on Machine Learning and Applications, ICMLA 2008 ; Conference date: 11-12-2008 Through 13-12-2008",

}

Mistry, J, Nelwamondo, F & Marwala, T 2008, Estimating missing data and determining the confidence of the estimate data. in Proceedings - 7th International Conference on Machine Learning and Applications, ICMLA 2008., 4725060, Proceedings - 7th International Conference on Machine Learning and Applications, ICMLA 2008, pp. 752-755, 7th International Conference on Machine Learning and Applications, ICMLA 2008, San Diego, CA, United States, 11/12/08. https://doi.org/10.1109/ICMLA.2008.71

Estimating missing data and determining the confidence of the estimate data. / Mistry, Jaisheel; Nelwamondo, Fulufhelo; Marwala, Tshlidzi.
Proceedings - 7th International Conference on Machine Learning and Applications, ICMLA 2008. 2008. p. 752-755 4725060 (Proceedings - 7th International Conference on Machine Learning and Applications, ICMLA 2008).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Estimating missing data and determining the confidence of the estimate data

AU - Mistry, Jaisheel

AU - Nelwamondo, Fulufhelo

AU - Marwala, Tshlidzi

PY - 2008

Y1 - 2008

N2 - A Computational Intelligence approach to estimate missing data makes use of Autoassociative Neural Networks (ANN) and a stochastic optimization technique. The ANN captures interrelationships within data and the optimization technique estimates probable values that are used as inputs to the ANN. The optimum estimate is one that has a minimum influence on the output of the ANN. A method to determine the confidence of this estimate is presented in this paper. An ensemble of ANNs with a Multi Layer Perceptron architecture is collected using Bayesian training methods. The percentage of the most dominant estimate values is used as a confidence measure. The South African antenatal seroprevalence survey data is used and the HIV status of the patients is estimated. It was found that the missing data could be estimated with an overall accuracy of 68% and the confidence ranges between 50% and 97%. Estimates that have a confidence exceeding 70% have 88% estimation accuracy.

AB - A Computational Intelligence approach to estimate missing data makes use of Autoassociative Neural Networks (ANN) and a stochastic optimization technique. The ANN captures interrelationships within data and the optimization technique estimates probable values that are used as inputs to the ANN. The optimum estimate is one that has a minimum influence on the output of the ANN. A method to determine the confidence of this estimate is presented in this paper. An ensemble of ANNs with a Multi Layer Perceptron architecture is collected using Bayesian training methods. The percentage of the most dominant estimate values is used as a confidence measure. The South African antenatal seroprevalence survey data is used and the HIV status of the patients is estimated. It was found that the missing data could be estimated with an overall accuracy of 68% and the confidence ranges between 50% and 97%. Estimates that have a confidence exceeding 70% have 88% estimation accuracy.

UR - https://www.scopus.com/pages/publications/60649116946

U2 - 10.1109/ICMLA.2008.71

DO - 10.1109/ICMLA.2008.71

M3 - Conference contribution

AN - SCOPUS:60649116946

SN - 9780769534954

T3 - Proceedings - 7th International Conference on Machine Learning and Applications, ICMLA 2008

SP - 752

EP - 755

BT - Proceedings - 7th International Conference on Machine Learning and Applications, ICMLA 2008

T2 - 7th International Conference on Machine Learning and Applications, ICMLA 2008

Y2 - 11 December 2008 through 13 December 2008

ER -

Estimating missing data and determining the confidence of the estimate data

Abstract

Publication series

Conference

UN SDGs

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this