Estimation of mutual information: a survey

Walters-Williams, Janett and Li, Yan (2009) Estimation of mutual information: a survey. In: 4th International Conference on Rough Set and Knowledge Technology (RSKT 2009), 14-16 Jul 2009, Gold Coast, Australia.

Text (Documentation)

Download (752Kb)


A common problem found in statistics, signal processing, data analysis and image processing research is the estimation of mutual information, which tends to be difficult. The aim of this survey is threefold: an introduction for those new to the field, an overview for those working in the field and a reference for those searching for literature on different estimation methods. In
this paper comparison studies on mutual information estimation is considered.
The paper starts with a description of entropy and mutual information and it closes with a discussion on the performance of different estimation methods and some future challenges.

Statistics for USQ ePrint 6645
Statistics for this ePrint Item
Item Type: Conference or Workshop Item (Commonwealth Reporting Category E) (Paper)
Refereed: Yes
Item Status: Live Archive
Additional Information: © 2009 Springer Berlin Heidelberg. Permanent restricted access to published version due to publisher copyright policy. Print copy held USQ Library 006.3 Rou.
Faculty / Department / School: Historic - Faculty of Sciences - Department of Maths and Computing
Date Deposited: 24 Jan 2010 03:09
Last Modified: 24 Nov 2014 01:43
Uncontrolled Keywords: mutual information; entropy; density estimation
Fields of Research : 01 Mathematical Sciences > 0104 Statistics > 010405 Statistical Theory
01 Mathematical Sciences > 0103 Numerical and Computational Mathematics > 010301 Numerical Analysis
08 Information and Computing Sciences > 0806 Information Systems > 080607 Information Engineering and Theory
Socio-Economic Objective: B Economic Development > 89 Information and Communication Services > 8999 Other Information and Communication Services > 899999 Information and Communication Services not elsewhere classified
Identification Number or DOI: 10.1007/978-3-642-02962-2_49

Actions (login required)

View Item Archive Repository Staff Only