Estimation of mutual information: a survey

Walters-Williams, Janett and Li, Yan (2009) Estimation of mutual information: a survey. In: RSKT 2009: 4th International Conference on Rough Set and Knowledge Technology , 14-16 Jul 2009, Gold Coast, Australia.

PDF (Accepted Version)

Download (156Kb)
PDF (Documentation)

Download (752Kb)


A common problem found in statistics, signal processing, data analysis and image processing research is the estimation of mutual information, which tends to be difficult. The aim of this survey is threefold: an introduction for those new to the field, an overview for those working in the field and a reference for those searching for literature on different estimation methods. In this paper comparison studies on mutual information estimation is considered. The paper starts with a description of entropy and mutual information and it closes with a discussion on the performance of different estimation methods and some future challenges.

Statistics for USQ ePrint 6645
Statistics for this ePrint Item
Item Type: Conference or Workshop Item (Commonwealth Reporting Category E) (Paper)
Refereed: Yes
Item Status: Live Archive
Additional Information: Print copy held USQ Library 006.3 Rou. Author's version deposited in accordance with the copyright policy of the publisher. This is the authors' version of the work. It is posted here with permission of the publisher for your personal use. No further distribution is permitted. The item is also available in Lecture Notes in Computer Science v. 5589 at
Depositing User: Dr Yan Li
Faculty / Department / School: Historic - Faculty of Sciences - Department of Maths and Computing
Date Deposited: 24 Jan 2010 03:09
Last Modified: 10 Sep 2014 05:50
Uncontrolled Keywords: mutual information; entropy; density estimation
Fields of Research (FOR2008): 01 Mathematical Sciences > 0103 Numerical and Computational Mathematics > 010301 Numerical Analysis
08 Information and Computing Sciences > 0801 Artificial Intelligence and Image Processing > 080199 Artificial Intelligence and Image Processing not elsewhere classified
08 Information and Computing Sciences > 0806 Information Systems > 080607 Information Engineering and Theory
Socio-Economic Objective (SEO2008): B Economic Development > 89 Information and Communication Services > 8999 Other Information and Communication Services > 899999 Information and Communication Services not elsewhere classified
Identification Number or DOI: doi: 10.1007/978-3-642-02962-2_49

Actions (login required)

View Item Archive Repository Staff Only