Performing informetric analysis on information retrieval test collections: Preliminary experiments in the physics domain (rip)

Heck, Tamara and Schaer, Philipp (2013) Performing informetric analysis on information retrieval test collections: Preliminary experiments in the physics domain (rip). In: 14th International Society of Scientometrics and Informetrics Conference, ISSI 2013, 15-20 Dec 2013, Vienna, Austria.

Abstract

The combination of informetric analysis and information retrieval allows a twofold application. (1) While informetrics analysis is primarily used to gain insights into a scientific domain, it can be used to build recommendation or alternative ranking services. They are usually based on methods like co-occurrence or citation analyses. (2) Information retrieval and its decades-long tradition of rigorous evaluation using standard document corpora, predefined topics and relevance judgements can be used as a test bed for informetric analyses. We show a preliminary experiment on how both domains can be connected using the iSearch test collection, a standard information retrieval test collection derived from the open access arXiv.org preprint server. In this paper the aim is to draw a conclusion about the appropriateness of iSearch as a test bed for the evaluation of a retrieval or recommendation system that applies informetric methods to improve retrieval results for the user. Based on an interview study with physicists, bibliographic coupling and author-co-citation analysis, important authors for ten different research questions are identified. The results show that the analysed corpus includes these authors and their corresponding documents. This study is a first step towards a combination of retrieval evaluations and the evaluation of informetric analyses methods. © AIT Austrian Institute of Technology GmbH Vienna 2013.


Statistics for USQ ePrint 33356
Statistics for this ePrint Item
Item Type: Conference or Workshop Item (Commonwealth Reporting Category E) (Paper)
Refereed: Yes
Item Status: Live Archive
Faculty / Department / School: Historic - Australian Digital Futures Institute
Date Deposited: 19 Mar 2018 23:49
Last Modified: 19 Mar 2018 23:49
Uncontrolled Keywords: alternative ranking; bibliographic couplings; citation analysis; relevance judgement; research questions; retrieval evaluation; rigorous evaluation; standard documents; computer applications; acoustical and optical measuring instruments; electric and electronic measuring instruments; mechanical and miscellaneous measuring instruments; moisture, pressure and temperature; radiation measuring instruments
Fields of Research : 08 Information and Computing Sciences > 0899 Other Information and Computing Sciences > 089999 Information and Computing Sciences not elsewhere classified
URI: http://eprints.usq.edu.au/id/eprint/33356

Actions (login required)

View Item Archive Repository Staff Only