SemanticMetadata.net

SIGIR Forum June 2007

In the last issue of the SIGIR Forum I found a very interesting in my opinion is the article of Massimo Melucci: On Rank Correlation in Information Retrieval Evaluation. I really like this paper. Massimo Melucci gives a lot of basic references on the use of rank correlation in retrieval evaluation. However his publication has a very practical (in contrast to mathematical & theoretical) essence and remains restricted to the comparison of values generated by experts or algorithms. The complicated task of integrating the target user (not an retrieval expert assessing the results) is not discussed in length.

Especially the last thing was part of the work in my PhD. One can find some further information in the publication Empirical Studies in Multimedia Retrieval Evaluation available here.