...Prabha Rajagopal; Sri Devi Ravana; Yun Sing Koh; Vimala Balakrishnan Purpose The effort in addition to relevance is a major factor for satisfaction and utility of the document to the actual user. The purpose of this paper is to propose a method in generating relevance judgments that incorporate...

...Sri Devi Ravana; Prabha Rajagopal; Vimala Balakrishnan Purpose – In a system-based approach, replicating the web would require large test collections, and judging the relevancy of all documents per topic in creating relevance judgment through human assessors is infeasible. Due to the large amount...