Evaluating Web Search Engines

Journal of Online Information Review (OIR) is going to publish a special issue on evaluating Web search engines. According to the journal's call for paper, "The aim of this special issue is to explore the importance and the many possibilities of evaluating Web search engines ... a web search is clearly the foremost method for finding information today. According to ComScore, more than 130 billion search queries were posed to search engines in a single month in 2009. This explains why search engine research is not only of interest to a community working on improving them, but also to a society whose members rely heavily on search engines. In contrast to the importance of search engines, there are still relatively few studies dealing with their quality. The question is how search engines can be best evaluated considering their wide use and the typical user behaviour towards them. Search engines are not only used for general-purpose queries, but in many different contexts. The spectrum of queries ranges from trivial to highly specific; the usage scenarios range from private to professional ... topics of interest may focus on but are not restricted to: Retrieval Effectiveness, Reliability of Search Results, Language Handling, Index Sizes and Overlap Comparisons, Query Log Analysis, User Behaviour, Results Presentation, User Surveys, User Guidance in the Search Process, Index and/or Results Freshness, Diversity of Results, Search Features Comparison and Influence of Search Engine Optimization (SEO) on Results Quality."

Popular posts from this blog

Web Search Efficacy

The following paper was published recently: Mansourian, Y. (2008). Web search efficacy: definition and implementation, Aslib Proceedings , Vol. 60, No. 4, pp. 349-363. Abstract: Purpose – This paper aims to report a number of factors that are perceived by web users as influential elements in their search procedure. The paper introduces a new conceptual measure called “web search efficacy” (hereafter WSE) to evaluate the performance of searches mainly based on users' perceptions. Design/methodology/approach – A rich dataset of a wider study was inductively re-explored to identify different categories that are perceived influential by web users on the final outcome of their searches. A selective review of the literature was carried out to discover to what extent previous research supports the findings of the current study. Findings – The analysis of the dataset led to the identification of five categories of influential factors. Within each group different factors have been recognize
Read more

Doctoral Forum in Aberystwyth

I attended a wonderful workshop at the University of Wales, Aberystwyth from 6th to 7th April. I delivered a presentation about my research. It was the third doctoral forum that I have attended during my PhD study. I like this kind of doctoral forums because it provides us with an opportunity to simply talk to other fellow researchers from different universities and learn new things from them. I’ll write more about the workshop in the next entries. I have uploaded some photos that I took in Aberystwyth on my homepage here and here .
Read more

Clusty

I think Clusty works more efficiently than other general-purpose search engines at present time. I like it because of the clustering method that it employs to present the search result. It seems very useful to me.
Read more