Conference and Labs of the Evaluation Forum
From Wikipedia, the free encyclopedia
The Conference and Labs of the Evaluation Forum (formerly Cross-Language Evaluation Forum), or CLEF, is an organization promoting research in multilingual information access (currently focusing on European languages). Its specific functions are to maintain an underlying framework for testing information retrieval systems and to create repositories of data for researchers to use in developing comparable standards.[1] The organization holds a conference every September in Europe since a first constituting workshop in 2000. From 1997 to 1999, TREC, the similar evaluation conference organised annually in the US, included a track for the evaluation of Cross-Language IR for European languages. This track was coordinated jointly by NIST and by a group of European volunteers that grew over the years. At the end of 1999, a decision by some of the participants was made to transfer the activity to Europe and set it up independently. The aim was to expand coverage to a larger number of languages and to focus on a wider range of issues, including monolingual system evaluation for languages other than English. Over the years, CLEF has been supported by a number of various EU funded projects and initiatives. [2]
Conference and Labs of the Evaluation Forum | |
---|---|
Abbreviation | CLEF |
Discipline | information retrieval |
Publication details | |
Publisher | Springer and CEUR Workshop Proceedings |
History | 2000; 24 years ago (2000); formerly known as Cross-Language Evaluation Forum from 2000 to 2009 |
Frequency | annual |
Website | www |
CLEF 2019 marked the 20th anniversary of the conference and it was celebrated by publishing a book[3] on the lessons learned in 20 years of evaluation activities.