Information Access Evaluation. Multilinguality, Multimodality, and Visualization

Information Access Evaluation. Multilinguality, Multimodality, and Visualization
Author: Pamela Forner
Publisher: Springer
Total Pages: 385
Release: 2013-09-10
Genre: Computers
ISBN: 3642408028

This book constitutes the refereed proceedings of the 4th International Conference of the CLEF Initiative, CLEF 2013, held in Valencia, Spain, in September 2013. The 32 papers and 2 keynotes presented were carefully reviewed and selected for inclusion in this volume. The papers are organized in topical sections named: evaluation and visualization; multilinguality and less-resourced languages; applications; and Lab overviews.

Information Access Evaluation. Multilinguality, Multimodality, and Visual Analytics

Information Access Evaluation. Multilinguality, Multimodality, and Visual Analytics
Author: Tiziana Catarci
Publisher: Springer
Total Pages: 157
Release: 2012-09-11
Genre: Computers
ISBN: 3642332471

This book constitutes the proceedings of the Third International Conference of the CLEF Initiative, CLEF 2012, held in Rome, Italy, in September 2012. The 14 papers and 3 poster abstracts presented were carefully reviewed and selected for inclusion in this volume. Furthermore, the books contains 2 keynote papers. The papers are organized in topical sections named: benchmarking and evaluation initiatives; information access; and evaluation methodologies and infrastructure.

Information Access Evaluation -- Multilinguality, Multimodality, and Interaction

Information Access Evaluation -- Multilinguality, Multimodality, and Interaction
Author: Evangelos Kanoulas
Publisher: Springer
Total Pages: 340
Release: 2014-08-19
Genre: Computers
ISBN: 3319113828

This book constitutes the refereed proceedings of the 5th International Conference of the CLEF Initiative, CLEF 2014, held in Sheffield, UK, in September 2014. The 11 full papers and 5 short papers presented were carefully reviewed and selected from 30 submissions. They cover a broad range of issues in the fields of multilingual and multimodal information access evaluation, also included are a set of labs and workshops designed to test different aspects of mono and cross-language information retrieval systems

Multilingual and Multimodal Information Access Evaluation

Multilingual and Multimodal Information Access Evaluation
Author: Pamela Forner
Publisher: Springer
Total Pages: 153
Release: 2011-09-25
Genre: Computers
ISBN: 3642237088

This book constitutes the refereed proceedings of the Second International Conference on Multilingual and Multimodal Information Access Evaluation, in continuation of the popular CLEF campaigns and workshops that have run for the last decade, CLEF 2011, held in Amsterdem, The Netherlands, in September 2011. The 14 revised full papers presented together with 2 keynote talks were carefully reviewed and selected from numerous submissions. The papers accepted for the conference included research on evaluation methods and settings, natural language processing within different domains and languages, multimedia and reflections on CLEF. Two keynote speakers highlighted important developments in the field of evaluation: the role of users in evaluation and a framework for the use of crowdsourcing experiments in the setting of retrieval evaluation.

Experimental IR Meets Multilinguality, Multimodality, and Interaction

Experimental IR Meets Multilinguality, Multimodality, and Interaction
Author: Gareth J.F. Jones
Publisher: Springer
Total Pages: 392
Release: 2017-08-31
Genre: Computers
ISBN: 3319658131

This book constitutes the refereed proceedings of the 8th International Conference of the CLEF Initiative, CLEF 2017, held in Dublin, Ireland, in September 2017. The 7 full papers and 9 short papers presented together with 6 best of the labs papers were carefully reviewed and selected from 38 submissions. In addition, this volume contains the results of 10 benchmarking labs reporting their year long activities in overview talks and lab sessions. The papers address all aspects of information access in any modality and language and cover a broad range of topics in the field of multilingual and multimodal information access evaluation.

Information Retrieval Evaluation in a Changing World

Information Retrieval Evaluation in a Changing World
Author: Nicola Ferro
Publisher: Springer
Total Pages: 597
Release: 2019-08-13
Genre: Computers
ISBN: 3030229483

This volume celebrates the twentieth anniversary of CLEF - the Cross-Language Evaluation Forum for the first ten years, and the Conference and Labs of the Evaluation Forum since – and traces its evolution over these first two decades. CLEF’s main mission is to promote research, innovation and development of information retrieval (IR) systems by anticipating trends in information management in order to stimulate advances in the field of IR system experimentation and evaluation. The book is divided into six parts. Parts I and II provide background and context, with the first part explaining what is meant by experimental evaluation and the underlying theory, and describing how this has been interpreted in CLEF and in other internationally recognized evaluation initiatives. Part II presents research architectures and infrastructures that have been developed to manage experimental data and to provide evaluation services in CLEF and elsewhere. Parts III, IV and V represent the core of the book, presenting some of the most significant evaluation activities in CLEF, ranging from the early multilingual text processing exercises to the later, more sophisticated experiments on multimodal collections in diverse genres and media. In all cases, the focus is not only on describing “what has been achieved”, but above all on “what has been learnt”. The final part examines the impact CLEF has had on the research world and discusses current and future challenges, both academic and industrial, including the relevance of IR benchmarking in industrial settings. Mainly intended for researchers in academia and industry, it also offers useful insights and tips for practitioners in industry working on the evaluation and performance issues of IR tools, and graduate students specializing in information retrieval.

Multilingual and Multimodal Information Access Evaluation

Multilingual and Multimodal Information Access Evaluation
Author: Maristella Agosti
Publisher: Springer
Total Pages: 158
Release: 2010-09-10
Genre: Computers
ISBN: 3642159982

In its ?rst ten years of activities (2000-2009), the Cross-Language Evaluation Forum (CLEF) played a leading role in stimulating investigation and research in a wide range of key areas in the information retrieval domain, such as cro- language question answering, image and geographic information retrieval, int- activeretrieval,and many more.It also promotedthe study andimplementation of appropriateevaluation methodologies for these diverse types of tasks and - dia. As a result, CLEF has been extremely successful in building a wide, strong, and multidisciplinary research community, which covers and spans the di?erent areasofexpertiseneededto dealwith thespreadofCLEFtracksandtasks.This constantly growing and almost completely voluntary community has dedicated an incredible amount of e?ort to making CLEF happen and is at the core of the CLEF achievements. CLEF 2010 represented a radical innovation of the “classic CLEF” format and an experiment aimed at understanding how “next generation” evaluation campaigns might be structured. We had to face the problem of how to innovate CLEFwhile still preservingits traditionalcorebusiness,namely the benchma- ing activities carried out in the various tracks and tasks. The consensus, after lively and community-wide discussions, was to make CLEF an independent four-day event, no longer organized in conjunction with the European Conference on Research and Advanced Technology for Digital Libraries (ECDL) where CLEF has been running as a two-and-a-half-day wo- shop. CLEF 2010 thus consisted of two main parts: a peer-reviewed conference – the ?rst two days – and a series of laboratories and workshops – the second two days.

Recent Findings in Intelligent Computing Techniques

Recent Findings in Intelligent Computing Techniques
Author: Pankaj Kumar Sa
Publisher: Springer
Total Pages: 588
Release: 2018-11-03
Genre: Technology & Engineering
ISBN: 9811086338

This three volume book contains the Proceedings of 5th International Conference on Advanced Computing, Networking and Informatics (ICACNI 2017). The book focuses on the recent advancement of the broad areas of advanced computing, networking and informatics. It also includes novel approaches devised by researchers from across the globe. This book brings together academic scientists, professors, research scholars and students to share and disseminate information on knowledge and scientific research works related to computing, networking, and informatics to discuss the practical challenges encountered and the solutions adopted. The book also promotes translation of basic research into applied investigation and convert applied investigation into practice.

Evaluating Information Retrieval and Access Tasks

Evaluating Information Retrieval and Access Tasks
Author: Tetsuya Sakai
Publisher: Springer Nature
Total Pages: 225
Release: 2021
Genre: Information retrieval
ISBN: 9811555540

This open access book summarizes the first two decades of the NII Testbeds and Community for Information access Research (NTCIR). NTCIR is a series of evaluation forums run by a global team of researchers and hosted by the National Institute of Informatics (NII), Japan. The book is unique in that it discusses not just what was done at NTCIR, but also how it was done and the impact it has achieved. For example, in some chapters the reader sees the early seeds of what eventually grew to be the search engines that provide access to content on the World Wide Web, todays smartphones that can tailor what they show to the needs of their owners, and the smart speakers that enrich our lives at home and on the move. We also get glimpses into how new search engines can be built for mathematical formulae, or for the digital record of a lived human life. Key to the success of the NTCIR endeavor was early recognition that information access research is an empirical discipline and that evaluation therefore lay at the core of the enterprise. Evaluation is thus at the heart of each chapter in this book. They show, for example, how the recognition that some documents are more important than others has shaped thinking about evaluation design. The thirty-three contributors to this volume speak for the many hundreds of researchers from dozens of countries around the world who together shaped NTCIR as organizers and participants. This book is suitable for researchers, practitioners, and students--anyone who wants to learn about past and present evaluation efforts in information retrieval, information access, and natural language processing, as well as those who want to participate in an evaluation task or even to design and organize one.