We present in this section lists of evaluation resources, providers, distributors and of evaluation packages.

Evaluation softwares

• NIST MT evaluation kit

• GTM General Text Matcher for MT evaluation

• EvalTrans for MT evaluation

• ROUGE for automatic evaluation of summaries

Evaluation Packages

List of evaluation packages available in ELRA Catalogue:

• Amaryllis for French Information Retrieval Evaluation.

• Aurora evaluation Packages:

• AURORA Project Database 2.0 - Evaluation Package.
• AURORA Project database - Subset of SpeechDat-Car - Finnish database - Evaluation Package.
• AURORA Project database - Subset of SpeechDat-Car - Spanish database - Evaluation Package.
• AURORA Project database - Subset of SpeechDat-Car - German database - Evaluation Package.
• AURORA Project database - Subset of SpeechDat-Car - Danish database - Evaluation Package.
• AURORA Project database - Subset of SpeechDat-Car - Italian database - Evaluation Package.
• AURORA Project Database - Aurora 4a - Evaluation Package.
• AURORA Project Database - Aurora 4b - Evaluation Package.

• EVALDA Evaluation Packages:

• ARCADE II evaluation package for Parallel Text Alignment.
• CESART evaluation package for Terminology Extraction.
• CESTA evaluation package for Machine Translation.
• EQueR evaluation package for Question-Answering.
• ESTER evaluation package for Speech Recognition.
• EvaSy evaluation package for Speech Synthesis.
• MEDIA evaluation package for Spoken Dialog.

• TC-STAR Evaluation Packages:

• TC-STAR 2007 Evaluation Package - ASR English.
• TC-STAR 2007 Evaluation Package - ASR Spanish - EPPS.
• TC-STAR 2007 Evaluation Package - ASR Spanish - CORTES.
• TC-STAR 2007 Evaluation Package - ASR Mandarin Chinese.
• TC-STAR 2007 Evaluation Package - SLT English-to-Spanish.
• TC-STAR 2007 Evaluation Package - SLT Spanish-to-English - EPPS.
• TC-STAR 2007 Evaluation Package - SLT Spanish-to-English - CORTES.
• TC-STAR 2007 Evaluation Package - SLT Chinese-to-English.
• TC-STAR 2007 Evaluation Package - End-to-End Spanish-to-English.

• TC-STAR 2006 Evaluation Package - ASR English.
• TC-STAR 2006 Evaluation Package - ASR Spanish - EPPS.
• TC-STAR 2006 Evaluation Package - ASR Spanish - CORTES.
• TC-STAR 2006 Evaluation Package - ASR Mandarin Chinese.
• TC-STAR 2006 Evaluation Package - SLT English-to-Spanish.
• TC-STAR 2006 Evaluation Package - SLT Spanish-to-English - EPPS.
• TC-STAR 2006 Evaluation Package - SLT Spanish-to-English - CORTES.
• TC-STAR 2006 Evaluation Package - SLT Chinese-to-English.
• TC-STAR 2006 Evaluation Package - End-to-End Spanish-to-English.

• TC-STAR 2005 Evaluation Package - ASR English.
• TC-STAR 2005 Evaluation Package - ASR Spanish.
• TC-STAR 2005 Evaluation Package - ASR Mandarin Chinese.
• TC-STAR 2005 Evaluation Package - SLT English-to-Spanish.
• TC-STAR 2005 Evaluation Package - SLT Spanish-to-English.
• TC-STAR 2005 Evaluation Package - SLT Chinese-to-English.

• The CHIL Evaluation Packages:

• CHIL 2006 evaluation package.
• CHIL 2005 evaluation package.
• CHIL 2004 evaluation package.

• The CLEF Test Suite for the CLEF 2000-2003 Campaigns - Evaluation Package