HLT Evaluation Portal

Evaluation Matrix - Projects

elda — 2011-03-24T11:27:31Z

#INCLURE (display_matrix_projects.php3) - Evaluation Matrix / popup, matrix

Evaluation Matrix

elda — 2010-01-13T10:43:00Z

In this section, evaluation projects and campaigns can be browsed, functions of the language or direction used and the technology adopted. Each number of the matrix is clickable, so as to give information about the different projects.
Three main types of technologies are distinguished hereafter, presented below.
Multilingual Technologies
#INCLURE (matrix_multi_technos.php3)
Monolingual Text Technologies
#INCLURE (matrix_mono_text_technos.php3)
Speech & Multimodal Technologies
#INCLURE (…) - Projects & Campaigns / Evaluation Matrix, Projects, Campaigns

Contact us

elda — 2009-12-03T14:20:46Z

For further information about evaluation services or if you would like to comment or add an event or evaluation campaign, please contact us
You can also visit our web site ELRA. - About / ELRA

About the HLT Evaluation Portal

elda — 2009-12-03T14:16:38Z

Initiated by ELRA, the HLT Evaluation portal is designed to be an online information resource about HLT evaluation and related topics of interest to the HLT community at large.
The portal endeavours to support the development of HLT evaluation within Europe by making available evaluation packages and resources for a wide range of human language technologies, and in as many languages as possible.
www.hlt-evaluation.org also aims to offer evaluation management services to third parties (…) - About / ouvert_rubrique, Evaluation, ELRA

Project list

elda — 2009-12-03T11:20:20Z

Multimodal processing technologies
Projects that focused on audio, visual, biometric processing evaluation.
Multimodal interface
TRECVID Automatic Segmentation, Indexing, and Content-based Retrieval of Digital Video, originated by TREC
CHORUS FP6 Coordination Action on Multimedia Content Search Engines
AMI Augmented Multi-party Interaction targets computer enhanced multi-modal interaction in the context of meetings
CHIL Computers in the Human Interaction Loop
IM2 Interactive (…) - Projects & Campaigns / Projects, Campaigns

Players

elda — 2009-12-03T11:20:17Z

Academic institutions, research centres and funding organisations active in the field of Human Language Technologies evaluation.
In this section, we presents links to centres or institutions of which the main activity is monitoring the implementation of both European and international HLT evaluation initiatives, as well as organizations and institutions which are involved in different HLT evaluation activities.
BAS
BAS is the Bavarian Archive for Speech Signals.
CELCT Center for the (…) - Links / Players

Services by Technology

elda — 2009-12-03T11:20:10Z
What we can evaluate ?
ELRA carries out evaluation activities for the following technologies :
ELRA can produce detailed evaluation requirements both for evaluation campaigns and for adequacy based context oriented evaluation.
According to the different technologies, ELRA produces detailed evaluation requirements for competitive campaign and individual system evaluation and builds specifications to carry out the evaluation.
ELRA can develop test materials according to specifications (…) - Evaluation Services / Evaluation, Services, ELRA

Parsing

elda — 2009-12-02T19:43:40Z
Parsing is the process of structuring a linear representation in accordance with a given grammar (Grune and Jacobs, 1990).
The basic idea of parsing evaluation consists in measuring the similarity between the parser-generated tree-structure (also called labelled bracketings) and the manually constructed tree-structure.
Adequacy evaluation involves determining the fitness of a parsing system for a particular task. Efficiency evaluation is to compare the parse time of a given parser on (…) - Technologies / Parsing

Multilingual Text Alignment

elda — 2009-12-02T19:43:39Z
Multilingual texts alignment consists in identifying correspondences between different text units, e.g., words, sentences, paragraphs, etc. in parallel texts.
The main approach of alignment evaluation is to compare a system-computed alignment with a manually produced reference alignment, usually called a gold standard. Different tasks have been defined in previous evaluation exercises such as Blinker, ARCADE, HLT-NAACL and ACL.
Alignment evaluations were generally performed by (…) - Technologies / Multilingual Text Alignment

Multimodal Technologies

elda — 2009-12-02T19:43:37Z
Multimodal technologies refer to all technologies combining features extracted from different modalities (text, audio, image, etc.). This covers a wide range of component technologies:
Audiovisual Speech Recognition.
Audiovisual Person Identification.
Audiovisual Event Detection.
Audiovisual Object or Person Tracking.
Biometric Identification (using face, voice fingerprints, iris, etc.).
Head Pose Estimation.
Gesture Recognition.
Multimodal Information Retrieval (e.g. Video (…) - Technologies / Multimodal Technologies