Consiglio Nazionale delle Ricerche

Tipo di prodottoContributo in atti di convegno
TitoloEvaluation of natural language tools for italian: EVALITA 2007
Anno di pubblicazione2008
Formato-
Autore/iMagnini B.; Cappelli A.; Tamburini F.; Bosco C.; Mazzei A.; Lombardo V.; Bertagna F.; Calzolari N.; Toral Ruiz A.; Bartalesi Lenzi V.; Sprugnoli R.; Speranza M.
Affiliazioni autoriCNR-ISTI, Pisa CNR-ILC, Pisa Univerity of Bologna, Italy University of Torino, Italy Center for the Evaluation of Language and Communication Technologies (CELCT), Trento Fondazione Bruno Kesler (FBK), Italia
Autori CNR e affiliazioni
  • FRANCESCA BERTAGNA
  • ANTONIO TORAL RUIZ
  • AMEDEO CAPPELLI
  • NICOLETTA ZAMORANI
Lingua/e
  • inglese
AbstractEVALITA 2007, the first edition of the initiative devoted to the evaluation of Natural Language Processing tools for Italian, provided a shared framework where participants' systems had the possibility to be evaluated on five different tasks, namely Part of Speech Tagging (organised by the University of Bologna), Parsing (organised by the University of Torino), Word Sense Disambiguation (organised by CNR-ILC, Pisa), Temporal Expression Recognition and Normalization (organised by CELCT, Trento), and Named Entity Recognition (organised by FBK, Trento). We believe that the diffusion of shared tasks and shared evaluation practices is a crucial step towards the development of resources and tools for Natural Language Processing. Experiences of this kind, in fact, are a valuable contribution to the validation of existing models and data, allowing for consistent comparisons among approaches and among representation schemes. The good response obtained by EVALITA, both in the number of participants and in the quality of results, showed that pursuing such goals is feasible not only for English, but also for other languages.
Lingua abstractinglese
Altro abstract-
Lingua altro abstract-
Pagine da2536
Pagine a2543
Pagine totali-
Rivista-
Numero volume della rivista-
Serie/Collana-
Titolo del volume-
Numero volume della serie/collana-
Curatore/i del volume-
ISBN-
DOI-
Editore-
Verificato da refereeSì: Internazionale
Stato della pubblicazionePublished version
Indicizzazione (in banche dati controllate)-
Parole chiaveNatural language evaluation, Standards for LRs, Evaluation methodologies, H.3 INFORMATION STORAGE AND RETRIEVAL. Linguistic processing
Link (URL, URI)-
Titolo convegno/congressoLREC 2008, Sixth International Conference on Language Resources and Evaluation
Luogo convegno/congressoMarrakech, Marocco
Data/e convegno/congresso26th May - 1st June 2008
RilevanzaInternazionale
RelazioneContributo
Titolo parallelo-
Note/Altre informazioni-
Strutture CNR
  • ILC — Istituto di linguistica computazionale "Antonio Zampolli"
  • ISTI — Istituto di scienza e tecnologie dell'informazione "Alessandro Faedo"
Moduli/Attività/Sottoprogetti CNR
  • IC.P02.005.001 : Risorse e Tecnologie Linguistiche: modelli, metodi di sviluppo, applicazioni, disegno di strategie internazionali
  • ICT.P08.009.003 : Knowledge Discovery and Data Mining
Progetti Europei-
Allegati

Dati storici
I dati storici non sono modificabili, sono stati ereditati da altri sistemi (es. Gestione Istituti, PUMA, ...) e hanno solo valore storico.
Area disciplinare
  • Information Technology & Communications Systems
  • Language & Linguistics
Area valutazione CIVR
  • Scienze dell'Antichità, filologico-letterarie e storico-artistiche
  • Scienze e tecnologie per una società dell'informazione e della comunicazione
NoteIn: LREC 2008 - Proceedings of LREC 2008 (Marrakech, 26th May - 1st June 2008). Proceedings, pp. 2536 - 2543. Nicoletta calzolari, Khalid Choukri, Bente Maegard (eds.). ELRA - European Language Resources Association, 2008. In: LREC - LREC 2008, Sixth International Conference on Language Resources and Evaluation (Palais des Congrès Masour Eddahbi, Marrakech, Maroc, 26 May - 1 June 2008). Proceedings, pp. 2536 - 2543. Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odjik, Stelios Piperidis, Daniel Tapias (eds.). European Language Resources Association (ELRA), 2008.
Descrizione sintetica del prodottoABSTRACT: EVALITA 2007, the first edition of the initiative devoted to the evaluation of Natural Language Processing tools for Italian, provided a shared framework where participants' systems had the possibility to be evaluated on five different tasks, namely Part of Speech Tagging (organised by the University of Bologna), Parsing (organised by the University of Torino), Word Sense Disambiguation (organised by CNR-ILC, Pisa), Temporal Expression Recognition and Normalization (organised by CELCT, Trento), and Named Entity Recognition (organised by FBK, Trento). We believe that the diffusion of shared tasks and shared evaluation practices is a crucial step towards the development of resources and tools for Natural Language Processing. Experiences of this kind, in fact, are a valuable contribution to the validation of existing models and data, allowing for consistent comparisons among approaches and among representation schemes. The good response obtained by EVALITA, both in the number of participants and in the quality of results, showed that pursuing such goals is feasible not only for English, but also for other languages.