UKP in Challenges

UKP has participated in a number of research challenges and competitions.  Please follow the links below for detailed descriptions of the tasks and our results.

Named Entity Recognition in German at KONVENS 2014

UKP participated in the shared task of GermEval at KONVENS 2014. In this task, systems were expected to automatically annotate nested named entities in German. For the shared task, a new dataset with sentences from German news articles and Wikipedia was created. Our system is based on state-of-the-art deep neural networks combined with specifically designed features. The system achieves an F1-measure of 75.1% and is  placed 2nd among 11 systems. You can read further details on the task and about our system.

Question Answering for University Entrance Exams at CLEF 2014

UKP participated in the university entrance exam task of the CLEF question answering track. In this task, systems were expected to automatically solve open-domain, multiple choice reading comprehension questions about short Englis narrative texts. Our system achieved the second best performance across all competing system in the challenge with a c@1 score of 0.375. More information about our system can be found here.

Sentiment Analysis in Twitter at SemEval 2014

UKP participated in the Sentiment Analysis in Twitter task for SemEval 2014, collocated with COLING conference on 23-24 August, 2014 in Dublin, Ireland. According to the official results,our system (ukp-dipf) achieved the 8th place on tweet level (subtask B) in terms of macro-averaged F-score among 50 systems. On the expression level (subtask A), our system ranked 14 out of 27 systems, based on macro-averaged F-score. For more details please refer to the dedicated page.

Uncovering Plagiarism, Authorship and Social Software Misuse 2013

UKP participated in the first edition of the Author Profiling Task in the PAN Lab at CLEF 2013. The author profiling task aims at revealing certain categorical information about the author, such as his/her age or gender, rather than reveal his/her exact identity. Our system placed 4th among 20 systems in Spanish and 15th among 22 systems in English in terms of accuracy. You can read further details on the task and about our system.

CrossLink2 at NTCIR-10

UKP participated in the  Cross-lingual Link Discovery Task (CrossLink-2) at the  10th NTCIR Workshop (NTCIR-10) held on 18-21 June 2013 at the National Center of Sciences in Tokyo, Japan. CrossLingual Link Discovery (CrossLink) is a task of discovering potential links between cross-lingual documents. At NTCIR-9, the UKP team developed a CrossLink framework consisting of anchor selection, anchor ranking, anchor translation, and target discovery subtasks for English-to-{Chinese, Japanese, Korean} directions. At NTCIR-10, the framework is further extended to work in the reverse direction ({Chinese, Japanese, Korean}-to-English), to find out the properties of the tasks in respect of resources, language pair, language direction as well as link discovery methods and evaluation approach. You can read further details about the task and about our system.

Uncovering Plagiarism, Authorship and Social Software Misuse 2012

In 2012, UKP participated in the Wikipedia Quality Flaw Prediction Task in the PAN Lab at CLEF 2012. According to the official results, our system placed first in terms of precision and second in terms of recall and F1-measure.  You can read further details on the task and about our system.

Helping Our Own 2012

In 2012 UKP participated in the Prepositions and Determiners Task of Helping Our Own, an ongoing shared task in text correction.  According to the official results, our system achieved modest performance in some of the nine tasks, placing as high as 9th among the 14 systems.  You can read further details on the task and our system.

SemEval-2012

UKP participated in the Semantic Textual Similarity Task for SemEval-2012, to be held at *SEM (the First Joint Conference on Lexical and Computational Semantics) on 7–8 June, 2012 in Montreal, Canada.  According to the official results, our system (baer/task6-UKP-run2_plus_postprocessing_smt_twsi) was ranked first in two evaluation measures, and second in the third evaluation measure.

NTCIR-9 (2011)

UKP participated in the Cross-lingual Link Discovery Task (CrossLink) at the 9th NTCIR Workshop (NTCIR-9) held on 6–9 December 2011 at the National Center of Sciences in Tokyo, Japan.  Our system came first in the English-to-Chinese and the English-to-Korean File-to-File with manual assessment and Anchor-to-File with Wikipedia ground truth assessment evaluations using Mean-Average-Precision (MAP) measure.  You can read further details about the task and about our system.

Helping Our Own 2011

In 2011 UKP participated in Helping Our Own, an ongoing shared task in text correction, whose pilot run took place as part of the 2011 Generation Challenges.  Our system achieved the best detection scores for 8 out of 13 error classes (among 6 participating systems). You can read further details about the task and our system.

NTCIR-7 (2008)

UKP participated in the Multilingual Opinion Analysis Task (MOAT) at the 7th NTCIR Workshop, held on 16–19 December 2008 in Tokyo, Japan.  Our system ranked 2nd out of 9 systems in the opinionated sentence classification subtask and 3rd out of 5 systems in the polarity classification subtask.  You can read further details on the competition and our system.

A A A | Drucken Print | Impressum Impressum | Sitemap Sitemap | Suche Search | Kontakt Contact |
zum Seitenanfangzum Seitenanfang