Darmstadt Knowledge Processing Repository

At the UKP Lab, we put a strong focus on developing the software that is the basis for our experiments in a re-usable manner. We call that body of software that we produce the Darmstadt Knowledge Processing Software Repository (DKPro). 

Products

Several products have grown from our DKPro philosophy and have been released under an open source license to the public:

  • CSniper is a search-based annotation tool to help distributed annotation teams finding infrequent linguistic phenomena in large corpora.
  • DKPro Core provides a set of ready to use software components for natural language processing, based on the Apache UIMA framework.
  • DKPro Lab is a lightweight framework for parameter sweeping experiments. It allows you to set up experiments consisting of multiple interdependent tasks in a declarative manner with minimal overhead.
  • DKPro LSR (Lexical Semantic Resources) is a unified API for several lexical-semantic resources.
  • DKPro Similarity is an open source software package for developing text similarity algorithms.
  • DKPro Spelling includes components for real-word spelling error correction and experimental frameworks for mining such errors from the Wikipedia revision history as well as for the "Helping Our Own" shared tasks 2011 and 2012.
  • DKPro Statistics is a collection of open-licensed statistical tools, currently including correlation and inter-rater agreement methods.
  • DKPro TC (Text Classification) is a UIMA-based text classification framework built on top of DKPro Core, DKPro Lab and the Weka Machine Learning Toolkit. It is intended to alleviate supervised machine learning experiments with any kind of textual data.
  • DKPro Uby is a Java framework for creating and accessing sense-linked lexical resources in accordance with the UBY-LMF lexicon model, an instantiation of the ISO standard Lexicon Markup Framework (LMF).
  • DKPro WSD is a modular, extensible Java framework for word sense disambiguation.
  • JOWKL (Java OmegaWiki Library) is an open-source, Java-based application programming interface that allows to access all information contained in OmegaWiki, such as glosses, usage examples, translations and much more.
  • JWKTL (Java Wiktionary Library) is a free, Java-based application programming interface that allows to access the information contained in Wiktionary.
  • JWPL (Java Wikipedia Library) is a free, Java-based application programming interface that allows to access all information contained in Wikipedia.
  • WebAnno is a general purpose web-based annotation tool for a wide range of linguistic annotations.

Team

The principal investigator is Prof. Dr. Iryna Gurevych.

Richard Eckart de Castilho is currently the technical lead.

DKPro is a shared project of all UKP to which all group members contribute.

Teaching

We use DKPro products in our courses:

Awards

The UKP group received two IBM's 2008 Unstructured Information Analytics (UIA) Awards for their DKPro proposals! The award was covered in the 30 June 2008 issue of the Darmstädter Echo.

Publications

Counting What Counts: Decompounding for Keyphrase Extraction

Author Nicolai Erbs, Pedro Bispo Santos, Torsten Zesch, Iryna Gurevych
Date July 2015
Kind Inproceedings
PublisherAssociation for Computational Linguistics
AddressBeijing, China
Book titleProceedings of the ACL 2015 Workshop on Novel Computational Approaches to Keyphrase Extraction
Pages10-17
LocationBeijing, China
ISBN978-1-941643-62-4
KeyTUD-CS-2015-0127
Research Areas Ubiquitous Knowledge Processing, UKP_p_WIKULU, UKP_p_DKPro, UKP_a_NLP4Wikis, UKP_reviewed, UKP_s_DKPro_Core
Abstract A core assumption of keyphrase extraction is that a concept is more important if it is mentioned more often in a document. Especially in languages like German that form large noun compounds, frequency counts might be misleading as concepts “hidden” in compounds are not counted. We hypothesize that using decompounding before counting term frequencies may lead to better keyphrase extraction. We identified two effects of decompounding: (i) enhanced frequency counts, and (ii) more keyphrase candidates. We created two German evaluation datasets to test our hypothesis and analyzed the effect of additional decompounding for keyphrase extraction.
Website
Full paper (pdf)
[Export this entry to BibTeX]

Important Copyright Notice:

The documents contained in these directories are included by the contributing authors as a means to ensure timely dissemination of scholarly and technical work on a non-commercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.
A A A | Drucken Print | Impressum Impressum | Sitemap Sitemap | Suche Search | Kontakt Contact | Webseitenanalyse: Mehr Informationen
zum Seitenanfangzum Seitenanfang