CLARIN-NL - application/msword

Ucto

root — Mon, 08 Apr 2019 08:38:55 +0000

https://raw.githubusercontent.com/LanguageMachines/ucto/master/logo.svg

Title

Ucto Tokeniser

Description

Ucto tokenizes text files: it separates words from punctuation, and splits sentences. This is one of the first tasks for almost any Natural Language Processing application. Ucto offers several other basic preprocessing steps such as changing case that you can all use to make your text suited for further processing such as indexing, part-of-speech tagging, or machine translation. The tokeniser engine is language independent. By supplying language-specific tokenisation rules in an external configuration file a tokeniser can be created for a specific language. Ucto comes with tokenization rules for English, Dutch, French, Italian, and Swedish; it is easily extendible to other languages. It recognizes dates, times, units, currencies, abbreviations. It recognizes paired quote spans, sentences, and paragraphs. It produces UTF8 encoding and NFC output normalization, optionally accepts other encodings as input. Optional conversion to all lowercase or uppercase. Ucto supports FoLiA XML.

Project

CLARIN-NL

CLARIAH-CORE

CLARIN National Project

CLARIN-NL

CLARIAH-CORE

CLARIN centre

none yet

Research domain

Linguistics

Linguistic Subject

general linguistics

Syntax

Tool task

sentence splitting

tokenisation

Country

Netherlands

Input Language

Dutch

Swedish

Russian

Spanish

Portuguese

English

German

French

Italian

Version

v0.13

Access Contact

Antal van den Bosch

Project Contact

/mailto:/

Creator Contact

Antal van den Bosch

Maarten van Gompel

Ko van der Sloot

Documentation

Maarten van Gompel, Ko van der Sloot and Antal van den Bosch. 2017. Ucto: Unicode Tokenizer. version 0.9.6. Reference Guide. Technical Report, Jan 23, 2017.

Maarten van Gompel, Ko van der Sloot, Antal van den Bosch (2012). Ucto: Unicode Tokeniser. Reference Guide. ILK Technical Report 12-05.

readme

releaseNotes

issueTracker

contIntegration

Source code

https://github.com/LanguageMachines/ucto

Resource

CMDI File Link

License

GNU GPL

Inventory Scope

local

Ucto Engine

root — Mon, 08 Apr 2019 08:38:55 +0000

https://raw.githubusercontent.com/LanguageMachines/ucto/master/logo.svg

Title

Ucto Tokeniser Engine

Description

The Ucto tokenisation engine is a language-independent engine that, given an external configuration file with tokenisation rules for a specifc language ,yields a tokenizer for that language that tokenizes text files: it separates words from punctuation, and splits sentences. This is one of the first tasks for almost any Natural Language Processing application. Ucto offers several other basic preprocessing steps such as changing case that you can all use to make your text suited for further processing such as indexing, part-of-speech tagging, or machine translation. The tokeniser engine is language independent. By supplying language-specific tokenisation rules in an external configuration file a tokeniser can be created for a specific language. Ucto comes with tokenization rules for English, Dutch, French, Italian, and Swedish; it is easily extensible to other languages. It recognizes dates, times, units, currencies, abbreviations. It recognizes paired quote spans, sentences, and paragraphs. It produces UTF8 encoding and NFC output normalization, optionally accepts other encodings as input. Optional conversion to all lowercase or uppercase. Ucto supports FoLiA XML.

Project

CLARIN-NL

CLARIAH-CORE

CLARIN National Project

CLARIN-NL

CLARIAH-CORE

CLARIN centre

none yet

Research domain

Linguistics

Linguistic Subject

general linguistics

Syntax

Tool task

sentence splitting

tokenisation

Country

Netherlands

Tool Type

local desktop

Research Phase

Enriching Data

Tool status

published

Input format

application/pdf

application/msword

text/folia+xml

text/plain

Output format

text/plain

Input Language

Language independent

Version

v0.13

Access Contact

Antal van den Bosch

Project Contact

/mailto:/

Creator Contact

Antal van den Bosch

Maarten van Gompel

Ko van der Sloot

Documentation

Maarten van Gompel, Ko van der Sloot and Antal van den Bosch. 2017. Ucto: Unicode Tokenizer. version 0.9.6. Reference Guide. Technical Report, Jan 23, 2017.

Maarten van Gompel, Ko van der Sloot, Antal van den Bosch (2012). Ucto: Unicode Tokeniser. Reference Guide. ILK Technical Report 12-05.

readme

releaseNotes

issueTracker

contIntegration

Source code

https://github.com/LanguageMachines/ucto

Resource

CMDI File Link

License

GNU GPL

Inventory Scope

local

Frog

root — Mon, 08 Apr 2019 08:38:48 +0000

http://dev.clarin.nl/sites/default/files/froglogo.svg

Title

Frog: An advanced Natural Language Processing Suite for Dutch (Web Service and Application)

Description

Frog is an integration of memory-based natural language processing (NLP) modules developed for Dutch. It performs automatic linguistic enrichment such as part of speech tagging, lemmatisation, named entity recognition, shallow parsing, dependency parsing and morphological analysis. All NLP modules are based on TiMBL.

Project

CGN

CLARIN-NL

CLARIAH-CORE

CLARIN National Project

CLARIN-NL

CLARIAH-CORE

CLARIN centre

none yet

Research domain

Linguistics

Linguistic Subject

general linguistics

Syntax

Tool task

dependency parsing

shallow parsing

lemmatisation

morphological analysis

named entity recognition

part of speech tagging

sentence splitting

tokenisation

Country

Netherlands

Tool Type

web application

Research Phase

Enriching Data

Tool status

published

Input format

application/pdf

application/msword

text/folia+xml

text/plain

Output format

text/csv

Input Language

Dutch

Version

v0.15

Access Contact

Antal van den Bosch

Project Contact

/mailto:/

Creator Contact

Antal van den Bosch

Maarten van Gompel

Ko van der Sloot

Bertjan Busser

Iris Hendrickx

Sander Canisius

Jakub Zavrel

Documentation

Iris Hendrickx, Antal van den Bosch, Maarten van Gompel, Ko van der Sloot, Walter Daelemans. 2016.Frog: An Natural Language Processing suite for Dutch. CLST Technical Report 16-02.

Webservice Specification

readme

releaseNotes

issueTracker

contIntegration

Source code

https://github.com/LanguageMachines/frog

Publications

Iris Hendrickx, Antal van den Bosch, Maarten van Gompel, Ko van der Sloot and Walter Daelemans. 2016.Frog: A Natural Language Processing Suite for Dutch. CLST Technical Report 16-02, pp 99-114. Nijmegen, the Netherlands. https://github.com/LanguageMachines/frog/blob/master/docs/frogmanual.pdf

Van den Bosch, A., Busser, G.J., Daelemans, W., and Canisius, S. (2007). An efficient memory-based morphosyntactic tagger and parser for Dutch, In F. van Eynde, P. Dirix, I. Schuurman, and V. Vandeghinste (Eds.), Selected Papers of the 17th Computational Linguistics in the Netherlands Meeting, Leuven, Belgium, pp. 99-114. http://ilk.uvt.nl/downloads/pub/papers/tadpole-final.pdf

Resource

CMDI File Link

License

GNU GPL

Inventory Scope

local

OpenConvert

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

OpenConvert

Description

The OpenConvert tools convert to TEI or FOLiA from a number of input formats (alto, text, word, HTML, ePub). The tools are available as a Java command line tool, a web service and a web application.The OpenConvert Tools were created by IVDNT in the OpenConvert project. The OpenConvert tools convert to TEI or FOLiA from a number of input formats (alto, text, word, HTML, ePub). The tools are available as a Java command line tool, a web service and a web application. Furthermore, as a proof of concept, the website currently provides two annotation tools: a simple Tokenizer for TEI files and a modern Dutch part of speech tagger.

Project

OpenConvert

CLARIN National Project

CLARIN-NL

CLARIAH-CORE

CLARIN centre

Dutch Language Institute

Research domain

Linguistics

Religion Studies

Communication and Media Studies

Cultural Sciences

History

Literary Studies

Philosophy

Political Studies

Tool task

corpus processing

format conversion

text conversion

tokenisation

part of speech tagging

Country

Netherlands

Tool Type

local desktop

Research Phase

Enriching Data

Tool status

released

Input format

text/plain

application/msword

text/html

text/xml

application/epub+zip

application/zip

Output format

text/xml

Input Language

Language independent

Access Contact

/mailto:servicedesk@ivdnt.org/

Institute for the Dutch Language

Project Contact

Jan Theo Bakker

Institute for the Dutch Language

Creator Contact

Jan Theo Bakker

Institute for the Dutch Language

Documentation

OpenConvert help

Source code

https://github.com/INL/OpenConvert

Original source

http://portal.clarin.nl/node/4224

Resource

CMDI File Link

License

other

Inventory Scope

local

Namescape Named Entity Recognition

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

Namescape Named Entity Recognition

Description

Searching and visualizing Named Entities in modern Dutch novels. The named entity (NE) tagging and resolution in NameScape enables quantitative and repeatable research where previously only guesswork and anecdotal evidence was feasible. The visualisation module enables researchers with a less technical background to draw conclusions about functions of names in literary work and help them to explore the material in search of more interesting questions (and answers). Users from other communities (sociolinguistics, sentiment analysis, …) also benefit from the NE tagged data, especially since the NE recognizer is available as a web service, enabling researchers to annotate their own research data. Datasets in NameScape (total of 1.129 books): Corpus Sanders: A corpus of 582 Dutch novels written and published between 1970 and 2009 will. Corpus Huygens: Consists of 22 novels manually tagged with detailed named entity information. IPR for this corpus do not allow distribution. Corpus eBooks: Consists of 7000+ Dutch eBooks tagged automatically with basic NER features and person name Part information. IPR for this corpus do not allow distribution. Corpus SoNaR Books: 105 Dutch books; NE tagged. Corpus Gutenberg Dutch: Consists of 530 NE tagged TEI files converted from the Epub versions of the corresponding Gutenberg documents. Recent research has conclusively proven names in literary works can only be put fully into perspective when studied in a wider context (landscape) of names either in the same text or in related material (the onymic landscape or “namescape”). Research on large corpora is needed to gain a better understanding of e.g. what is characteristic for a certain period, genre, author or cultural region. The data necessary for research on this scale simply does not exist yet. NameScape aims to fill the need by providing a substantial amount of literary works annotated with a rich tag set, thereby enabling researchers to perform their research in more depth than previously possible. Several exploratory visualization tools help the scholar to answer old questions and uncover many more new ones, which can be addressed using the demonstrator.

Project

Namescape

CLARIN National Project

CLARIN-NL

CLARIN centre

Huygens ING

Research domain

Linguistics

Literary Studies

Linguistic Subject

Computational Linguistics

Tool task

named entity recognition

corpus searching

Country

Netherlands

Tool Type

web application

Research Phase

Enriching Data

Tool status

published

Input format

text/html

application/msword

application/epub+zip

text/xml

Output format

text/xml

Input Language

Dutch

Access Contact

/mailto:servicedesk@ivdnt.org/

Institute for the Dutch Language

Project Contact

dr. Karina van Dalen-Oskam

Creator Contact

dr. Karina van Dalen-Oskam

Maarten Marx

Isaac Sijaranamual

Jesse de Does

Katrien Depuydt

Boukje Verheij

Institute for the Dutch Language

Instituut voor de Nederlandse Taal

Institute for the Dutch Language

Documentation

user documentation

Demonstration Scenario

Source code

not specified

Original source

http://portal.clarin.nl/node/1940

Publications

de Does, J, Depuydt, K, van Dalen-Oskam, K and Marx, M. 2017. Namescape: Named Entity Recognition from a Literary Perspective. In: Odijk, J and van Hessen, A. (eds.) CLARIN in the Low Countries, Pp. 361–370. London: Ubiquity Press. DOI: https://doi.org/10.5334/bbi.30. License: CC-BY 4.0

Karina van Dalen-Oskam (2013), Nordic Noir: a background check on Inspector Van Veeteren, 31 May 2012, http://blog.namescape.nl/?p=47

Resource

SearchPage

CMDI File Link

License

unknown

Inventory Scope

local