CLARIN-NL - CLARIN-NL

Orthography

Tool task

corpus processing

orthographic normalisation

Country

Netherlands

Tool Type

web application

Research Phase

Enriching Data

Tool status

published

Input format

image/tiff

image/vnd.djvu

application/pdf

text/plain

text/xml

text/csv

Output format

text/xml

Input Language

Dutch

English

Finnish

French

German

German (Fraktur)

Classical Greek

Modern Greek

Icelandic

Italian

Latin

Polish

Portuguese

Russian

Spanish

Swedish

Access Contact

Institute for the Dutch Language

Project Contact

dr. Martin Reynaert

Creator Contact

Dr. Arianna Betti

Documentation

Usage

Source code

not specified

Original source

http://portal.clarin.nl/node/4190

Publications

Betti, A, Reynaert, M and van den Berg, H. 2017. @PhilosTEI: Building Corpora for Philosophers. In: Odijk, J and van Hessen, A. (eds.) CLARIN in the Low Countries, Pp. 379–392. London: Ubiquity Press. DOI: https://doi.org/10.5334/bbi.32. License: CC-BY 4.0

Resource

CMDI File Link

License

unknown

Inventory Scope

local

Ucto

root — Mon, 08 Apr 2019 08:38:55 +0000

https://raw.githubusercontent.com/LanguageMachines/ucto/master/logo.svg

Title

Ucto Tokeniser

Description

Ucto tokenizes text files: it separates words from punctuation, and splits sentences. This is one of the first tasks for almost any Natural Language Processing application. Ucto offers several other basic preprocessing steps such as changing case that you can all use to make your text suited for further processing such as indexing, part-of-speech tagging, or machine translation. The tokeniser engine is language independent. By supplying language-specific tokenisation rules in an external configuration file a tokeniser can be created for a specific language. Ucto comes with tokenization rules for English, Dutch, French, Italian, and Swedish; it is easily extendible to other languages. It recognizes dates, times, units, currencies, abbreviations. It recognizes paired quote spans, sentences, and paragraphs. It produces UTF8 encoding and NFC output normalization, optionally accepts other encodings as input. Optional conversion to all lowercase or uppercase. Ucto supports FoLiA XML.

Project

CLARIN-NL

CLARIAH-CORE

CLARIN National Project

CLARIN-NL

CLARIAH-CORE

CLARIN centre

none yet

Research domain

Linguistics

Linguistic Subject

Syntax

Tool task

sentence splitting

tokenisation

Country

Netherlands

Tool Type

local desktop

Research Phase

Enriching Data

Tool status

published

Input format

application/pdf

application/msword

text/folia+xml

text/plain

Output format

text/plain

Input Language

Dutch

Swedish

Russian

Spanish

Portuguese

English

German

French

Italian

Version

v0.13

Access Contact

Project Contact

/mailto:/

Creator Contact

Maarten van Gompel, Ko van der Sloot and Antal van den Bosch. 2017. Ucto: Unicode Tokenizer. version 0.9.6. Reference Guide. Technical Report, Jan 23, 2017.

Ko van der Sloot

Documentation

Maarten van Gompel, Ko van der Sloot, Antal van den Bosch (2012). Ucto: Unicode Tokeniser. Reference Guide. ILK Technical Report 12-05.

readme

releaseNotes

issueTracker

contIntegration

Source code

https://github.com/LanguageMachines/ucto

Resource

CMDI File Link

License

GNU GPL

Inventory Scope

local

Ucto Engine

root — Mon, 08 Apr 2019 08:38:55 +0000

https://raw.githubusercontent.com/LanguageMachines/ucto/master/logo.svg

Title

Ucto Tokeniser Engine

Description

The Ucto tokenisation engine is a language-independent engine that, given an external configuration file with tokenisation rules for a specifc language ,yields a tokenizer for that language that tokenizes text files: it separates words from punctuation, and splits sentences. This is one of the first tasks for almost any Natural Language Processing application. Ucto offers several other basic preprocessing steps such as changing case that you can all use to make your text suited for further processing such as indexing, part-of-speech tagging, or machine translation. The tokeniser engine is language independent. By supplying language-specific tokenisation rules in an external configuration file a tokeniser can be created for a specific language. Ucto comes with tokenization rules for English, Dutch, French, Italian, and Swedish; it is easily extensible to other languages. It recognizes dates, times, units, currencies, abbreviations. It recognizes paired quote spans, sentences, and paragraphs. It produces UTF8 encoding and NFC output normalization, optionally accepts other encodings as input. Optional conversion to all lowercase or uppercase. Ucto supports FoLiA XML.

Project

CLARIN-NL

CLARIAH-CORE

CLARIN National Project

CLARIN-NL

CLARIAH-CORE

CLARIN centre

none yet

Research domain

Linguistics

Linguistic Subject

Syntax

Tool task

sentence splitting

tokenisation

Country

Netherlands

Tool Type

local desktop

Research Phase

Enriching Data

Tool status

published

Input format

application/pdf

application/msword

text/folia+xml

text/plain

Output format

text/plain

Input Language

Language independent

Version

v0.13

Access Contact

Project Contact

/mailto:/

Creator Contact

Maarten van Gompel, Ko van der Sloot and Antal van den Bosch. 2017. Ucto: Unicode Tokenizer. version 0.9.6. Reference Guide. Technical Report, Jan 23, 2017.

Ko van der Sloot

Documentation

Maarten van Gompel, Ko van der Sloot, Antal van den Bosch (2012). Ucto: Unicode Tokeniser. Reference Guide. ILK Technical Report 12-05.

readme

releaseNotes

issueTracker

contIntegration

Source code

https://github.com/LanguageMachines/ucto

Resource

CMDI File Link

License

GNU GPL

Inventory Scope

local

PICCL

root — Mon, 08 Apr 2019 08:38:55 +0000

Title

PICCL: Philosophical Integrator of Computational and Corpus Libraries

Description

PICCL is a set of workflows for corpus building through OCR, post-correction, modernization of historic language and Natural Language Processing. It combines Tesseract Optical Character Recognition, TICCL functionality and Frog functionality in a single pipeline. Tesseract offers Open Source software for optical character recognition. TICCL (Text Induced Corpus Clean-up) is a system that is designed to search a corpus for all existing variants of (potentially) all words occurring in the corpus. This corpus can be one text, or several, in one or more directories, located on one or more machines. TICCL creates word frequency lists, listing for each word type how often the word occurs in the corpus. These frequencies of the normalized word forms are the sum of the frequencies of the actual word forms found in the corpus. TICCL is a system that is intended to detect and correct typographical errors (misprints) and OCR errors (optical character recognition) in texts. When books or other texts are scanned from paper by a machine, that then turns these scans, i.e. images, into digital text files, errors occur. For instance, the letter combination `in' can be read as `m', and so the word `regeering' is incorrectly reproduced as `regeermg'. TICCL can be used to detect these errors and to suggest a correct form. Frog enriches textual documents with various linguistic annotations.

Project

CLARIN-NL

CLARIAH-CORE

Nederlab

CLARIN National Project

CLARIN-NL

CLARIAH-CORE

CLARIN centre

none yet

Research domain

Linguistics

Philosophy

Literary Studies

Religion Studies

History

Linguistic Subject

Orthography

Morphology

Syntax

Tool task

optical character recognition

orthographic normalisation

sentence splitting

tokenisation

dependency parsing

shallow parsing

lemmatisation

morphological analysis

named entity recognition

part of speech tagging

Country

Netherlands

Tool Type

local desktop

Research Phase

Enriching Data

Tool status

published

Input format

application/pdf

image/tiff

text/plain

text/folia+xml

image/vnd.djvu

Output format

text/folia+xml

Input Language

Dutch

Swedish

Russian

Spanish

Portuguese

English

German

French

Italian

Finnish

Modern Greek

Classical Greek

Icelandic

German (Fraktur)

Latin

Romanian

Version

v0.6.4

Access Contact

Martin Reynaert

Project Contact

/mailto:/

Creator Contact

Martin Reynaert

Ko van der Sloot

Documentation

Information Page

readme

releaseNotes

issueTracker

contIntegration

Source code

https://github.com/LanguageMachines/piccl

Publications

Martin Reynaert, Maarten van Gompel, Ko van der Sloot and Antal van den Bosch. 2015. PICCL: Philosophical Integrator of Computational and Corpus Libraries. Proceedings of CLARIN Annual Conference 2015, pp. 75-79. Wrocław, Poland. http://www.nederlab.nl/cms/wp-content/uploads/2015/10/Reynaert_PICCL-Philosophical-Integrator-of-Computational-and-Corpus-Libraries.pdf

Resource

LandingPage

CMDI File Link

License

GNU GPL

Inventory Scope

local

FLAT

root — Mon, 08 Apr 2019 08:38:55 +0000

https://github.com/proycon/flat/blob/master/flat/style/logo.svg

Title

FLAT: FoLiA-Linguistic-Annotation-Tool

Description

FLAT is a web-based linguistic annotation environment based around the FoLiA format (http://proycon.github.io/folia), a rich XML-based format for linguistic annotation. FLAT allows users to view annotated FoLiA documents and enrich these documents with new annotations, a wide variety of linguistic annotation types is supported through the FoLiA paradigm. It is a document-centric tool that fully preserves and visualises document structure. Features Web-based, multi-user environment Server-side document storage, divided into 'namespaces', by default each user has his own namespace. Active documents are held in memory server-side. Read and write permissions to access namespaces are fully configurable. Concurrency (multiple users may edit the same document similtaneously) Full versioning control for documents (using git), allowing limitless undo operations. (in foliadocserve) Full annotator information, with timestamps, is stored in the FoLiA XML and can be displayed by the interface. The git log also contains verbose information on annotations. Annotators can indicate their confidence for each annotation Highly configurable interface; interface options may be disabled on a per-configuration basis. Multiple configurations can be deployed on a single installation Displays and retains document structure (divisions, paragraphs, sentence, lists, etc) Support for corrections, of text or linguistic annotations, and alternative annotations. Corrections are never mere substitutes, originals are always preserved! Spelling corrections for runons, splits, insertions and deletions are supported. Supports FoLiA Set Definitions to display label sets. Sets are not predefined in FoLiA and anybody can create their own. Supports Token Annotation and Span Annotation Supports complex span annotations such as dependency relations, syntactic units (constituents), predicates and semantic roles, sentiments, stratements/attribution, observations Simple metadata editor for editing/adding arbitrary metadata to a document. Selected metadata fields can be shown in the document index as well. User permission model featuring groups, group namespaces, and assignable permissions File/document management functions (copying, moving, deleting) Allows converter extensions to convert from other formats to FoLiA on upload In-document search (CQL or FQL), advanced searches can be predefined by administrators Morphosyntactic tree visualisation (constituency parses and morphemes) Higher-order annotation: associate features, comments, descriptions with any linguistic annotation

Project

CLARIN-NL

CLARIAH-CORE

CLARIN National Project

CLARIN-NL

CLARIAH-CORE

CLARIN centre

none yet

Research domain

Linguistics

Linguistic Subject

Syntax

Morphology

Morpho-syntax

Orthography

Tool task

annotation

editing

Country

Netherlands

Tool Type

web application

Research Phase

Enriching Data

Tool status

published

Input format

text/folia+xml

Output format

text/folia+xml

Input Language

Language independent

Version

v0.7.12

Access Contact

Project Contact

Jan Odijk

Creator Contact

Documentation

Installation Guide

Administration Guide

User Guide

FLAT Demonstration Video

Release Notes

Issue Tracker

Source code

https://github.com/proycon/flat

Resource

CMDI File Link

License

GNU GPL

Inventory Scope

local

WNT

root — Mon, 08 Apr 2019 08:38:55 +0000

Title

Dictionary of the Dutch Language

Description

Het Woordenboek der Nederlandsche Taal beschrijft de betekenis en geschiedenis van honderdduizenden woorden uit het geschreven Nederlands van 1500 tot 1976.

Project

GTB

CLARIN National Project

CLARIN-NL

CLARIN centre

Dutch Language Institute

Research domain

Linguistics

Linguistic Subject

Language Documentation

Lexicology

Tool task

dictionary searching

other

Country

Netherlands

Tool Type

web application

Research Phase

Tool status

published

Input Language

Dutch

Version

1.5

Access Contact

Institute for the Dutch Language

Project Contact

Institute for the Dutch Language

Creator Contact

Lic. Katrien Depuydt

Institute for the Dutch Language

Documentation

Frequently Asked Questions

Source code

not specified

Resource

SearchPage

LandingPage

CMDI File Link

License

unknown

Inventory Scope

local

WIP

root — Mon, 08 Apr 2019 08:38:55 +0000

Title

WIP: War in Parliament

Description

An advanced search engine for the OCR-ed scanned image collection of proceedings of the Dutch Hansard (Handelingen der Staten-Generaal 1930-1995). These proceedings are available as a fully annotated semi-structures dataset for historical and social science research. The output of the search engine can be restricted by speaker name, party, date range, and other criteria. References to the Second World War (WW II) have shaped political debate in the Netherlands for many decades. However, we have no systematic knowledge of why, how often, when, by whom or from which political party, and in which context, these references were made. Nor do we know the meanings politicians ascribed to the war years, the lessons the war was supposed to teach, and how all of this influenced political decision-making. WIP helps answering these questions and will help us better understand the complex legacies of WW II. The WIP project bridges the gap between historical and social science practices and the possibilities offered by using large corpora and language resources, in particular Clarin tools for Dutch. The dataset - de Handelingen der Staten-Generaal (Dutch Hansard) - are made compliant with Clarin, ISOCAT and ISO/TC 37/SC 4 standards. The search engine for this dataset uses an intuitive and powerful query language based on XPath, and its output can be fed directly into further analysis programs like SPSS. Integrating this technology with important historical research questions will directly contribute to new and innovative ways of writing about history. The search engine results can be exported in a CSV-format (comma seperated values). This makes it easy to calculate statistics offline from a result set and apply further filters.

Project

ExPoSe

DiLiPaD

CLARIN National Project

CLARIN-NL

CLARIN centre

DANS

Research domain

Political Studies

History

Communication and Media Studies

Tool task

corpus searching

Country

Netherlands

Tool Type

web application

Research Phase

Data analysis

Tool status

published

Output format

text/plain

Input Language

Dutch

Access Contact

/mailto:maartenmarx@uva.nl/

Project Contact

/mailto:maartenmarx@uva.nl/

University of Amsterdam

Creator Contact

Dr. Hinke Piersma

Documentation

Zoeken in de Handelingen: help

Movie

Demonstration Scenario

Source code

not specified

Original source

http://portal.clarin.nl/node/1923

Publications

Marx, M. (2011), Oorlog in de Kamer, NRC, March 3, 2011

‘Waarom politici graag over de oorlog praten’, NRC-Handelsblad, 25 februari 2011

‘Zoekmachine vindt relevante WO2-verwijzingen in Handelingen der Staten Generaal. Dat doet denken aan de oorlog’, in: E-data & research, Jaargang 6, nummer 2, oktober 2011 http://www.edata.nl/0602_011011/pdf/0602_011011_1.pdf

‘NIOD ontwikkelt zoekmachine die verwijzingen naar de oorlog opspoort’, in: Informatie Professional. Vakblad voor informatiewerkers, nr. 11 (2011)

L. Buitinck en M. Marx (2012), ‘Two-stage named entity recognition using averaged perceptrons’, in: Proc. NLDB 2012, pp. 171-176

Resource

SearchPage

CMDI File Link

License

unknown

Inventory Scope

local

WFT-GTB

root — Mon, 08 Apr 2019 08:38:55 +0000

Title

WFT-GTB: Integrating the Wurdboek fan ˈe Fryske Taal into the Geïntegreerde TaalBank

Description

The Dictionary of the Frisian Language (Wurdboek fan de Fryske Taal) is online available via the GTB dictionary web application. The GTB also holds other major Dutch historical dictionaries, such as the Dictionary of Old Dutch (ONW), the Dictionary of early Middle Dutch (VMNW), the Dictionary of Middle Dutch (MNW), and the Dictionary of the Dutch language (WNT). The digital surrounding enables extensive forms of free and structured search queries, including comparative studies with Dutch materials. The Wurdboek fan de Fryske Taal (Dictionary of the Frisian Language)-project includes the vocabulary of Modern West Frisian from the period 1800-1975. The dictionary’s metalanguage is Dutch. A volume of 400 pages comes out every year, the first one in 1984. The editorial phase was finalized in 2009, the final editing and publication phase in 2010.

Project

WFT-GTB

CLARIN National Project

CLARIN-NL

CLARIN centre

Dutch Language Institute

Research domain

Linguistics

Linguistic Subject

Language Documentation

Lexicology

Tool task

dictionary searching

other

Country

Netherlands

Tool Type

web application

Research Phase

Tool status

published

Output format

text/html

Input Language

Frisian

Dutch

Version

1.5

Access Contact

Institute for the Dutch Language

Project Contact

Institute for the Dutch Language

Creator Contact

drs. Hindrik Sijens

Lic. Katrien Depuydt

Institute for the Dutch Language

Documentation

Frequently Asked Questions

Source code

not specified

Original source

http://portal.clarin.nl/node/1919

Publications

Depuydt, K, de Does, J, Duijff, P and Sijens, H. 2017. Making the Dictionary of the Frisian Language Available in the Dutch Historical Dictionary Portal. In: Odijk, J and van Hessen, A. (eds.) CLARIN in the Low Countries, Pp. 151–165. London: Ubiquity Press. DOI: https://doi.org/10.5334/bbi.13. License: CC-BY 4.0

Resource

SearchPage

LandingPage

CMDI File Link

License

unknown

Inventory Scope

local

WAHSP/BILAND

root — Mon, 08 Apr 2019 08:38:55 +0000

Title

WAHSP/BILAND: web application for (bilingual) historical sentiment mining in public media

Description

WAHSP/BILAND is a research tool for historians that uses textual data of news media from the period 1863-1940 of the Koninklijke Bibliotheek and Staatsbibliothek zu Berlin as input material. One can search with single query terms or with combinations thereof. Apart from showing the articles that match the query, the results can be visualized by word clouds of single articles together with sentiment words highlighted, or by a word cloud of the whole result set together with newspaper statistics derived from their metadata. WAHSP/BILAND enables historians to collect and process large bi-lingual (Dutch and German) sets of opinionated text-data from news media and extract discourse identity and intensity patterns in two different countries with different scripts (e.g. Latin and Gothic). This tool offers a unique opportunity for non-technical humanities researchers to perform a new kind of historical e-research for studying changing opinions, notions and perceptions regarding public health and policy issues. The text mining tools for opinion/sentiment extraction that form the technological base for WAHSP/BILAND have been developed within the NTU/STEVIN DuOMAn project. The technology includes algorithms and tools for identification of polarity (positive/support or negative/criticism), sources (opinion-holders), frequency of items and specific targets of discourses. The tools and subjectivity lexicons are implemented as modules of ‘Fietstas’ 2, an web service for text analysis. Fietstas also provides other essential text processing modules (morphological normalization, format and encoding reconciliation, named entity recognition and normalization, etc.) and visualization modules (interactive word clouds and timelines). Fietstas has been developed and is being used for processing of large-scale datasets in the context of several projects, such as DuOMAn. A text translation service based on Machine Learning can be used to translate existing lexicons and documents between Dutch and German (both directions). The web application uses this functionality of Fietstas to leverage interactive creation, expansion and refinement of lexicons specific to the user’s research questions and needs. For BILAND new bilingual and biscriptural lexicons have been developed. The application uses the visualization features of Fietstas to allow users to examine the research domain along the dimensions of time, context, and the identity and frequency of the discourse. WAHSP/BILAND is meant to be generic and testable in all domains, where analysis of topics, contexts and attitudes in large volumes of text is needed.

Project

WAHSP/BILAND

CLARIN National Project

CLARIN-NL

CLARIN centre

Huygens ING

Research domain

History

Communication and Media Studies

Tool task

corpus searching

visualisation

Country

Netherlands

Tool Type

web application

Research Phase