CLARIN-NL - local desktop

Syntax

Tool task

sentence splitting

tokenisation

Country

Netherlands

Input Language

Dutch

Swedish

Russian

Spanish

Portuguese

English

German

French

Italian

Version

v0.13

Access Contact

Project Contact

/mailto:/

Creator Contact

Maarten van Gompel, Ko van der Sloot and Antal van den Bosch. 2017. Ucto: Unicode Tokenizer. version 0.9.6. Reference Guide. Technical Report, Jan 23, 2017.

Maarten van Gompel

Ko van der Sloot

Documentation

Maarten van Gompel, Ko van der Sloot, Antal van den Bosch (2012). Ucto: Unicode Tokeniser. Reference Guide. ILK Technical Report 12-05.

readme

releaseNotes

issueTracker

contIntegration

Source code

https://github.com/LanguageMachines/ucto

Resource

CMDI File Link

License

GNU GPL

Inventory Scope

local

Ucto Engine

root — Mon, 08 Apr 2019 08:38:55 +0000

https://raw.githubusercontent.com/LanguageMachines/ucto/master/logo.svg

Title

Ucto Tokeniser Engine

Description

The Ucto tokenisation engine is a language-independent engine that, given an external configuration file with tokenisation rules for a specifc language ,yields a tokenizer for that language that tokenizes text files: it separates words from punctuation, and splits sentences. This is one of the first tasks for almost any Natural Language Processing application. Ucto offers several other basic preprocessing steps such as changing case that you can all use to make your text suited for further processing such as indexing, part-of-speech tagging, or machine translation. The tokeniser engine is language independent. By supplying language-specific tokenisation rules in an external configuration file a tokeniser can be created for a specific language. Ucto comes with tokenization rules for English, Dutch, French, Italian, and Swedish; it is easily extensible to other languages. It recognizes dates, times, units, currencies, abbreviations. It recognizes paired quote spans, sentences, and paragraphs. It produces UTF8 encoding and NFC output normalization, optionally accepts other encodings as input. Optional conversion to all lowercase or uppercase. Ucto supports FoLiA XML.

Project

CLARIN-NL

CLARIAH-CORE

CLARIN National Project

CLARIN-NL

CLARIAH-CORE

CLARIN centre

none yet

Research domain

Linguistics

Linguistic Subject

Syntax

Tool task

sentence splitting

tokenisation

Country

Netherlands

Tool Type

local desktop

Research Phase

Enriching Data

Tool status

published

Input format

application/pdf

application/msword

text/folia+xml

text/plain

Output format

text/plain

Input Language

Version

v0.13

Access Contact

Project Contact

/mailto:/

Creator Contact

Maarten van Gompel, Ko van der Sloot and Antal van den Bosch. 2017. Ucto: Unicode Tokenizer. version 0.9.6. Reference Guide. Technical Report, Jan 23, 2017.

Maarten van Gompel

Ko van der Sloot

Documentation

Maarten van Gompel, Ko van der Sloot, Antal van den Bosch (2012). Ucto: Unicode Tokeniser. Reference Guide. ILK Technical Report 12-05.

readme

releaseNotes

issueTracker

contIntegration

Source code

https://github.com/LanguageMachines/ucto

Resource

CMDI File Link

License

GNU GPL

Inventory Scope

local

PICCL

root — Mon, 08 Apr 2019 08:38:55 +0000

Title

PICCL: Philosophical Integrator of Computational and Corpus Libraries

Description

PICCL is a set of workflows for corpus building through OCR, post-correction, modernization of historic language and Natural Language Processing. It combines Tesseract Optical Character Recognition, TICCL functionality and Frog functionality in a single pipeline. Tesseract offers Open Source software for optical character recognition. TICCL (Text Induced Corpus Clean-up) is a system that is designed to search a corpus for all existing variants of (potentially) all words occurring in the corpus. This corpus can be one text, or several, in one or more directories, located on one or more machines. TICCL creates word frequency lists, listing for each word type how often the word occurs in the corpus. These frequencies of the normalized word forms are the sum of the frequencies of the actual word forms found in the corpus. TICCL is a system that is intended to detect and correct typographical errors (misprints) and OCR errors (optical character recognition) in texts. When books or other texts are scanned from paper by a machine, that then turns these scans, i.e. images, into digital text files, errors occur. For instance, the letter combination `in' can be read as `m', and so the word `regeering' is incorrectly reproduced as `regeermg'. TICCL can be used to detect these errors and to suggest a correct form. Frog enriches textual documents with various linguistic annotations.

Project

CLARIN-NL

CLARIAH-CORE

Nederlab

CLARIN National Project

CLARIN-NL

CLARIAH-CORE

CLARIN centre

none yet

Research domain

Linguistics

Philosophy

Literary Studies

Religion Studies

History

Linguistic Subject

Orthography

Morphology

Syntax

Tool task

optical character recognition

orthographic normalisation

sentence splitting

tokenisation

dependency parsing

shallow parsing

lemmatisation

morphological analysis

named entity recognition

Country

Netherlands

Tool Type

local desktop

Research Phase

Enriching Data

Tool status

published

Input format

application/pdf

image/tiff

text/plain

text/folia+xml

image/vnd.djvu

Output format

text/folia+xml

Input Language

Dutch

Swedish

Russian

Spanish

Portuguese

English

German

French

Italian

Finnish

Modern Greek

Classical Greek

Icelandic

German (Fraktur)

Latin

Romanian

Version

v0.6.4

Access Contact

Martin Reynaert

Project Contact

/mailto:/

Creator Contact

Martin Reynaert

Maarten van Gompel

Ko van der Sloot

Documentation

Information Page

readme

releaseNotes

issueTracker

contIntegration

Source code

https://github.com/LanguageMachines/piccl

Publications

Martin Reynaert, Maarten van Gompel, Ko van der Sloot and Antal van den Bosch. 2015. PICCL: Philosophical Integrator of Computational and Corpus Libraries. Proceedings of CLARIN Annual Conference 2015, pp. 75-79. Wrocław, Poland. http://www.nederlab.nl/cms/wp-content/uploads/2015/10/Reynaert_PICCL-Philosophical-Integrator-of-Computational-and-Corpus-Libraries.pdf

Resource

LandingPage

CMDI File Link

License

GNU GPL

Inventory Scope

local

Arbil

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

Metadata Editor, Browser and Organiser for IMDI and CMDI

Description

Arbil (Archive Builder) is a metadata editor, browser and organiser for metadata in IMDI and CMDI format. It is a Java desktop application that runs on most operating systems. Arbil can be used to create new metadata from scratch for resources on your local machine, or it can be used to download and modify metadata that are already in an archive. Arbil is a generic CMDI editor and therefore supports all CMDI profiles. It has a built-in file type verification tool that is configured to check files against the list of accepted file types for The Language Arhive, this can however be overruled for other archives.

Project

The Language Archive

DOBES

CLARIN National Project

CLARIN-NL

CLARIN centre

MPI for Psycholinguistics

Research domain

General

Tool task

editing

metadata creation

Country

Netherlands

Tool Type

local desktop

Research Phase

Publishing Data / Software

Tool status

released

Output format

text/xml

Input Language

Version

2.6

Access Contact

Project Contact

/mailto:dobes@mpi.nl/

Creator Contact

Documentation

Arbil CMDI Manual

Arbil Online CMDI Manual

Arbil CMDI User Guide

Source code

https://github.com/TheLanguageArchive/Arbil

Original source

http://portal.clarin.nl/node/1962

Resource

CMDI File Link

License

GNU GPL

Inventory Scope

local

ANNEX

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

Web-based Annotation Explorer

Description

Annex (Annotation Explorer) is a web-based tool for exploring and viewing annotated multimedia recordings in an archive. ANNEX can play audio and video files in a web browser along with annotations in a variety of formats: ELAN (EAF), Shoebox/Toolbox text, CHAT (CHILDES annotation format), Plain text, CSV, PDF, SubRip, Praat TextGrid, HTML and XML. Annex will visualise the annotations in synchrony with the media files as long as time-alignment information is available. If no time-alignment information is available, a default segment duration is assumed. Annex has a graphical interface that resembles the interface of the ELAN annotation tool to some extent, with a number of different view modes such as subtitle view, timeline view and grid view. Annex runs in any modern web browser with the Adobe Flash plugin (> version 10) installed. ANNEX has been functionally extended with the help of the following CLARIN-NL-funded projects: - ColTime: Collaboration on Time-Based Resources. - EXILSEA: Exploiting ISOcat's Language Sections in ELAN and ANNEX. - MultiCon: Multilayer Concordance Functions in ELAN and ANNEX. - SignLinC: Linking lexical databases and annotated corpora of signed languages. Over the years, many funders have contributed to the development of ANNEX in several projects, such as the Volkswagen Foundation, the Royal Netherlands Academy of Arts and Sciences, the Berlin-Brandenburg Academy of Sciences and Humanities, the German Federal Ministry of Education and Research and the the Max Planck Society.

Project

The Language Archive

DOBES

ColTime

EXILSEA

MultiCon

SignLinC

CLARIN National Project

CLARIN-NL

CLARIN centre

MPI for Psycholinguistics

Research domain

Cultural Sciences

Oral History

Linguistics

Linguistic Subject

Sign language

language acquisition

psycholinguistics

anthropological linguistics

discourse analysis

Language Documentation

Morpho-syntax

text and corpus linguistics

Tool task

alignment

morphosyntactic tagging

phonetic annotation

analysis

speech transcription

Country

Netherlands

Tool Type

local desktop

Research Phase

Enriching Data

Tool status

retired

Input Language

Version

1.6

Access Contact

Project Contact

O.A. Crasborn

/mailto:/

Creator Contact

Documentation

ANNEX Manual

ANNEX Online Manual

ANNEX Flyer

ANNEX A4 Guide

Source code

not specified

Original source

http://portal.clarin.nl/node/4188

http://portal.clarin.nl/node/4187

http://portal.clarin.nl/node/1941

http://portal.clarin.nl/node/4186

Resource

CMDI File Link

License

GNU GPL

Inventory Scope

local

OpenConvert

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

OpenConvert

Description

The OpenConvert tools convert to TEI or FOLiA from a number of input formats (alto, text, word, HTML, ePub). The tools are available as a Java command line tool, a web service and a web application.The OpenConvert Tools were created by IVDNT in the OpenConvert project. The OpenConvert tools convert to TEI or FOLiA from a number of input formats (alto, text, word, HTML, ePub). The tools are available as a Java command line tool, a web service and a web application. Furthermore, as a proof of concept, the website currently provides two annotation tools: a simple Tokenizer for TEI files and a modern Dutch part of speech tagger.

Project

OpenConvert

CLARIN National Project

CLARIN-NL

CLARIAH-CORE

CLARIN centre

Dutch Language Institute

Research domain

Linguistics

Religion Studies

Communication and Media Studies

Cultural Sciences

History

Literary Studies

Philosophy

Political Studies

Tool task

corpus processing

format conversion

text conversion

tokenisation

Country

Netherlands

Tool Type

local desktop

Research Phase

Enriching Data

Tool status

released

Input format

text/plain

application/msword

text/html

text/xml

application/epub+zip

application/zip

Output format

text/xml

Input Language

Access Contact

/mailto:servicedesk@ivdnt.org/

Institute for the Dutch Language

Project Contact

Jan Theo Bakker

Institute for the Dutch Language

Creator Contact

Jan Theo Bakker

Institute for the Dutch Language

Documentation

OpenConvert help

Source code

https://github.com/INL/OpenConvert

Original source

http://portal.clarin.nl/node/4224

Resource

CMDI File Link

License

other

Inventory Scope

local

ELAN

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

ELAN Multimedia Annotator

Description

ELAN is a professional tool for the creation of complex annotations on video and audio resources. With ELAN a user can add an unlimited number of annotations to audio and/or video streams. An annotation can be a sentence, word or gloss, a comment, translation or a description of any feature observed in the media. Annotations can be created on multiple layers, called tiers. Tiers can be hierarchically interconnected. An annotation can either be time-aligned to the media or it can refer to other existing annotations. The textual content of annotations is always in Unicode and the transcription is stored in an XML format. ELAN provides several different views on the annotations, each view is connected and synchronized to the media playhead. Up to 4 video files can be associated with an annotation document. Each video can be integrated in the main document window or displayed in its own resizable window. ELAN delegates media playback to an existing media framework, like Windows Media Player, QuickTime or JMF (Java Media Framework). As a result a wide variety of audio and video formats is supported and high performance media playback can be achieved. ELAN is written in the Java programming language and the sources are available for non-commercial use. It runs on Windows, Mac OS X and Linux. ELAN has been functionally extended with the help of the following CLARIN-NL-funded projects: - ColTime: Collaboration on Time-Based Resources. - EXILSEA: Exploiting ISOcat's Language Sections in ELAN and ANNEX. - MultiCon: Multilayer Concordance Functions in ELAN and ANNEX. - SignLinC: Linking lexical databases and annotated corpora of signed languages. Over the years, many funders have contributed to the development of ELAN in several projects, such as the Volkswagen Foundation, the Royal Netherlands Academy of Arts and Sciences, the Berlin-Brandenburg Academy of Sciences and Humanities, the German Federal Ministry of Education and Research, the Max Planck Society and the ARC Centre of Excellence for the Dynamics of Language.

Project

The Language Archive

DOBES

ColTime

EXILSEA

MultiCon

SignLinC

COEDL

CLARIN National Project

CLARIN-NL

CLARIN centre

MPI for Psycholinguistics

Research domain

Linguistics

Cultural Sciences

Oral History

Linguistic Subject

Sign language

language acquisition

psycholinguistics

anthropological linguistics

discourse analysis

Language Documentation

Morpho-syntax

text and corpus linguistics

Tool task

speech transcription

phonetic annotation

morphosyntactic tagging

alignment

analysis

audio-visual processing

Country

Netherlands

Tool Type

local desktop

Research Phase

Enriching Data

Tool status

released

Input Language

Access Contact

Project Contact

O.A. Crasborn

/mailto:/

/mailto:coedl@anu.edu.au/

Creator Contact

Documentation

ELAN - user Guide

ELAN - Online User Guide

ELAN - Linguistic Annotator Manual

ELAN - Linguistic Annotator Online Manual

ELAN - Media Encoding Guideliens

Source code

not specified

Original source

http://portal.clarin.nl/node/4188

http://portal.clarin.nl/node/4187

http://portal.clarin.nl/node/1941

http://portal.clarin.nl/node/4186

Resource

CMDI File Link

License

GNU GPL

Inventory Scope

local

Dupira

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

Dupira; the Dutch Parser for IR Applications

Description

Dupira is a rule-based parser, generated by means of the AGFL parser generator from the Dupira grammar, lexicon and fact tables. By means of transductions which are specified in the grammar (and can be modified), the parser transduces sentences to dependency graphs. Dupira was developed for practical applications in Information Retrieval and for Information Systems needing a Natural Language interface. Its intended users are computer scientists and computer professionals rather than linguists.

Project

PHASAR

CLARIN National Project

CLARIN-NL

CLARIN centre

Dutch Language Institute

Research domain

Linguistics

Linguistic Subject