CLARIN-NL - Data analysis

SPOD

root — Mon, 08 Apr 2019 08:38:55 +0000

Title

Syntactic Profiler of Dutch

Description

SPOD is syntactic profiler that covers a broad spectrum of properties. It is part of the PaQu application but has its own interface with a menu of predefined queries. It can be used to provide general information about corpus properties, such as the number of main and subordinate clauses, types of main and subordinate clauses, and their frequencies, average length of clauses (per clause type: e.g. relative clauses, indirect questions, finite complement clauses, infinitival clauses, finite adverbial clauses, etc.). It yields output in HTML and tab-separated text format.

Project

SPOD

CLARIN National Project

CLARIAH-CORE

CLARIN centre

none yet

Research domain

Linguistics

Linguistic Subject

Computational Linguistics

general linguistics

Syntax

Tool task

syntactic analysis

Country

Netherlands

Input Language

Dutch

Version

no explicit version mentioned

Access Contact

Gertjan van Noord

Jack Hoeksema

Project Contact

Jack Hoeksema

Creator Contact

Peter Kleiweg

Documentation

PaQu Info

PaQu/README.md

Source code

https://github.com/rug-compling/paqu

Resource

CMDI File Link

License

other

Inventory Scope

local

WIP

root — Mon, 08 Apr 2019 08:38:55 +0000

Title

WIP: War in Parliament

Description

An advanced search engine for the OCR-ed scanned image collection of proceedings of the Dutch Hansard (Handelingen der Staten-Generaal 1930-1995). These proceedings are available as a fully annotated semi-structures dataset for historical and social science research. The output of the search engine can be restricted by speaker name, party, date range, and other criteria. References to the Second World War (WW II) have shaped political debate in the Netherlands for many decades. However, we have no systematic knowledge of why, how often, when, by whom or from which political party, and in which context, these references were made. Nor do we know the meanings politicians ascribed to the war years, the lessons the war was supposed to teach, and how all of this influenced political decision-making. WIP helps answering these questions and will help us better understand the complex legacies of WW II. The WIP project bridges the gap between historical and social science practices and the possibilities offered by using large corpora and language resources, in particular Clarin tools for Dutch. The dataset - de Handelingen der Staten-Generaal (Dutch Hansard) - are made compliant with Clarin, ISOCAT and ISO/TC 37/SC 4 standards. The search engine for this dataset uses an intuitive and powerful query language based on XPath, and its output can be fed directly into further analysis programs like SPSS. Integrating this technology with important historical research questions will directly contribute to new and innovative ways of writing about history. The search engine results can be exported in a CSV-format (comma seperated values). This makes it easy to calculate statistics offline from a result set and apply further filters.

Project

ExPoSe

DiLiPaD

CLARIN National Project

CLARIN-NL

CLARIN centre

DANS

Research domain

Political Studies

History

Communication and Media Studies

Tool task

corpus searching

Country

Netherlands

Tool Type

web application

Research Phase

Browsing and Searching

Data analysis

Tool status

published

Output format

text/plain

Input Language

Dutch

Access Contact

/mailto:maartenmarx@uva.nl/

Project Contact

/mailto:maartenmarx@uva.nl/

University of Amsterdam

Creator Contact

Dr. Hinke Piersma

Documentation

Zoeken in de Handelingen: help

Movie

Demonstration Scenario

Source code

not specified

Original source

http://portal.clarin.nl/node/1923

Publications

Marx, M. (2011), Oorlog in de Kamer, NRC, March 3, 2011

‘Waarom politici graag over de oorlog praten’, NRC-Handelsblad, 25 februari 2011

‘Zoekmachine vindt relevante WO2-verwijzingen in Handelingen der Staten Generaal. Dat doet denken aan de oorlog’, in: E-data & research, Jaargang 6, nummer 2, oktober 2011 http://www.edata.nl/0602_011011/pdf/0602_011011_1.pdf

‘NIOD ontwikkelt zoekmachine die verwijzingen naar de oorlog opspoort’, in: Informatie Professional. Vakblad voor informatiewerkers, nr. 11 (2011)

L. Buitinck en M. Marx (2012), ‘Two-stage named entity recognition using averaged perceptrons’, in: Proc. NLDB 2012, pp. 171-176

Resource

SearchPage

CMDI File Link

License

unknown

Inventory Scope

local

Stylene

root — Mon, 08 Apr 2019 08:38:55 +0000

Title

Stylene, a robust, modular system for stylometry and readability research

Description

Stylene is a robust, modular system for stylometry and readability research on the basis of existing techniques for automatic text analysis and machine learning, and the development of a web service that allows researchers in the humanities and social sciences to analyze texts with this system. In this way, the project will make available to researchers recent advances in research on the computational modeling of style and readability. Background Stylene consists of an educational demonstration interface and tools for stylometry (authorship attribution and profiling) and readability research for Dutch. The Stylene system consists of a popularization interface for learning to understand stylometric analysis, and web-based interfaces to software for readability and stylometry research aimed at researchers from the humanities and social sciences who don’t want to develop or install such software themselves. Stylene has been created in the context of CLARIN Flanders.

Project

Stylene

CLARIN National Project

CLARIN-DLU

CLARIN centre

none yet

Research domain

Linguistics

Linguistic Subject

Readability Studies

discourse analysis

Stylistics

Tool task

analysis

Authorship Attribution

stylistic analysis

Profiling

Readability Analysis

Country

Belgium

Tool Type

web application

Research Phase

Data analysis

Tool status

published

Output format

text/html

Input Language

Dutch

Access Contact

Walter Daelemans

Project Contact

Walter Daelemans

Creator Contact

Walter Daelemans

Documentation

Explanation of how Stylene works (provided after submitting a text for analysis)

Source code

not specified

Original source

http://portal.clarin.nl/node/4240

Publications

Daelemans, W, De Clercq, O and Hoste, V. 2017. Stylene: an Environment for Stylometry and Readability Research for Dutch. In: Odijk, J and van Hessen, A. (eds.) CLARIN in the Low Countries, Pp. 195–209. London: Ubiquity Press. DOI: https://doi.org/10.5334/bbi.16. License: CC-BY 4.0

Resource

LandingPage

Resource

CMDI File Link

License

unknown

Inventory Scope

local

SHEBANQ

root — Mon, 08 Apr 2019 08:38:55 +0000

Title

SHEBANQ: System for HEBrew Text: ANnotations for Queries and Markup

Description

The WIVU (Werkgroep Informatica Vrije Universiteit) Hebrew Text Database contains the Biblia Hebraica Stuttgartensia (BHS) version of the text of the Hebrew Bible. Portions of other Semitic languages are included as well: the Aramaic sections of the Old Testament, two Syriac versions, and annotated portions of the Syriac and Aramaic translations. All these texts have been enriched with features that primarily result from linguistic analysis. The database can be queried by means of a language that is optimized to deal with data that is modeled as objects + features. SHEBANQ builds a bridge between the linguistically annotated Hebrew Text corpus and biblical scholars by (1) making this text, including its annotations, available to scholars; (2) demonstrating how queries can function to address research questions; the query saver and the metadata added to them will be a growing repository of valuable best practices of what queries are used in addressing research questions and how they contribute to answering these questions; (3) giving textual scholarship a more empirical basis, by creating the opportunity that claims made in scholarly articles (e.g.: “this syntactic pattern is not attested elsewhere in the Hebrew Bible”) can be accompanied by the unique identifiers that refer to the saved queries that have led to the claim. The WIVU database is a resource under long-term development. New features are being added, new corrections are being made over time.

Project

SHEBANQ

CLARIN National Project

CLARIN-NL

CLARIN centre

DANS

Research domain

Linguistics

Religion Studies

Linguistic Subject

historical linguistics

Syntax

Morpho-syntax

Tool task

corpus exploration

corpus searching

browsing

analysis

visualisation

Country

Netherlands

Tool Type

web application

Research Phase

Browsing and Searching

Data analysis

Tool status

published

Output format

text/plain

Input Language

Hebrew

Aramaic

Access Contact

Dirk Roorda

Project Contact

/mailto:dirk.roorda@dans.knaw.nl/

Creator Contact

Prof. Dr. W.T. (Wido) van Peursen

Documentation

SHEBANQ - help

Source code

not specified

Original source

http://portal.clarin.nl/node/4180

Publications

Roorda, D. 2017. The Hebrew Bible as Data: Laboratory - Sharing - Experiences. In: Odijk, J and van Hessen, A. (eds.) CLARIN in the Low Countries, Pp. 217–229. London: Ubiquity Press. DOI: https://doi.org/10.5334/bbi.18. License: CC-BY 4.0

Roorda, D. (2015). The Hebrew Bible as Data: Laboratory - Sharing - Experiences http://arxiv.org/abs/1501.01866

Roorda, D. (2014). LAF-Fabric: a data analysis tool for Linguistic Annotation Framework with an application to the Hebrew Bible, Computational Linguistics in the Netherlands Journal, Volume 4, December 2014, pp. 105-109 http://www.clinjournal.org/sites/clinjournal.org/files/08-Roorda-etal-CLIN2014.pdf and http://arxiv.org/abs/1410.0286

Resource

SearchPage

Resource

CMDI File Link

License

Creative Commons (non-commercial)

Inventory Scope

local

PaQu

root — Mon, 08 Apr 2019 08:38:55 +0000

Title

PaQu - Parse and Query

Description

PaQu uses the Alpino parser to make treebanks of your own text corpus, and to search in these treebanks using an interface based on the LASSY Word Relations Search interface (http://dev.clarin.nl/node/1966). Several treebanks are already available in the application, such as: Lassy Klein (1M words, manually checked syntactic analysis) and Lassy Groot (700M words, syntactic analysis automatically assigned by Alpino). PaQu offers two ways to search through the syntactically annotated texts. The first option is to use the search bar to look for word pairs, optionally complemented by their syntactic relationship. The second search option is to use the query language XPath.

Project

PaQu

CLARIN National Project

CLARIN-NL

CLARIAH-CORE

CLARIN centre

none yet

Research domain

Linguistics

Linguistic Subject

Computational Linguistics

general linguistics

Syntax

Tool task

corpus browsing

corpus searching

corpus processing

parsing

dependency parsing

grammatical relation assignment

Country

Netherlands

Tool Type

web application

Research Phase

Browsing and Searching

Data analysis

Enriching Data

Tool status

published

Input format

text/plain

Output format

text/plain

Input Language

Dutch

Version

no explicit version mentioned

Access Contact

Gertjan van Noord

Project Contact

/mailto:g.j.m.van.noord@rug.nl/

Creator Contact

/mailto:p.c.j.kleiweg@rug.nl/

Documentation

PaQu Info

paqu/README.md

Source code

https://github.com/rug-compling/paqu

Original source

http://portal.clarin.nl/node/4182

Publications

Odijk, J, van Noord, G, Kleiweg, P and Tjong Kim Sang, E. 2017. The Parse and Query (PaQu) Application. In: Odijk, J and van Hessen, A. (eds.) CLARIN in the Low Countries, Pp. 281–297. London: Ubiquity Press. DOI: https://doi.org/10.5334/bbi.23. License: CC-BY 4.0

Resource

CMDI File Link

License

other

Inventory Scope

local

OpenSONAR

root — Mon, 08 Apr 2019 08:38:55 +0000

Title

OpenSONAR: a 500 MW reference corpus of Contemporary Written Dutch

Description

SoNaR is a 500-million-word reference corpus of contemporary written Dutch for use in different types of linguistic (incl. lexicographic) and HLT research and the development of applications. The STEVIN funded SoNaR project (2008-2011) built on the results obtained in the D-Coi and Corea projects which were awarded funding in the first call of proposals within the STEVIN programme. SONAR contains over 500 million words (i.e. word tokens) of full texts from a wide variety of text types including both texts from conventional media and texts from the new media. All texts except for texts from the social media (Twitter, Chat, SMS) have been tokenized, tagged for part of speech and lemmatized, while in the same set the Named Entities have been labelled. All annotations were produced automatically, no manual verification took place. The texts are enriched with several annotations (Part of Speech and lemma information) and are available as FoLiA xml files (folia.xml). The system relies on BlackLab server as back-end and WhiteLab as user-interface. OpenSONAR is an online application for exploration of and searching in the SoNaR corpus.

Project

OpenSONAR

CLARIN National Project

CLARIN-NL

CLARIAH-CORE

CLARIN centre

Dutch Language Institute

Research domain

Linguistics

Linguistic Subject

Computational Linguistics

general linguistics

Lexicology

Morphology

Syntax

text and corpus linguistics

Tool task

corpus browsing

corpus searching

corpus exploration

Country

Netherlands

Tool Type

web application

Research Phase

Browsing and Searching

Data analysis

Tool status

published

Input Language

Dutch

Access Contact

/mailto:servicedesk@ivdnt.org/

Institute for the Dutch Language

Project Contact

/mailto:-/

Creator Contact

Dr. Nelleke Oostdijk

Radboud University

Katholieke Universiteit Leuven (CCL)

Hogeschool Gent (Dept. Vertaalkunde, LT3)

Tilburg University (TiCC/ILK)

Twente University (HMI)

Utrecht University (UiL-OTS)

Documentation

OpenSONAR Manual - First Use

SoNaR User Manual 1.0.4

Source code

not specified

Original source

http://portal.clarin.nl/node/4195

Publications

van de Camp, M, Reynaert,MandOostdijk, N. 2017.WhiteLab 2.0: AWeb Interface for Corpus Exploitation. In: Odijk, J and van Hessen, A. (eds.) CLARIN in the Low Countries, Pp. 231–243. London: Ubiquity Press. DOI: https://doi.org/10.5334/bbi.19. License: CC-BY 4.0

de Does, J, Niestadt, J and Depuydt, K. 2017. Creating Research Environments with BlackLab. In: Odijk, J and van Hessen, A. (eds.) CLARIN in the Low Countries, Pp. 245–257. London: Ubiquity Press. DOI: https://doi.org/10.5334/bbi.20. License: CC-BY 4.0

Oostdijk, N., Reynaert, M., Hoste, V., Schuurman, I. (2013) The Construction of a 500 Million Word Reference Corpus of Contemporary Written Dutch in: Essential Speech and Language Technology for Dutch: Results by the STEVIN-programme (eds. P. Spyns, J. Odijk), Springer Verlag.

Resource

SearchPage

CMDI File Link

License

other

Inventory Scope

local

ONW

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

Dictionary of Old Dutch

Description

The dictionary of Old Dutch (ONW) online is the electronic version of the ONW. The dictionary describes describes the Old Dutch vocabulary from the period 500 to 1200.

Project

GTB

CLARIN National Project

CLARIN-NL

CLARIN centre

Dutch Language Institute

Research domain

Linguistics

Linguistic Subject

general linguistics

Language Documentation

Lexicology

Tool task

dictionary searching

other

Country

Netherlands

Tool Type

web application

Research Phase

Browsing and Searching

Data analysis

Tool status

published

Input Language

Old Dutch

Version

1.0

Access Contact

/mailto:servicedesk@ivdnt.org/

Institute for the Dutch Language

Project Contact

/mailto:servicedesk@ivdnt.org/

Institute for the Dutch Language

Creator Contact

Lic. Katrien Depuydt

Institute for the Dutch Language

Documentation

Frequently Asked Questions

Source code

not specified

Resource

SearchPage

LandingPage

CMDI File Link

License

unknown

Inventory Scope

local

Nederlab

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

Nederlab, online laboratory for humanities research on Dutch text collections

Description

The Nederlab project aims to bring together all digitized texts relevant to Dutch national heritage, the history of Dutch language and culture (c. 800 - present) in one user-friendly and tool-enriched open access web interface, allowing scholars to simultaneously search and analyze data from texts spanning the full recorded history of the Netherlands, its language and culture. The project builds on various initiatives: for corpora Nederlab collaborates with the scientific libraries and institutions, for infrastructure with CLARIN (and CLARIAH), for tools with eHumanities programmes such as Catch, IMPACT and CLARIN (TICCL, frog). Nederlab will offer a large number of search options with which researchers can find the occurrence of a particular term in a particular corpus or subcorpus. It'll also offer visualization of search results through line graphs, bar graphs, circle graphs, or scatter graphs. Furthermore, this online lab will offer a large set of tools, like tokenization tools, tools for spelling normalization, PoS-tagging tools, lemmatization tools, a computational historical lexicon and indices. Also, the use of (semi-) automatic syntactic parsing, tools for text mining, data mining and sentiment mining, Named Entity Recognition tools, coreference resolution tools, plagiarism detection tools, paraphrase detection tools and cartographical tools is offered The first version of Nederlab was launched in early 2015, it’ll be expanded until the end of 2017. Nederlab is financed by NWO, KNAW, CLARIAH and CLARIN-NL.

Project

Nederlab

CLARIN National Project

CLARIN-NL

CLARIAH-CORE

CLARIN centre

Meertens/HuC

Research domain

Linguistics

History

Cultural Sciences

Linguistic Subject

historical linguistics

Tool task

coreference resolution

corpus searching

corpus processing

corpus workbench

lemmatisation

part of speech tagging

dependency parsing

tokenisation

Country

Netherlands

Tool Type

web application

Research Phase

Browsing and Searching

Data analysis

Tool status

published

Input Language

Dutch

Version

Access Contact

Hennie Brugman

Project Contact

/mailto:hennie.brugman@meertens.knaw.nl/

Creator Contact

/mailto:hennie.brugman@meertens.knaw.nl/

Documentation

Help

Multi Tier Annotation Search

Source code

https://github.com/meertensinstituut/mtas

Original source

http://portal.clarin.nl/node/4233

Publications

http://www.nederlab.nl/wp/?page_id=12

Resource

CMDI File Link

License

GNU GPL

Inventory Scope

local

MIMORE

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

MIMORE: Microcomparative Morphosyntax Research Tool

Description

With the MIMORE search engine one can search three databases together, with text strings, part of speech tags and syntactic variables. The researcher can combine categories and features into complex tags or use predefined tags. All categories and features are defined in ISOcat. Since all sentences have a location code, the morphosyntactic phenomena found in a set of sentences resulting from a search can be automatically plotted on a geographic map. It is possible to include more than one morphosyntactic phenomenon in one map, thus visualizing potential correlations between these phenomena. There is also a user-friendly function to export the data to a statistical program. The data in DynaSAND, the dynamic syntactic atlas of the Dutch dialects (http://www.meertens.knaw.nl/sand/ (link is external)), were collected between 2000 and 2005 by oral interviews (fieldwork and telephone) in about 300 locations across The Netherlands, Belgium and a small part of north-west France. Dialect speakers were asked to judge and/or translate some 150 test sentences. DynaSAND makes available the full recordings and transcriptions of these interviews. Together, the DynSAND data cover the syntactic variation in the Dutch language area in the left periphery of the clause (the complementizer system and complementizer agreement), variation in subject pronoun form depending on syntactic position, subject pronoun doubling, cliticization on YES/NO, the reflexive system, fronting constructions (Wh-clauses, relative clauses, topicalization), word order and morphological variation in verb clusters, negation and quantification. The data in DiDDD (Diversity in Dutch DP Design; http://www.meertens.knaw.nl/diddd/ (link is external)) were collected between 2005 and 2009 with oral and written interviews in about 200 locations in the Dutch language area, with a methodology highly parallel to DynaSAND. The data involve translations of and judgements on test sentences. For 29 interviews there are sound recordings which have been lined up with their transcriptions. The DIDDD data cover the morphosyntactic variation within nominal groups, in particular possessives, partitives, noun ellipsis, the demonstrative system, the numeral modification system, what-for constructions, quantitative er, adjectival inflection, negation and exclamatives. The data in GTRP (Goeman, Taeldeman, van Reenen Project; http://www.meertens.knaw.nl/mand/database/ (link is external)) were collected between 1979 and 2000 with oral interviews in about 600 locations in the Dutch language area. Informants were asked to translate words or short sentences. Part of the transcriptions have been lined up with the sound recordings. The morphological data in GTRP include plural forms of nouns, diminutives, gender on nouns and adjectives, comparatives, superlatives, verbal inflection including participles, subject, object and possessive pronouns.

Project

MIMORE

CLARIN National Project

CLARIN-NL

CLARIAH-CORE

CLARIN centre

Meertens/HuC

Research domain

Linguistics

Linguistic Subject

Dialectology

Morphology

Syntax

Tool task

corpus searching

corpus browsing

analysis

visualisation

Country

Netherlands

Tool Type

web application

Research Phase

Browsing and Searching

Data analysis

Tool status

published

Output format

text/csv

Input Language

Dutch

Access Contact

/mailto:info@meertens.knaw.nl/

Project Contact

prof. dr. Sjef Barbiers

Creator Contact

prof. dr. Sjef Barbiers

Documentation

Demonstration of the Microcomparative Morphosyntactic Research Tool

Architectuur MIMORE

MIMORE Video

Source code

not specified

Original source

http://portal.clarin.nl/node/1911

Publications

S. Barbiers, M. van Koppen, H. Bennis, N. Corver, MIcrocomparative MOrphosyntactic REsearch (MIMORE): Mapping partial grammars of Flemish, Brabantish and Dutch. Lingua Vol. 178, 5-31. doi:10.1016/j.lingua.2015.10.018

Resource

SearchPage

SearchService

CMDI File Link

License

unknown

Inventory Scope

local

MIGMAP

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

MIGMAP: Detailed interactive mapping of migration in The Netherlands in the 20th century.

Description

MIGMAP is a web application that can show migration flow between Dutch municipalities. The user first chooses generation (forward or backward in time) and gender, while subsequently the migration map of The Netherlands related to an interactively pointed municipality (or other aggregation unit) is shown. The data underlying the migration maps originate from the first name selection from the Civil Registration, acquired by Utrecht University and the Meertens Institute in 2006. These concern 16 million records from persons with Dutch citizenship, alive in 2006, and in addition 6 million persons deceased before 2006, but mentioned in other records – mainly as parents. The records include identifiers by which family relations can be reconstructed. After considerable efforts in data clearing and reconstruction of older generations, the data provide an almost complete overview of the Dutch population, born after 1930, and a fairly good sample from the period 1880-1930 (>25%). The user will be given options to choose generation (places of birth of the current population, their parents, grandparents grand-grandparents, or starting with the persons born between 1880-1900: the current places of residence of their children, grandchildren), and gender. Each map will be made available as a .csv record with municipality number and percentage as fields, and thus can be used by users in correlation studies with other variables. Utrecht University and the Meertens Institute have the signed permission of the "Basisadministratie voor Persoonsgegevens en Reisdocumenten, The Hague" to use the data for scientific purposes. The migration maps present the data in an aggregated way, and do not violate privacy requirements (no individual can possibly be identified from the maps). However, the underlying data containing information about individual persons and their family relations cannot be made available for reasons of privacy.

Project

MIGMAP

CLARIN National Project

CLARIN-NL

CLARIN centre

Meertens/HuC

Research domain

Linguistics

History

Linguistic Subject

Dialectology

Onomatology

Sociolinguistics

Tool task

searching

browsing

visualisation

analysis

Country

Netherlands

Tool Type

web application

Research Phase

Data analysis

Tool status

published

Output format

text/csv

Input Language

Dutch

Access Contact

/mailto:info@meertens.knaw.nl/

Project Contact

/mailto:info@meertens.knaw.nl/

Creator Contact

dr. ir. G. Bloothooft

Documentation

Background information - Instructions for use

Source code

not specified

Original source

http://portal.clarin.nl/node/1930

Publications

Bloothooft, G, Onland, D and Kunst, J.P. 2017. Mapping Migration across Generations. In: Odijk, J and van Hessen, A. (eds.) CLARIN in the Low Countries, Pp. 351–360. London: Ubiquity Press. DOI: https://doi.org/10.5334/bbi.29. License: CC-BY 4.0

Ekamper, P. en Bloothooft, G. (2013), "Weg van je wortels. De afstand tussen overgrootouders en achterkleinkinderen", DEMOS 29, 2, p8.