CLARIN-NL - querying

Tool status

published

Input Language

Dutch

English

German

Access Contact

/mailto:servicedesk@ivdnt.org/

Institute for the Dutch Language

Project Contact

/mailto:-/

Creator Contact

Carole Tiberius

Institute for the Dutch Language

Documentation

WebCelex help facility

Source code

not specified

Resource

CMDI File Link

License

other

Inventory Scope

local

GrETEL 4.0

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

GrETEL Search Engine for Querying Syntactic Constructions in Treebanks

Description

GrETEL Version 4 extends the functionality of GrETEL in a number of ways: (1) it allows uploading one's own corpus, either a parsed corpus in LASSY DTD format, or a text corpus in a variety of formats (currently supported: plain text, CHAT; FoLiA and TEI to follow). An uploaded unparsed corpus will be automatically parsed by Alpino and made available in the search interface. (2) It also enables upload of metadata that are contained in the data, e.g. in accordance with the PaQu metadata format (3) Checking of XPath expressions and suggestions for selecting valid attributes and values have been added, as have the use of macros (a la PaQu) (4) filtering on the basis of metadata has been made possible (5) full analysis of the metadta in combination with nodes and their properties from the syntactic structures is available, allowing a user to select, group, sort, and filter data and metadata in combination, through a pivot table with draggable attributes and node properties. Sums , counts, heatmaps and other graphical visualisation enable rapid analysis of the data. GrETEL 4 is being developed by Utrecht University (UiL-OTS and Digital Humanities Lab) in the context of the AnnCor and CLARIAH-CORE projects. It based on GrETEL 3 developed by KU Leuven. GrETEL is a query engine in which linguists can use a natural language example as a starting point for searching a treebank with limited knowledge about tree representations and formal query languages. Instead of a formal search instruction, it takes a natural language example as input. This provides a convenient way for novice and non-technical users to use treebanks with a limited knowledge of the underlying syntax and formal query languages. By allowing linguists to search for constructions similar to the example they provide, it aims to bridge the gap between descriptive-theoretical and computational linguistics. The example-based query procedure consists of six steps. In the first step the user enters an example of the construction he/she is interested in. In the second step the example sentence is automatically parsed with the Alpino parser, resulting in a parse tree. In the third step the example is returned in the form of a matrix, in which the user specifies which aspects of this example are essential for the construction under investigation. Based on the information indicated in the matrix, a query tree is cut out of the initial parse tree and automatically converted to an XPath query. By clicking the advanced options button, the XPath query is made visible, and can be edited if desired. This query will be used for the actual treebank search. In the fourth step the user can select which treebank needs to be queried. The fifth step provides an overview of the search instruction, i.e. the input sentence, the selected treebank(s), the query tree and the (adapted) XPath query. In the sixth step the query is executed on the selected corpus. The matching constructions are presented to the user as a list of sentences, which can be downloaded. The user can also click on the sentences in order to visualize the results as syntax trees. In addition to the example-based search functionality, users can also query the treebanks using an XPath expression. This query is then processed in the same way as the automatically generated query in the example-based approach.

Project

AnnCor

CLARIAH-CORE

CLARIN National Project

CLARIAH-CORE

CLARIN centre

none yet

Research domain

Linguistics

Linguistic Subject

Syntax

Morpho-syntax

Tool task

corpus searching

querying

corpus processing

parsing

dependency parsing

grammatical relation assignment

analysis

Country

Netherlands

Tool Type

web application

Research Phase

Data analysis

Enriching Data

Tool status

alpha

Input format

text/xml

text/plain

Output format

text/xml

Input Language

Dutch

Version

4.0

Access Contact

Jan Odijk

Project Contact

Jan Odijk

Creator Contact

Jan Odijk

Martijn van der Klis

Sheean Spoel

Gerson Foks

Documentation

Source code

https://github.com/UUDigitalHumanitieslab/gretel

https://github.com/UUDigitalHumanitieslab/GrETEL-upload

Original source

Publications

Augustinus, L, Vandeghinste, V, Schuurman, I and Van Eynde, F. 2017. GrETEL: A Tool for Example-Based Treebank Mining. In: Odijk, J and van Hessen, A. (eds.) CLARIN in the Low Countries, Pp. 269–280. London: Ubiquity Press. DOI: https://doi.org/10.5334/bbi.22. License: CC-BY 4.0

Jan Odijk, Martijn van der Klis and Sheean Spoel. 2018. Extensions to the GrETEL Treebank Query Application, in Proceedings of TLT16, 23-24 Jan 2018, Prague, Czech Republic

Resource

CMDI File Link

License

CC-BY-NC-SA

Inventory Scope

local

GrETEL 3.0

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

GrETEL Search Engine for Querying Syntactic Constructions in Treebanks

Description

GrETEL is a query engine in which linguists can use a natural language example as a starting point for searching a treebank with limited knowledge about tree representations and formal query languages. Instead of a formal search instruction, it takes a natural language example as input. This provides a convenient way for novice and non-technical users to use treebanks with a limited knowledge of the underlying syntax and formal query languages. By allowing linguists to search for constructions similar to the example they provide, it aims to bridge the gap between descriptive-theoretical and computational linguistics. The example-based query procedure consists of six steps. In the first step the user enters an example of the construction he/she is interested in. In the second step the example sentence is automatically parsed with the Alpino parser, resulting in a parse tree. In the third step the example is returned in the form of a matrix, in which the user specifies which aspects of this example are essential for the construction under investigation. Based on the information indicated in the matrix, a query tree is cut out of the initial parse tree and automatically converted to an XPath query. By clicking the advanced options button, the XPath query is made visible, and can be edited if desired. This query will be used for the actual treebank search. In the fourth step the user can select which treebank needs to be queried. The fifth step provides an overview of the search instruction, i.e. the input sentence, the selected treebank(s), the query tree and the (adapted) XPath query. In the sixth step the query is executed on the selected corpus. The matching constructions are presented to the user as a list of sentences, which can be downloaded. The user can also click on the sentences in order to visualize the results as syntax trees. In addition to the example-based search functionality, users can also query the treebanks using an XPath expression. This query is then processed in the same way as the automatically generated query in the example-based approach. GrETEL enables search in several Dutch treebanks: the 1-million word LASSY-Small (written Dutch) and CGN treebanks (spoken Dutch), and the 500-million word SoNaR-500 treebank (written Dutch).

Project

SCATE

CLARIN National Project

CLARIN-DLU

CLARIN centre

none yet

Research domain

Linguistics

Linguistic Subject

Syntax

Morpho-syntax

Tool task

corpus searching

querying

Country

Belgium

Tool Type

web application

Research Phase

Tool status

published

Output format

text/html

Input Language

Dutch

Version

3.0

Access Contact

Project Contact

Vincent Vandeghinste

Creator Contact

Documentation

Source code

not specified

Original source

Publications

http://gretel.ccl.kuleuven.be/project/publications.php

Resource

CMDI File Link

License

CC-BY-NC-SA

Inventory Scope

local

GrETEL 2.0

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

GrETEL Search Engine for Querying Syntactic Constructions in Treebanks

Description

GrETEL is a query engine in which linguists can use a natural language example as a starting point for searching a treebank with limited knowledge about tree representations and formal query languages. Instead of a formal search instruction, it takes a natural language example as input. This provides a convenient way for novice and non-technical users to use treebanks with a limited knowledge of the underlying syntax and formal query languages. By allowing linguists to search for constructions similar to the example they provide, it aims to bridge the gap between descriptive-theoretical and computational linguistics. The example-based query procedure consists of six steps. In the first step the user enters an example of the construction he/she is interested in. In the second step the example sentence is automatically parsed with the Alpino parser, resulting in a parse tree. In the third step the example is returned in the form of a matrix, in which the user specifies which aspects of this example are essential for the construction under investigation. In the fourth step the user can select which treebank needs to be queried. The fifth step provides an overview of the search instruction, i.e. the subpart of the parse tree that contains the elements relevant for the construction under investigation. This query tree is automatically converted in an XPath query which can be used for the actual treebank search. In the advanced search mode, the XPath query is made visible, and can be edited if desired. In the sixth step the query is executed on the selected corpus. The matching constructions are presented to the user as a list of sentences, which can be downloaded. The user can also click on the sentences in order to visualize the results as syntax trees. In addition to the example-based search functionality, users can also query the treebanks using an XPath expression. This query is then processed in the same way as the automatically generated query in the example-based approach. GrETEL 2.0 enables search in two Dutch treebanks: the 1-million word LASSY-Small (written Dutch) and CGN treebanks (spoken Dutch).

Project

GrETEL 2.0

CLARIN National Project

CLARIN-DLU

CLARIN centre

none yet

Research domain

Linguistics

Linguistic Subject

Syntax

Morpho-syntax

Tool task

corpus searching

querying

Country

Belgium

Tool Type

web application

Research Phase

Tool status

superseded

Output format

text/html

Input Language

Dutch

Version

2.0

Access Contact

Project Contact

/mailto:liesbeth.augustinus@kuleuven.be/

Creator Contact

Documentation

Source code

not specified

Original source

Publications

http://gretel.ccl.kuleuven.be/project/publications.php

Resource

CMDI File Link

License

CC-BY-NC-SA

Inventory Scope

local

GrETEL 1.0

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

GrETEL Search Engine for Querying Syntactic Constructions in Treebanks

Description

GrETEL is a query engine in which linguists can use a natural language example as a starting point for searching a treebank with limited knowledge about tree representations and formal query languages. Instead of a formal search instruction, it takes a natural language example as input. This provides a convenient way for novice and non-technical users to use treebanks with a limited knowledge of the underlying syntax and formal query languages. By allowing linguists to search for constructions similar to the example they provide, it aims to bridge the gap between descriptive-theoretical and computational linguistics. The example-based query procedure consists of several steps. In the first step the user enters an example of the construction he/she is interested in. In the second step the example is returned in the form of a matrix, in which the user specifies which aspects of this example are essential for the construction under investigation. The third step provides an overview of the search instruction, i.e. the subpart of the parse tree that contains the elements relevant for the construction under investigation. This query tree is automatically converted in an XPath query which can be used for the actual treebank search. This query can be edited if desired. In the fourth step the query is executed on the selected corpus. The matching constructions are presented to the user as a list of sentences, which can be downloaded. The user can also click on the sentences in order to visualize the results as syntax trees. GrETEL enables search in the LASSY-SMALL and the CGN (Spoken Dutch Corpus) Treebanks (1 million tokens each). GrETEL was created by CLARIN Dutch Language Union in Flanders in the context of the CLARIN-NL / CLARIN Flanders cooperation project.

Project

Nederbooms

CLARIN National Project

CLARIN-DLU

CLARIN centre

none yet

Research domain

Linguistics

Linguistic Subject

Syntax

Morpho-syntax

Tool task

corpus searching

querying

Country

Belgium

Tool Type

web application

Research Phase

Tool status

superseded

Output format

text/html

Input Language

Dutch

Version

1.0

Access Contact

Project Contact

/mailto:liesbeth.augustinus@kuleuven.be/

Creator Contact

Documentation

Source code

not specified

Original source

Publications

Liesbeth Augustinus, Vincent Vandeghinste, and Frank Van Eynde (2012). "Example-Based Treebank Querying" In: Proceedings of the 8th International Conference on Language Resources and Evaluation (LREC-2012). Istanbul, Turkey. pp. 3161-3167

http://gretel.ccl.kuleuven.be/project/publications.php

Resource

CMDI File Link

License

CC-BY-NC-SA

Inventory Scope

local

Corpus Studio Web

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

Corpus Studio Web

Description

Summary CorpusStudio is a web application that facilitates in-depth quantitative syntactic research for linguists. Background CorpusStudio is a web application that facilitates in-depth quantitative syntactic research for linguists. It does so by supporting researchers in writing queries that operate on syntactically parsed text corpora in a number of major xml formats. Queries that belong together are kept in xml documents that are called ‘Corpus Research Projects’ (CRPs). These documents contain the queries, the order in which they are to be executed, meta-information about the queries and the project as a whole, as well as a specification of the input used for the project. The use of CRPs helps improve the replicability of corpus research. Access Any CLARIN-NL user can access the CorpusStudio web application and make use of the 'standard' corpora. New users must provide a login name and password, after which they can make use of the application. Adaptable The CorpusStudio code is open-source. Users can take the code, adapt it and use it for their own purposes. Users can also take the code from GitHub as it is, but build their own server in order to run the application on their own text-corpora. User documentation and an API are available (see below). The current version of CorpusStudio supports xml text corpora in the FoLiA and Psdx formats. Extensions to other xml formats are possible. CrpxProcessor provides the basic functionality and is on github on https://github.com/ErwinKomen/CrpxProcessor. CrppServer takes care of /crpp and uses CrpxProcessor. It is on GitHub on https://github.com/ErwinKomen/CrppServer. CrpStudio is on https://github.com/ErwinKomen/CrpStudio, takes care of /crpstudio and uses CrpxProcessor. Main features Keep all important aspects of a research project in one file Define one or more search queries in a hierarchy Uses w3c developed Xquery and Xpath Integrated CorpusStudio-specific Xquery functions User-definable functions and variables Create corpus result databases with user-definable features accompanying each hit Divide the output into calculatable categories Divide the results into meta-data-dependent groups Parallel processing yields a speed-up of a factor 20-100 compared to the Windows version Compatibility with the Windows programs "Cesax" and "CorpusStudio" Limitations and future developments Current limitations to the program include: working with result database, restricted login system, no document view, grouping is restricted to system-defined groups, no query or project wizard. Although the CLARIN-NL project has stopped in December 2015, every effort will be undertaken to make sure that a number of essential features are going to be added.

Project

Corpus Studio Web

CLARIN National Project

CLARIN-NL

CLARIN centre

Meertens/HuC

Research domain

Linguistics

Linguistic Subject

Syntax

Morpho-syntax

Tool task

corpus searching

querying

Country

Netherlands

Tool Type

web application

Research Phase

Komen, Erwin R. 2015. "Corpus Studio: the web application". User documentation. version 1.7. Meertens Instituut, Amsterdam.

Data analysis

Tool status

published

Output format

text/csv

Input Language

Language independent

Access Contact

Erwin Komen

Project Contact

Erwin Komen

Creator Contact

Erwin Komen

Documentation

Komen, Erwin R. 2016. "An API for the CorpusStudio web application". version 1.3. Meertens Instituut, Amsterdam.

Source code

https://github.com/ErwinKomen/CrpxProcessor

https://github.com/ErwinKomen/CrppServer

https://github.com/ErwinKomen/CrpStudio

Original source

http://portal.clarin.nl/node/4239

Publications

Komen, E. R. 2017. Beyond Counting Syntactic Hits. In: Odijk, J and van Hessen, A. (eds.) CLARIN in the Low Countries, Pp. 259–268. London: Ubiquity Press. DOI: https://doi.org/10.5334/bbi.21. License: CC-BY 4.0

Komen, Erwin R. 2011. Coreferenced corpora for information structure research. In Outposts of Historical Corpus Linguistics: From the Helsinki Corpus to a Proliferation of Resources. (Studies in Variation, Contacts and Change in English 10) Jukka Tyrkkö, Terttu Nevalainen, Matti Rissanen & Matti Kilpiö (eds). Helsinki, Finland: Research Unit for Variation, Contacts, and Change in English.

Komen, Erwin R. 2013. Finding focus: a study of the historical development of focus in English. Utrecht: LOT.

Komen, Erwin R. 2013. Corpus databases with feature pre-calculation. In Proceedings of the twelfth workshop on treebanks and linguistic theories (TLT12). Sandra Kübler, Petya Osenova & Martin Volk (eds), 85-96. Sofia, Bulgaria: The institute of information and communication technologies, Bulgarian academy of sciences.

Resource

CMDI File Link

License

unknown

Inventory Scope

local

ePistolarium

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

ePistolarium: A Web-based Humanities’ Collaboratory on Correspondences

Description

Circulation of Knowledge and Learned Practices in the 17th-century Dutch Republic (CKCC) investigates the circulation of knowledge in the 17th-century Dutch Republic. A multi-disciplinary project team consisting of historians, literature researchers, linguists and computer scientists works together in this project and created a web-based Humanities’ Collaboratory on Correspondences. This project, is carried out thanks to a NWO Medium investment subsidy and with CLARIN subsidies to make the resources available withing the CLARIN domain. A consortium of Dutch universities and cultural heritage institutions is building a web-based collaboratory (an online space for asynchronous collaboration) around a corpus of 20.000 letters of scholars who lived in the 17th-century Dutch Republic to answer the research question: how did knowledge circulate in the 17th century? Hereto, it will be necessary to analyze this large amount of correspondence systematically. Based on this (extendable) corpus, we will implement a content processing workflow that consists of iterative cycles of conceptual analysis, enrichment with several layers of annotation and visualization. With advice from CLARIN-EU in the first stage of the project a demonstrator was developed which implements techniques of keyword extraction. The second stage consists of evaluating existing more complex tools en techniques that can tackle one or more aspects of the targeted grammatical, content-related, and network complexity analysis, annotation, and visualization. The phase shall identify a set of tools that can be readily utilized in CKCC, as well as tools that need to be adapted or extended to the needs of CKCC; in short, by the end of this phase resources, requirements and risks shall become clear (deadline: December 2010). In the third stage the collaboratory is further developed according to the description in the CKCC project goals, centering around the technique of concept extraction. These three stages constitute the Work Package Analysis Tools, the core of the CKCC project, which was supported by CLARIN-NL. Other Work Packages provide data and software tools needed to create a complete system: the digital corpus of letters (WP6), the editing collaboratory that will contain the letters (WP1), and the archiving environment for data and software (WP2).

Project

CKCC

CLARIN National Project

CLARIN-NL

CLARIN centre

Huygens ING

Research domain

Cultural Sciences

History

Tool task

corpus searching

querying

Country

Netherlands

Tool Type

web application

Research Phase