CLARIN-NL - evaluation

TQE

root — Mon, 08 Apr 2019 08:38:55 +0000

Title

TQE: Transcription Quality Evaluation

Description

The Transcription Quality Evaluation (TQE) tool is an instrument that automatically evaluates the quality of phonetic transcriptions. The application makes it possible to upload pairs of files consisting of an audio file and a transcription file and process them as follows: the audio signal and the phonetic transcription are aligned, segment boundaries are derived for each phone, and for each segment-phone combination it is determined how well they fit together, i.e. for each phone a TQE measure (a confidence measure) is determined, a number ranging from 0-100%, indicating how good the fit is, i.e. the quality of the phone transcription. The higher the number, the better the fit. The output of the TQE tool consists of a TQE measure and the segment boundaries for each phone in the corpus. The TQE tool thus makes it possible to find (sequences of) segments for which the match of the phone symbols with the audio signal is not optimal, in other words, the TQE tool can be used to check the quality of phonetic transcriptions. This can be useful for validating (manual) phonetic transcriptions, but also to compare and select (‘competing’) transcriptions, e.g. to study pronunciation variation. The TQE tool can thus be usefully applied in all research – in various (sub-) fields of humanities and language and speech technology (L&ST) – in which audio and phonetic transcriptions are involved.

Project

TQE

CLARIN National Project

CLARIN-NL

CLARIN centre

MPI for Psycholinguistics

Country

Netherlands

Tool Type

web application

Research Phase

Enriching Data

Tool status

published

Input format

audio/wav

text/plain

Output format

text/plain

Input Language

English

Access Contact

Project Contact

Dr. H. Strik

Creator Contact

Dr. H. Strik

Documentation

Manual

Source code

not specified

Original source

http://portal.clarin.nl/node/1912

Resource

CMDI File Link

License

unknown

Inventory Scope

local

Nederlab

Erica Renckens — Mon, 10 Aug 2015 08:07:39 +0000

Nederlab, online laboratory for humanities research on Dutch text collections

Summary

A user-friendly and tool-enriched open access web interface that that aims at containing all digitized texts relevant for the Dutch national heritage and the history of Dutch language and culture (c. 800 - present).

Background

The Nederlab project aims to bring together all digitized texts relevant to Dutch national heritage, the history of Dutch language and culture (c. 800 - present) in one user-friendly and tool-enriched open access web interface, allowing scholars to simultaneously search and analyze data from texts spanning the full recorded history of the Netherlands, its language and culture. The project builds on various initiatives: for corpora Nederlab collaborates with the scientific libraries and institutions, for infrastructure with CLARIN (and CLARIAH), for tools with eHumanities programmes such as Catch, IMPACT and CLARIN (TICCL, frog).
Nederlab will offer a large number of search options with which researchers can find the occurrence of a particular term in a particular corpus or subcorpus. It'll also offer visualization of search results through line graphs, bar graphs, circle graphs, or scatter graphs. Furthermore, this online lab will offer a large set of tools, like tokenization tools, tools for spelling normalization, PoS-tagging tools, lemmatization tools, a computational historical lexicon and indices. Also, the use of (semi-) automatic syntactic parsing, tools for text mining, data mining and sentiment mining, Named Entity Recognition tools, coreference resolution tools, plagiarism detection tools, paraphrase detection tools and cartographical tools is offered
The first version of Nederlab was launched in early 2015, it’ll be expanded until the end of 2017. Nederlab is financed by NWO, KNAW, CLARIAH and CLARIN-NL.

Contacts

Project leader:  prof. dr. Hans Bennis, Meertens Institute
CLARIN center: Meertens Institute
Help contact: hennie.brugman@meertens.knaw.nl

Links

Web-sites: http://www.nederlab.nl/
User scenario's (screencasts, screenshots): n.a.
Manual: http://www.nederlab.nl/onderzoeksportaal/?action=help
Tool/Service link: http://www.nederlab.nl/onderzoeksportaal/
Publications: http://www.nederlab.nl/wp/?page_id=12

Research domain

Cultural Sciences

History

Linguistics

Language

Dutch

Resource tags

data

corpus

text corpus

service

web-application

mono-lingual

Tool task

semantic registry & mapping

analysis

evaluation

annotation

corpus exploration

browse

visualisation

text processing

POS tagging

multiword unit identification

lemmatisation

parsing

co-reference assignment

tokenization

CLARIN centre

Meertens/HuC

Country

Netherlands

TQE

root — Sun, 20 Apr 2014 13:45:49 +0000

TQE: Transcription Quality Evaluation

Summary

The Transcription Quality Evaluation tool can be used to check the quality of phonetic transcription. The only thing the researcher has to do is upload pairs of files consisting of an audio file and a transcription file. After uploading he’ll receive an e-mail with the matching output.

Background

The Transcription Quality Evaluation (TQE) tool is an instrument that automatically evaluates the quality of phonetic transcriptions. The application makes it possible to upload pairs of files consisting of an audio file and a transcription file and process them as follows: the audio signal and the phonetic transcription are aligned, segment boundaries are derived for each phone, and for each segment-phone combination it is determined how well they fit together, i.e. for each phone a TQE measure (a confidence measure) is determined, a number ranging from 0-100%, indicating how good the fit is, i.e. the quality of the phone transcription. The higher the number, the better the fit. The output of the TQE tool consists of a TQE measure and the segment boundaries for each phone in the corpus.
The TQE tool thus makes it possible to find (sequences of) segments for which the match of the phone symbols with the audio signal is not optimal, in other words, the TQE tool can be used to check the quality of phonetic transcriptions. This can be useful for validating (manual) phonetic transcriptions, but also to compare and select (‘competing’) transcriptions, e.g. to study pronunciation variation. The TQE tool can thus be usefully applied in all research – in various (sub-) fields of humanities and language and speech technology (L&ST) – in which audio and phonetic transcriptions are involved.

Contacts