Vigo International Journal of Applied Linguistics VIAL

Carlos Periñán-Pascual (1) and Ricardo Mairal-Usón (2). A framework of analysis for the evaluation of automatic term extractors. VIAL Number 15/2018: 105-125.


Following previous research on automatic term extraction, the primary aim of this paper is to propose a more robust and consistent framework of analysis for the comparative evaluation of term extractors. Within the different views for software quality outlined in ISO standards, our proposal focuses on the criterion of external quality and in particular on the characteristics of functionality, usability and efficiency together with the subcharacteristics of suitability, precision, operability and time behavior. The evaluation phase is completed by comparing four online open-access automatic term extractors: TermoStat, GaleXtract, BioTex and DEXTER. This latter resource forms part of the virtual functional laboratory for natural language processing (FUNK Lab) developed by our research group. Furthermore, the results obtained from the comparative analysis are discussed.

Keywords: corpus, terminology, software evaluation, ISO, DEXTER

(1) Universitat Politècnica de València, Spain.
(2) UNED, Madrid Spain.

Back to Contents of Number 15

Download full text of this article in pdf format