Vigo International Journal of Applied Linguistics VIAL

Carles Fernández, Xavier Rocai (1), Jordi González (2): Providing Automatic Multilingual Text Generation to Artificial Cognitive Systems. VIAL. Number 5/2008: 37-62.


This contribution addresses the incorporation of a module for advanced user interaction into an artificial cognitive vision system to include the human-in-the-loop. Specifically, the document describes a method to automatically generate natural language textual descriptions of meaningful events and behaviors, in a controlled scenario. One of the goals of the system is to be capable of producing these descriptions in multiple languages. We will introduce some relevant stages of the whole system, and concentrate on the linguistic aspects which have been taken into account to derive final text from conceptual predicates. Some experimental results are provided for the description of simple and complex behaviors of pedestrians in an intercity crosswalk, for Catalan, English, Italian, and Spanish.

Keywords: natural language generation, behavior analysis, multilingual generation, human sequence evaluation, artificial cognitive system.

(1) Computer Vision Centre, Universitat Autónoma de Barcelona, Spain
(2) Institut de Robótica i Informática Ind. Universitat Politécnica de Catalunya,Spain

Back to Contents of Number 5

Download full text of this article in pdf format