Dies ist das Newsblog des Sprachwissenschaftlichen Instituts an der Ruhr-Universität Bochum.





Ruhr-Universität Bochum
Sprachwissenschaftliches Institut



Powered by PivotX - 2.3.11 
XML-Feed (RSS 1.0) 
XML: Atom Feed 

« KONVENS 2016 in Bochu… | home | Vortrag von Lewis Bot… »

Vortrag von Grzegorz Chrupała am Dienstag, 25.10.2016 (16:00 Uhr - GB 3/159)

Mittwoch, 05. Oktober 2016. Aus der Kategorie 'Vortragsreihe'.

Das Sprachwissenschaftliche Institut lädt herzlich ein zu dem Vortrag von

Grzegorz Chrupała (Universität Tilburg)

Representations of language in visually grounded neural models.

The task of learning language in a visually-grounded setting, with weak and noisy supervision, is of interest to scientists trying to understand the human mind as well as to engineers trying to build smart conversational agents or robots. In this talk I present models of grounded language learning based on recurrent neural networks which learn language from sentences paired with images of corresponding visual scenes. Input sentences are given at different levels of granularity: as sequences of words, sequences of phonemes, or as an acoustic signal.

I evaluate the internal representations induced by the models in these scenarios and present quantitative and qualitative analyses of their characteristics. I show how they encode language form and function, and specifically how they are selectively sensitive to certain aspects of language structure such as word boundaries, lexical categories and grammatical functions.