1 |
Grounding Hindsight Instructions in Multi-Goal Reinforcement Learning for Robotics ...
|
|
|
|
BASE
|
|
Show details
|
|
2 |
LipSound2: Self-Supervised Pre-Training for Lip-to-Speech Reconstruction and Lip Reading ...
|
|
|
|
BASE
|
|
Show details
|
|
3 |
Neural Network Learning for Robust Speech Recognition
|
|
Qu, Leyuan. - : Staats- und Universitätsbibliothek Hamburg Carl von Ossietzky, 2021
|
|
BASE
|
|
Show details
|
|
4 |
Towards a self-organizing pre-symbolic neural model representing sensorimotor primitives ...
|
|
|
|
BASE
|
|
Show details
|
|
5 |
Conversational Language Learning for Human-Robot Interaction
|
|
|
|
BASE
|
|
Show details
|
|
6 |
Crossmodal Language Grounding in an Embodied Neurocognitive Model
|
|
|
|
In: Front Neurorobot (2020)
|
|
Abstract:
Human infants are able to acquire natural language seemingly easily at an early age. Their language learning seems to occur simultaneously with learning other cognitive functions as well as with playful interactions with the environment and caregivers. From a neuroscientific perspective, natural language is embodied, grounded in most, if not all, sensory and sensorimotor modalities, and acquired by means of crossmodal integration. However, characterizing the underlying mechanisms in the brain is difficult and explaining the grounding of language in crossmodal perception and action remains challenging. In this paper, we present a neurocognitive model for language grounding which reflects bio-inspired mechanisms such as an implicit adaptation of timescales as well as end-to-end multimodal abstraction. It addresses developmental robotic interaction and extends its learning capabilities using larger-scale knowledge-based data. In our scenario, we utilize the humanoid robot NICO in obtaining the EMIL data collection, in which the cognitive robot interacts with objects in a children's playground environment while receiving linguistic labels from a caregiver. The model analysis shows that crossmodally integrated representations are sufficient for acquiring language merely from sensory input through interaction with objects in an environment. The representations self-organize hierarchically and embed temporal and spatial information through composition and decomposition. This model can also provide the basis for further crossmodal integration of perceptually grounded cognitive representations.
|
|
Keyword:
Neuroscience
|
|
URL: https://doi.org/10.3389/fnbot.2020.00052 http://www.ncbi.nlm.nih.gov/pmc/articles/PMC7591775/
|
|
BASE
|
|
Hide details
|
|
7 |
Incorporating End-to-End Speech Recognition Models for Sentiment Analysis ...
|
|
|
|
BASE
|
|
Show details
|
|
8 |
Towards Dialogue-based Navigation with Multivariate Adaptation driven by Intention and Politeness for Social Robots ...
|
|
|
|
BASE
|
|
Show details
|
|
9 |
GradAscent at EmoInt-2017: Character- and Word-Level Recurrent Neural Network Models for Tweet Emotion Intensity Detection ...
|
|
|
|
BASE
|
|
Show details
|
|
10 |
Syntactic Reanalysis in Language Models for Speech Recognition
|
|
|
|
In: 2017 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob) ; https://hal.inria.fr/hal-01558462 ; 2017 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob), Sep 2017, Lisbon, Portugal ; http://icdl-epirob.org/ (2017)
|
|
BASE
|
|
Show details
|
|
11 |
Interactive Natural Language Acquisition in a Multi-modal Recurrent Neural Architecture ...
|
|
|
|
BASE
|
|
Show details
|
|
12 |
Recurrent Neural Network for Syntax Learning with Flexible Predicates for Robotic Architectures
|
|
|
|
In: The Sixth Joint IEEE International Conference Developmental Learning and Epigenetic Robotics (ICDL-EPIROB) ; https://hal.inria.fr/hal-01417697 ; The Sixth Joint IEEE International Conference Developmental Learning and Epigenetic Robotics (ICDL-EPIROB), Sep 2016, Cergy, France ; http://icdl-epirob.org/ (2016)
|
|
BASE
|
|
Show details
|
|
13 |
Semantic Role Labelling for Robot Instructions using Echo State Networks
|
|
|
|
In: European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (ESANN) ; https://hal.inria.fr/hal-01417701 ; European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (ESANN), Apr 2016, Bruges, Belgium ; https://www.elen.ucl.ac.be/esann/index.php?pg=esann16_programme (2016)
|
|
BASE
|
|
Show details
|
|
14 |
Using Natural Language Feedback in a Neuro-inspired Integrated Multimodal Robotic Architecture
|
|
|
|
In: 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN) ; https://hal.inria.fr/hal-01417706 ; 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), Aug 2016, New York City, United States. pp.52 - 57, ⟨10.1109/ROMAN.2016.7745090⟩ ; http://www.tc.columbia.edu/conferences/roman2016/ (2016)
|
|
BASE
|
|
Show details
|
|
15 |
Natural language acquisition in recurrent neural architectures ; Erwerb von natürlicher Sprache in rekurrenten neuronalen Architekturen
|
|
Heinrich, Stefan. - : Staats- und Universitätsbibliothek Hamburg Carl von Ossietzky, 2016
|
|
BASE
|
|
Show details
|
|
16 |
A Recurrent Neural Network for Multiple Language Acquisition: Starting with English and French
|
|
|
|
In: Proceedings of the NIPS Workshop on Cognitive Computation: Integrating Neural and Symbolic Approaches (CoCo 2015) ; https://hal.inria.fr/hal-02561258 ; Proceedings of the NIPS Workshop on Cognitive Computation: Integrating Neural and Symbolic Approaches (CoCo 2015), Dec 2015, Montreal, Canada ; http://ceur-ws.org/Vol-1583/ (2015)
|
|
BASE
|
|
Show details
|
|
17 |
Toward a self-organizing pre-symbolic neural model representing sensorimotor primitives
|
|
|
|
BASE
|
|
Show details
|
|
18 |
Toward a self-organizing pre-symbolic neural model representing sensorimotor primitives
|
|
|
|
BASE
|
|
Show details
|
|
|
|