Skip to Main content Skip to Navigation

Ancrage d'un lexique partagé entre robots autonomes dans un environnement non-contraint

Abstract : The Talking Heads is a developmental robotics experiment conducted by Luc Steels and Frederic Kaplan in 1995, at Sony CSL lab. In this experiment, agents acquire a shared grounded lexicon of words associated with visual properties of objects in their environnement through language game interactions. The grounding of symbols in the agent's perception is ensured by the way the interactions are designed, thus providing an answer to the grounding problem formulated by Brooks and others, illustrated by the Chinese room experiment. The Talking Heads are also capable of building a shared lexicon with a population of thousands of agents in an unsupervised way. They implement a model of how a language could emerge in a population of agents capable of communication. This experiment has been extended in multiple areas : the lexicon has been extended with a grammar, and the static environnement has been modified to include scenes with moving objects. Yet the limited environnement is now limiting some interesting extensions of these experiments. The aim of this thesis is to reimplement the Talking Heads using autonomous robots and using an unconstrained environment: our laboratory. This would first show that the Talking Heads models are able to scale to a more complex environment, and allow the development of future experiments with more complex cognitive models giving more autonomy to the agents and that would require this richer environnement. We first focus on the new problems introduced by mobile robots: the detection of an other robot, the problem of positionning a robot, and the problem of pointing a region of the environnement to another robot. We then explore a first model using image segmentation algorithms to stay very close to the original Talking Heads, and show why this model is failing to obtain lexicon convergence between the agents. We finally introduce a second model using the state of the art in the object detection field to build object models based on the detection of recurring patterns in the environnement. We first show that this model can successfully be used for classification tasks on object databases, then apply it to the Talking Heads setup. Our results show that the agents are able to exchange symbols associated with regions of their environnement, although the overall game success rate stays low.
Document type :
Complete list of metadata

Cited literature [71 references]  Display  Hide  Download
Contributor : Ecole ENSTA ParisTech Connect in order to contact the contributor
Submitted on : Thursday, July 21, 2011 - 2:55:13 PM
Last modification on : Wednesday, May 11, 2022 - 12:06:05 PM
Long-term archiving on: : Friday, December 2, 2016 - 11:38:06 AM


  • HAL Id : pastel-00004260, version 1


Matthieu Nottale. Ancrage d'un lexique partagé entre robots autonomes dans un environnement non-contraint. Informatique. Université Pierre et Marie Curie - Paris VI, 2008. Français. ⟨pastel-00004260⟩



Record views


Files downloads