Robots to engage in communicative behaviours with humans!

The EU project – What You Say Is What You Did – studies how to teach robots to build a narrative self and communicate with humans!

Personal robots in homes and their integration in everyday life will be a major breakthrough of the 21st century. Yet, to realize this vision, important obstacles need to be overcome: these robots will have to act in unpredictable environments including homes and learn new skills while interacting with humans. Intelligent artifacts and robots are expected to operate in complex physical and social environments. The deployment of service and companion robots, however, requires that humans and robots can understand each other and can communicate.iCub_object_MariaThe goal of the Eu project WYSIWYD  is to be able to contribute to a qualitative change in human-robot interaction and cooperation (HRI)  and scientists are working towards advancing a robot’s ability to engage in communicative behaviours with humans.

By allowing robots to both understand their own actions and those of humans, will unable the interpretation and communication of the robot “understanding” into human compatible intentional terms. This is expressed as a language-like communication channel called “WYSIWYD Robotese” (WR). The WYSIWYD project will advance this critical communication channel following a biologically and psychologically grounded developmental perspective allowing the robot to acquire, retain and express WR dependent on its individual interaction history or “narrative”.


An integrated architecture to improve communication in HRI

To achieve transparency and communication in HRI a number of elements must be put in place: a well defined experimental paradigm, an integrated architecture for perception, cognition, action and intrinsic motivation that, among other things, provides the backbone for the acquisition of an autonomous communication structure, the WR-DAC architecture

WYSIWYD aims to contribute to a qualitative change in human-robot interaction (HRI) and cooperation, unlocking new capabilities and application areas together with enhanced safety, robustness and monitoring.

Project reviewed with excellence !

The Eu project WYSIWYD, coordinated by ICREA Prof. Paul Verschure director of the SPECS lab at UPF, has reached its 2nd year with a very positive report by the Eu project reviewers and has passed its 2nd review with excellent!

The yearly review meeting took place on the 19th of March and was hosted by the INSERM group in Lyon.  for more information on the project and more recent video see

Share this article:

    Living Machines 2016

    POSTER LM2016_OKcut

    The 5th International Conference on Biomimetic and Biohybrid Systems will be held this year in beautiful Edinburgh, Scotland,18 -22 July. The three-day event, organised by the Convergent Science Network, will be hosted at a fantastic venue consistent with the spirit of the conference, the Dynamic Earth: a 5 stars visitor experience with incredible interactive technology to learn about natural events and much more….

    Continue reading

    Share this article:

      Here Space of Memory: Conserving, Presenting and Elaborating the Memory of the Holocaust

      blog by Paul Verschure [@Paul.Verschure]

      Soon after liberation, camp survivors await their ration of potato soup. Bergen-Belsen, Germany, April 28, 1945. — US Holocaust Memorial Museum

      Soon after liberation, camp survivors await their ration of potato soup. Bergen-Belsen, Germany, April 28, 1945.
      — US Holocaust Memorial Museum

      “Wir wissen nur dass wenn wir hier rauskommen, das wir alles dass wir hier erlebt haben in die Welt hinaus schreien müssen, anders kann man nicht leben”

      “We only know that when we get out of here, we must shout out into the world about everything that we have experienced here. Otherwise one cannot live.”

      These are the words of Charlotte Grunow recorded on April 20, 1945 by BBC reporter Patrick Gordon Walker.

      Continue reading

      Share this article:

        New survey on public attitudes towards robots: comfortable or confused?

        Article by Michael Szollosy

        SO, the British Science Association has released a survey on the British public’s attitudes toward robotics and AI. Their headlines:

        BSA w headline

        • 60% of people think that the use of robots or programmes equipped with artificial intelligence (AI) will lead to fewer jobs within ten years
        • 36% of the public believe that the development of AI poses a threat to the long term survival of humanity.

        Some other highlights: Continue reading

        Share this article:

          Raising the bar on AI


          Article by Michael Szollosy


          Go game. (Credit: Nature / Google DeepMind)

          So the media last week was absolutely full of the latest Sure Sign that the robocalypse is immanent: apparently, Google-backed DeepMind have now managed to create an AI so very sophisticated that it has beat human champions at the ancient Chinese board-game of Go. DeepMind’s AlphaGo has defeated the European champion, which marks another important development in the progress of AI research, trumping IBM DeepBlue’s victory over Gary Kasparov at chess back in 1997: Go is, apparently, a much more difficult game for humans – and, it was thought, for computers – to master, due to its complexity and the need for players to recognise complex patterns. Continue reading

          Share this article:

            A brain for a foraging robot

            sf_rabams_uva_web An animal survival depends on its ability to find resources in the surrounding environment, in other words in its foraging strategies.

            According to Prof. Paul Verschure and his Distributed Adaptive Control theory of mind and brain DAC, when foraging and hoarding, animals behave according to 5 top-level objectives called: “how”, “why”, “what”, “where” and “when” or the so called H4W problem (Verschure, 2012). This form of complex behavior includes: to learn where and when to look for  resources, what to look for, where and when to return to the home base, how  to avoid obstacles and how to act in order to satisfy internal needs.

            But how does the brain organization and underlying neural principles account for these complex behaviors? Continue reading

            Share this article:

              An ecology of robots built using principles of biomimetics

              More then ever scientists are using a nature-inspired approach to build biomimimetic robots. Developed after through investigation of biological systems, these robots are a wonder of engineering and artificial intelligence research.


              Robotic Lobster by Prof. Josef Ayers at Northeastern University. Photography Jan Witting

              Continue reading

              Share this article:

                Mind and Brain experts meet in Woods Hole to discuss large scale integration

                IMG_2 “We are coming to an era where one of the most urgent challenges in neuroscience is the problem of large scale integration”.

                Large-scale simulations of the brain in silico, sometimes using robotics, can be useful, but they are only meaningful if built upon a solid understanding of brain regions. “We need to know the specific interactions between brain regions and we need know the control signals involved. We need to know how the brain functions as a whole”, comments ICREA Prof, Paul Verschure from UPF Barcelona, with Prof. John Lisman from Brandeis UniversityContinue reading

                Share this article: