Playing with language in a virtual world: The MUSE Project

I was recently taking a look at this project by the University of Leuven in Belgium called the Machine Understanding for Interactive Storytelling (MUSE) project, in which written text is converted into 3D virtual worlds, “a way of bringing text to life”. The research team has created this tool to teach computers how to understand human language. So far, they have been testing children’s stories and medical applications which the machine translates into images. MUSE’s project could give rise to very promising applications. For example, they would enable people to understand complex instructions or medical treatments.

You can read more in the sources below, but you can start “playing” with this technology and create a 3D demo. Very easy to use here: http://glenda.cs.kuleuven.be/muse_demon/#/children-story

Sources and further reading:

  1. MUSE official page.
  2. Would you like to draw by just using words? This project is part of the FETFX, or FET research. You can take a look at their other AI projects by clicking here.
  3. Watch this presentation recorded during the 2016 Translating Europe Forum given by Marie Francie Moens about Deep Learning for Machine Translation and Machine Understanding. (start at 3 h, 15 min to skip other presentations).

Leave a Reply

Your email address will not be published.