Xinyue Yang | Word to World

„Word to World“ uses new technologies such as speech recognition and natural language processing to transform spoken words into dynamic visual worlds in real time. Narrating – now with the computer as listener and visualizer – shows the possibility of a playful collaboration between human and machine. The complexity of the project consisted in the transformation of linguistic information into the properties of a three-dimensional „world“. Narrative factors had to be translated into camera movements, physics simulations and corresponding movements or 3D animations.