Magic Surfaces


Ubiquitous computing is a concept where computing is thought to be omnipresent, effectively "invisible", so that humans and computers are brought together in a seamless way. The progress of hardware and software technologies make it compelling to investigate innovative possibilities of interaction with computers.
We are exploring novel forms of interaction in interactive installations that use portable and low cost equipment. The Magic Surface is a system that transforms a regular surface (such as a wall or a tabletop) into a multitouch interactive space. The Magic Surface detects touch of hand fingers, colored pens and eraser. It also supports the usage of a magic wand for 3D interaction. The Magic Surface can run applications, allowing the transformation of a regular surface into an interactive drawing area, a map explorer, a 3D simulator for navigation in virtual environments, among other possibilities. Areas of application range from education to interactive art and entertainment. The setup of our prototype includes: a Microsoft Kinect sensor, a video projector and a personal computer.

Code

The code developed by Alexandre M. S. de Sousa for his masters degree is open source and available on his Github: https://github.com/alemart/mestrado (readme is in Portuguese, but the code is in English).

Videos

You can find videos related to this project on Alexandre's YouTube page.

Papers

5* Magic Wand: An RGBD Camera-Based 5 DoF User Interface for 3D Interaction

5* Magic Wand: An RGBD Camera-Based 5 DoF User Interface for 3D Interaction [pdf]

Alexandre M. F. de Sousa and Carlos H. Morimoto.
Virtual and Augmented Reality (SVR), 2015 XVII Symposium on
Abstract Bibtex
5* Magic Wand: a RGBD camera-based 5 DoF pointing device for 3D interaction

5* Magic Wand: a RGBD camera-based 5 DoF pointing device for 3D interaction [pdf]

Alexandre M. F. de Sousa and Carlos H. Morimoto.
SBC Journal on Interactive Systems
Abstract Bibtex
Tangible Beats: Uma Interface Tangível Para Expressão e Exploração Musical

Tangible Beats: Uma Interface Tangível Para Expressão e Exploração Musical [pdf]

Alexandre M. F. de Sousa and Carlos H. Morimoto.
Proceedings of the 13th Brazilian Symposium on Human Factors in Computing Systems
Abstract Bibtex
Penspective: a Perspective-Aware Game Map Editor with Natural Interaction

Penspective: a Perspective-Aware Game Map Editor with Natural Interaction [pdf]

Alexandre M. F. de Sousa, Anderson C. M. Tavares and Carlos H. Morimoto.
XII Simpósio Brasileiro de Jogos e Entretenimento Digital
Abstract Bibtex