Carlos Hitoshi Morimoto

Faculty Member

Department of Computer Science
Institute of Mathematics and Statistics
University of São Paulo

E-mail: hitoshi @ ime . usp . br

About Me

BSc in Eletronic Engineering from USP (University of São Paulo), MSc in Electric Engineering from USP, and PhD in Computer Science from the University of Maryland at College Park. He is currently an assistant professor at the Department of Computer Science at IME (Instituto de Matemática e Estatística - Institute of Mathematics and Statistics) at USP. His main areas of interest include Computer Vision, Image Processing, and Human Computer Interaction. His projects involve the understanding of human activities using computer vision to enhance human interaction, with focus on person detection, tracking of body, face, and eye movements.

Publications

2024

Detection of visual pursuits using 1D convolutional neural networks [pdf]

Alex Torquato S. Carneiro, Flavio Luiz Coutinho and Carlos H. Morimoto.
Pattern Recognition Letters
Abstract Bibtex

2023

EyePursuitLinks - an Eye-pursuit Based Interface for Web Browsing Using Smart Targets [pdf]

Carneiro, Alex Torquato Souza, Gonzales, Candy Veronica Tenorio and Morimoto, Carlos Hitoshi.
Proceedings of the 29th Brazilian Symposium on Multimedia and the Web
Abstract Bibtex

2022

Online eye-movement classification with temporal convolutional networks [pdf]

Elmadjian, Carlos and Gonzales, Candy and Costa, Rodrigo Lima da and Morimoto, Carlos H..
Behavior Research Methods
Abstract Bibtex

2021

Eye Movement Classification With Temporal Convolutional Networks [pdf]

Elmadjian, Carlos, Gonzales, Candy and Morimoto, Carlos H..
Proceedings of the Workshop on Eye Tracking Techniques, Applications and Challenges
Abstract Bibtex

GazeBar: Exploiting the Midas Touch in Gaze Interaction [pdf]

Elmadjian, Carlos and Morimoto, Carlos H.
Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems
Abstract Bibtex

A Probabilistic Interpretation of Motion Correlation Selection Techniques [pdf]

Velloso, Eduardo and Morimoto, Carlos H.
Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
Abstract Bibtex

HGaze Typing: Head-Gesture Assisted Gaze Typing [pdf]

Feng, Wenxin, Zou, Jiangnan, Kurauchi, Andrew, Morimoto, Carlos H and Betke, Margrit.
ACM ETRA 2021 -- Best Paper Award
Abstract Bibtex

Métodos Experimentais em Interação Humano Computador [pdf]

Morimoto, C. H. and Diaz-Tula, A..
Jornada de Atualização em Informática 2021
Abstract Bibtex

2020

Screen-Light Decomposition Framework for Point-of-Gaze Estimation Using a Single Uncalibrated Camera and Multiple Light Sources [pdf]

Morimoto, Carlos H., Coutinho, Flávio L. and Hansen, Dan W..
Journal of Mathematical Imaging and Vision
Abstract Bibtex

Swipe&Switch: Text Entry Using Gaze Paths and Context Switching [pdf]

Kurauchi, Andrew, Feng, Wenxin, Joshi, Ajjen, Morimoto, Carlos H. and Betke, Margrit.
Adjunct Publication of the 33rd Annual ACM Symposium on User Interface Software and Technology
Abstract Bibtex

2019

xSDL: stroboscopic differential lighting eye tracker with extended temporal support [pdf]

Borsato, Frank H. and Diaz-Tula, Antonio and Morimoto, Carlos H..
Machine Vision and Applications
Abstract Bibtex

Towards a Low Cost and High Speed Mobile Eye Tracker [pdf]

Borsato, Frank H. and Morimoto, Carlos H..
Proceedings of the 11th ACM Symposium on Eye Tracking Research \& Applications
Abstract Bibtex

PursuitPass: A Visual Pursuit-Based User Authentication System [pdf]

Carneiro, A. T. S., Elmadjian, C. E., Gonzalez, C., Coutinho, F. L. and Morimoto, C. H..
Electronic Proceedings of the 31st Conference on Graphics, Patterns and Images (SIBGRAPI'19)
Abstract Bibtex

A Virtual Makeup Augmented Reality System [pdf]

Borges, A. F. S. and Morimoto, C. H..
Electronic Proceedings of the 21st Symposium on Virtual and Augmented Reality (SVR)
Abstract Bibtex

2018

An investigation of the distribution of gaze estimation errors in head mounted gaze trackers using polynomial functions [pdf]

Diako Mardanbegi, Andrew Kurauchi and Carlos Morimoto.
Journal of Eye Movement Research
Abstract Bibtex

3D Gaze Estimation in the Scene Volume with a Head-mounted Eye Tracker [pdf]

Elmadjian, Carlos, Shukla, Pushkar, Tula, Antonio Diaz and Morimoto, Carlos H..
Proceedings of the Workshop on Communication by Gaze Interaction
Abstract Bibtex

Context Switching Eye Typing Using Dynamic Expanding Targets [pdf]

Morimoto, Carlos H., Leyva, Jose A. T. and Diaz-Tula, Antonio.
Proceedings of the Workshop on Communication by Gaze Interaction
Abstract Bibtex

Circular Orbits Detection for Gaze Interaction Using 2D Correlation and Profile Matching Algorithms [pdf]

Velloso, Eduardo, Coutinho, Flavio Luiz, Kurauchi, Andrew and Morimoto, Carlos H.
Proceedings of the 2018 ACM Symposium on Eye Tracking Research \& Applications -- Paper of Note Award
Abstract Bibtex

Asynchronous stroboscopic structured lighting image processing using low-cost cameras [pdf]

Borsato, Frank H. and Morimoto, Carlos H..
Electronic Proceedings of the 31st Conference on Graphics, Patterns and Images (SIBGRAPI'18)
Abstract Bibtex

2017

Building Structured Lighting Applications Using Low-Cost Cameras [pdf]

Borsato, Frank H. and Morimoto, Carlos H..
Electronic Proceedings of the 30th Conference on Graphics, Patterns and Images (SIBGRAPI'17)
Abstract Bibtex

Gaze Interaction Using Low Resolution Images at 5 FPS [pdf]

Elmadjian, C.E.L., Diaz-Tula, A., Aluani, F.O. and Morimoto, C.H..
Electronic Proceedings of the COGAIN 2017 Symposium (COGAIN'17)
Abstract Bibtex

Robust, real-time eye movement classification for gaze interaction using finite state machines [pdf]

Diaz-Tula, A. and Morimoto, C.H..
Electronic Proceedings of the COGAIN 2017 Symposium (COGAIN'17)
Abstract Bibtex

2016

AugKey: Increasing Foveal Throughput in Eye Typing with Augmented Keys [pdf]

Antonio Diaz Tula and Carlos H. Morimoto.
Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems
Abstract Bibtex

EyeSwipe: Dwell-free Text Entry Using Gaze Paths [pdf]

Andrew T. N. Kurauchi, Wenxin Feng, Ajjen Joshi, Carlos H. Morimoto and Margrit Betke.
Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems
Abstract Bibtex

Episcleral Surface Tracking: Challenges and Possibilities for Using Mice Sensors for Wearable Eye Tracking [pdf]

Frank H. Borsato and Carlos H. Morimoto.
Proceedings of the Ninth Biennial ACM Symposium on Eye Tracking Research & Applications
Abstract Bibtex

Heatmap Explorer: an interactive gaze data visualization tool for the evaluation of computer interfaces [pdf]

Antonio Diaz Tula, Andrew T. N. Kurauchi, Flávio L. Coutinho, and Carlos H. Morimoto.
Proc. of the 15th Brazilian Symposium on Human Factors in Computing Systems (IHC'16)
Abstract Bibtex

2015

A Fast and Accurate Eye Tracker Using Stroboscopic Differential Lighting [pdf]

Frank H. Borsato, Fernando O. Aluani and Carlos H. Morimoto.
2015 IEEE International Conference on Computer Vision Workshop (ICCVW)
Abstract Bibtex

HMAGIC: Head Movement and Gaze Input Cascaded Pointing [pdf]

Andrew T. N. Kurauchi, Wenxin Feng, Carlos H. Morimoto and Margrit Betke.
Proceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments
Abstract Bibtex

A mathematical model of saccadic reaction time as a function of the fixation point brightness gain [pdf]

Antonio Diaz Tula, Carlos H. Morimoto and Ronald D. Ranvaud.
Attention, Perception, & Psychophysics
Abstract Bibtex

5* Magic Wand: An RGBD Camera-Based 5 DoF User Interface for 3D Interaction [pdf]

Alexandre M. F. de Sousa and Carlos H. Morimoto.
Virtual and Augmented Reality (SVR), 2015 XVII Symposium on
Abstract Bibtex

5* Magic Wand: a RGBD camera-based 5 DoF pointing device for 3D interaction [pdf]

Alexandre M. F. de Sousa and Carlos H. Morimoto.
SBC Journal on Interactive Systems
Abstract Bibtex

Dynamic and Meta-Context Switching for Gaze-Based Interaction [pdf]

Antonio Diaz Tula and Carlos H. Morimoto.
SBC Journal on Interactive Systems
Abstract Bibtex

2014

Espelho Virtual Interativo Para Simulação De Maquiagem [pdf]

Filipe M. S. de Campos and Carlos H. Morimoto.
Proceedings of the 13th Brazilian Symposium on Human Factors in Computing Systems
Abstract Bibtex

Tangible Beats: Uma Interface Tangível Para Expressão e Exploração Musical [pdf]

Alexandre M. F. de Sousa and Carlos H. Morimoto.
Proceedings of the 13th Brazilian Symposium on Human Factors in Computing Systems
Abstract Bibtex

Meta-keys: Extending the Functionality of Gaze-based Interaction [pdf]

Antonio Diaz Tula and Carlos H. Morimoto.
Proceedings of the 13th Brazilian Symposium on Human Factors in Computing Systems
Abstract Bibtex

Facilitating Accessibility and Digital Inclusion Using Gaze-aware Wearable Computing [pdf]

Andrew T. N. Kurauchi, Antonio Diaz Tula and Carlos H. Morimoto.
Proceedings of the 13th Brazilian Symposium on Human Factors in Computing Systems
Abstract Bibtex

Virtual Makeup: Foundation, Eye Shadow and Lipstick Simulation [pdf]

Filipe M. S. de Campos and Carlos H. Morimoto.
XVI Symposium on Virtual and Augmented Reality (SVR)
Abstract Bibtex

Método de calibração de rastreadores de olhar móveis utilizando 2 planos para correção de paralaxe [pdf]

Andrew T. N. Kurauchi, Antonio Diaz Tula and Carlos H. Morimoto.
XXIV Congresso Brasileiro de Engenharia Biomédica
Abstract Bibtex

Sistema móvel de baixo custo para rastreamento do olhar voltado à identificação de disfunções oculomotoras [pdf]

Antonio Diaz Tula, Andrew T. N. Kurauchi, Carlos H. Morimoto, Silvia Veitzman and Jéssica N. Ianof.
XXIV Congresso Brasileiro de Engenharia Biomédica
Abstract Bibtex

Tangible Beats: a collaborative user interface for creating musical beats [pdf]

Alexandre M. F. de Sousa and Carlos H. Morimoto.
XIII Simpósio Brasileiro de Jogos e Entretenimento Digital (SBGames) - Trilha de Arte & Design
Abstract Bibtex

2013

Towards Wearable Gaze Supported Augmented Cognition [pdf]

Andrew T. N. Kurauchi, Carlos H. Morimoto, Diako Mardanbeigi and Dan W. Hansen.
CHI 2013 Workshop on Gaze Interaction in the Post-WIMP World
Abstract Bibtex

Penspective: a Perspective-Aware Game Map Editor with Natural Interaction [pdf]

Alexandre M. F. de Sousa, Anderson C. M. Tavares and Carlos H. Morimoto.
XII Simpósio Brasileiro de Jogos e Entretenimento Digital
Abstract Bibtex

Facilitating Gaze Interaction Using the Gap and Overlap Effects [pdf]

Antonio Diaz Tula, Andrew T. N. Kurauchi and Carlos H. Morimoto.
CHI '13 Extended Abstracts on Human Factors in Computing Systems
Abstract Bibtex

Improving Head Movement Tolerance of Cross-Ratio Based Eye Trackers [pdf]

Flavio L. Coutinho and Carlos H. Morimoto.
International Journal of Computer Vision
Abstract Bibtex

2012

Dynamic Context Switching for Gaze Based Interaction [pdf]

Antonio Diaz Tula, Filipe M. S. de Campos and Carlos H. Morimoto.
Proceedings of the Symposium on Eye Tracking Research & Applications
Abstract Bibtex

Augmenting the Robustness of Cross-ratio Gaze Tracking Methods to Head Movement [pdf]

Flávio L. Coutinho and Carlos H. Morimoto.
Proceedings of the Symposium on Eye Tracking Research and Applications
Abstract Bibtex

2011

Virtual Reality in Brazil: Automatic Camera Control in Virtual Environments Augmented Using Multiple Sparse Videos [pdf]

Jeferson R. Silva, Thiago T. Santos and Carlos H. Morimoto.
Computers and Graphics
Abstract Bibtex

Computer Vision based Machine Interaction [pdf]

Carlos H. Morimoto, Flavio L. Coutinho, Jefferson R. da Silva, Silvia E. Ghirotti and Thiago T. Santos.
SBC Journal on 3D Interactive Systems
Abstract Bibtex

2010

Multiple camera people detection and tracking using support integration [pdf]

Thiago T. Santos and Carlos H. Morimoto.
Pattern Recognition Letters
Abstract Bibtex

Um Sistema De Interação Baseado Em Gestos Manuais Tridimensionais Para Ambientes Virtuais [pdf]

Silvia E. Ghirotti and Carlos H. Morimoto.
Proceedings of the IX Symposium on Human Factors in Computing Systems
Abstract Bibtex

A Depth Compensation Method for Cross-ratio Based Eye Tracking [pdf]

Flavio L. Coutinho and Carlos H. Morimoto.
Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications
Abstract Bibtex

Context Switching for Fast Key Selection in Text Entry Applications [pdf]

Carlos H. Morimoto and Arnon Amir.
Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications
Abstract Bibtex

Real Time Novel View Scene Rendering From Multiple Sparse Videos [pdf]

Jeferson R. da Silva, Thiago T. Santos and Carlos H. Morimoto.
Proceedings of the XII Brazilian Symposium on Virtual and Augmented Reality
Abstract Bibtex

2009

Automatic Measurement of Eye Features Using Image Processing [pdf]

Carlos H. Morimoto.
Workshop de Informática Médica
Abstract Bibtex

2008

People detection under occlusion in multiple camera views [pdf]

Thiago T. Santos and Carlos H. Morimoto.
XXI Brazilian Symposium on Computer Graphics and Image Processing
Abstract Bibtex

GInX: Gaze Based Interface Extensions [pdf]

Thiago S. Barcelos and Carlos H. Morimoto.
Proceedings of the 2008 Symposium on Eye Tracking Research & Applications
Abstract Bibtex

Eyelid Measurements Using Digital Video Processing [pdf]

Carlos H. Morimoto and Thomaz F. de Oliveira.
Proceedings of the 2008 ACM Symposium on Applied Computing
Abstract Bibtex

Free Head Motion Eye Gaze Tracking Techniques

Carlos H. Morimoto and Flávio L. Coutinho.
Passive Eye Monitoring: Algorithms, Applications and Experiments
Abstract Bibtex

Eye Movements and Motor Programming in a Time-To-Contact Task [pdf]

Edgard Morya, Marco Bertolassi, Adhemar Pettri Filho, Carlos H. Morimoto and Ronald D. Ranvaud.
Proceedings of the 2006 Symposium on Eye Tracking Research & Applications
Abstract Bibtex

The Relation of Eye Fixation Patterns with Emotional Content and Episodic Memory [pdf]

Luiz H. M. do Canto Pereira, Breno Santos, Edgard Morya, Carlos H. Morimoto and Ronald D. Ranvaud.
Proceedings of the 2006 Symposium on Eye Tracking Research & Applications
Abstract Bibtex

2007

Jmin-image based color-texture segmentation using watershed and hierarchical clustering [pdf]

Thiago T. Santos, Carlos H. Morimoto and Rama Chellappa.
Proceedings of the 8th International Symposium on Mathematical Morphology
Abstract Bibtex

2005

On the Usability of Gesture Interfaces in Virtual Reality Environments [pdf]

Marcio C. Cabral, Carlos H. Morimoto and Marcelo K. Zuffo.
Proceedings of the 2005 Latin American Conference on Human-computer Interaction
Abstract Bibtex

Automatic Iris Segmentation Using Active Near Infra Red Lighting [pdf]

Carlos H. Morimoto, Thiago T. Santos and Adriano S. Muniz.
XVIII Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI'05)
Abstract Bibtex

JEcoSys - a framework for interactive plants simulation [pdf]

Luis C. Y. Endo, Carlos H. Morimoto and Antonio E. Fabris.
Computer Graphics International 2005
Abstract Bibtex

Eye Gaze Tracking Techniques for Interactive Applications [pdf]

Carlos H. Morimoto and Marcio R. M. Mimica.
Computer Vision and Image Understanding
Abstract Bibtex

2004

Panda: Sistema de Gerenciamento de Cursos Online [pdf]

Carlos H. Morimoto, Carlos E. Ferreira and José Soares.
XII Workshop de Educação em Computação
Abstract Bibtex

2003

System and method for eye gaze tracking using corneal image mapping [pdf]

Arnon Amir, Myron D. Flickner, David B. Koons and Carlos H. Morimoto.
US Patent 6,659,611
Abstract Bibtex

A computer vision framework for eye gaze tracking [pdf]

Marcio R. M. Mimica and Carlos H. Morimoto.
XVI Brazilian Symposium on Computer Graphics and Image Processing
Abstract Bibtex

Method and system for relevance feedback through gaze tracking and ticker interfaces [pdf]

Myron D. Flickner, David B. Koons, Qi Lu, Paul P. Maglio, Carlos H. Morimoto and Edwin J. Selker.
US Patent 6,577,329
Abstract Bibtex

Real-time animation of underbrush [pdf]

Luis C. Y. Endo, Carlos H. Morimoto and Antonio E. Fabris.
WSCG SHORT PAPERS proceedings
Abstract Bibtex

A computer vision framework for eye gaze tracking [pdf]

Marcio R. M. Mimica and Carlos H. Morimoto.
XVI Brazilian Symposium on Computer Graphics and Image Processing
Abstract Bibtex

2002

Method and apparatus for determining eye contact [pdf]

Arnon Amir, Myron D. Flickner, David B. Koons, Carlos H. Morimoto and Shumin Zhai.
US Patent 6,393,136
Abstract Bibtex

Free Head Motion Eye Gaze Tracking Without Calibration [pdf]

Carlos H. Morimoto, Arnon Amir and Myron D. Flickner.
CHI '02 Extended Abstracts on Human Factors in Computing Systems
Abstract Bibtex

Detecting eye position and gaze from a single camera and 2 light sources [pdf]

Carlos H. Morimoto, Arnon Amir and Myron Flickner.
Proceedings of the 16th International Conference on Pattern Recognition
Abstract Bibtex

2001

Interactive Digital Mirror [pdf]

Carlos H. Morimoto.
Proceedings of the 14th Brazilian Symposium on Computer Graphics and Image Processing
Abstract Bibtex

Gaze-based secure keypad entry system [pdf]

Myron D. Flickner, Qi Lu and Carlos H. Morimoto.
US Patent 6,282,553
Abstract Bibtex

2000

Pupil detection and tracking using multiple light sources [pdf]

Carlos H. Morimoto, David B. Koons, Arnon Amir and Myron D. Flickner.
Image and Vision Computing
Abstract Bibtex

Virtual autonomous agents with vision [pdf]

Carlos H. Morimoto.
Proceedings of the Workshop on Artificial Intelligence and Computer Vision
Abstract Bibtex

Real-time multiple face detection using active illumination [pdf]

Carlos H. Morimoto and Myron D. Flickner.
Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition
Abstract Bibtex

1999

Frame-rate pupil detector and gaze tracker [pdf]

Carlos H. Morimoto, David B. Koons, Arnon Amir and Myron D. Flickner.
Proceedings of the IEEE ICCV'99 frame-rate workshop
Abstract Bibtex

Manual and Gaze Input Cascaded (MAGIC) Pointing [pdf]

Shumin Zhai, Carlos H. Morimoto and Steven Ihde.
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Abstract Bibtex

Keeping an eye for HCI [pdf]

Carlos H. Morimoto, David B. Koons, Arnon Amir, Myron D. Flickner and Shumin Zhai.
Proceedings of the XII Brazilian Symposium on Computer Graphics and Image Processing
Abstract Bibtex

1998

Real-time detection of eyes and faces [pdf]

Carlos H. Morimoto, David B. Koons, Arnon Amir and Myron D. Flickner.
Workshop on Perceptual User Interfaces
Abstract Bibtex

Evaluation of image stabilization algorithms [pdf]

Carlos H. Morimoto and Rama Chellappa.
Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing
Abstract Bibtex

1997

Video coding using hybrid motion compensation [pdf]

Carlos H. Morimoto, Philippe Burlina and Rama Chellappa.
Proceedings of the International Conference on Image Processing
Abstract Bibtex

Fast 3D stabilization and mosaic construction [pdf]

Carlos H. Morimoto and Rama Chellappa.
Proceedings of the 1997 IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Abstract Bibtex

Fast Image Stabilization and Mosaicking [pdf]

Carlos H. Morimoto, Rama Chellappa and Steve Balakirsky.
DARPA Image Understanding Workshop
Abstract Bibtex

1996

RSTA on the Move: Detection and Tracking of Moving Objects from an Autonomous Mobile Platform [pdf]

Larry S. Davis, Carlos H. Morimoto, Martin Herman, Ruzena Bajcsy and Randal Nelson.
Tech. Report: Maryland Univ. College Park Center for Automation Research
Abstract Bibtex

Video Coding by Model-Based Stabilization [pdf]

Carlos H. Morimoto, Philippe Burlina, Rama Chellappa and Yi-Sheng Yao.
Tech. Report: Maryland Univ. College Park Center for Automation Research
Abstract Bibtex

1995

Detection of Independently Moving Objects in Passive Video [pdf]

Carlos H. Morimoto, Daniel Dementhon, Larry Davis, Rama Chellappa and Randal Nelson.
In Proceedings of Intelligent Vehicles Workshop
Abstract Bibtex

Motion compensated subband coding of video acquired from a moving platform [pdf]

Oh-Jin Kwon, Rama Chellappa and Carlos H. Morimoto.
International Conference on Acoustics, Speech, and Signal Processing
Abstract Bibtex