Computer users could soon be leading their mouse around by the nose – literally! The "Nouse," developed by a team at NRC's Institute for Information Technology led by Dr. Dmitry Gorodnichy, is an alternative to the traditional computer mouse. Short for "nose as mouse," the Nouse lets users control their computers with the tip of their nose rather than by using their hands.

How Does it Work?

Perceptual Vision Systems (PVS) have been around for a while. They are systems that detect a user's motions and use the information to control software. Until now, PVS haven't worked very well because they were not very accurate.

The Nouse changed all that. The technology uses a webcam to capture an image of the user. It then detects and tracks the tip of the user's nose which is the closest to the camera. This makes it possible to operate a computer with one's nose just like with a normal mouse or joystick (e.g. moving the cursor on screen, writing hands-free like when using chalk, etc.) To click, a user double-blinks.

Why the Nose?

Other facial recognition efforts have focused on tracking facial features like the eyebrows or mouth, but none of these were precise enough. The computer easily lost track of them when users turned their heads.

The tip of the nose, however, is ideal for tracking because, thanks to Mother Nature, its convex shape is easy to pick up, moves smoothly, and always remains within view of the camera, even when a user's head moves or facial expression changes.

Combined with face memorization and recognition techniques that were also developed for the project by the NRC group, the system is able to automatically recognize users and retrieve the settings needed to run the Perceptual Vision System, hands free!

So What?

The Nouse has many useful applications. The technology could provide video gamers with an exciting new way of controlling interactive environments. It could also be used in surveillance, video conferencing, and entertainment. Perhaps most promising is its potential use in the development of hands-free devices for people with physical disabilities.  

The Smell of Success

Nouse technology has caught the attention of international media. In 2003, the Nouse website was the most visited perceptual vision technology website in the world with over 2,500 visitors a day! Judging from positive feedback, it's clear that the Nouse is a nose ahead of other facial recognition methods.