What are you looking at? Looking at the eyes

Villanueva Larre, Arantxa

Telekomunikazio Ingeniaritzan doktorea

Nafarroako Unibertsitate Publikoa

Although research on the monitoring systems of the gaze began decades ago, then, around the end of the 60s, being able to control a computer with the eye was a dream totally unimaginable for his first admirers. However, since then, these systems have developed very quickly and have made the way to realize those intentions that seemed inaccessible. The developments and applications of the eye tracking system, eye tracking, have aroused some interest in recent years.
What are you looking at? Looking at the eyes
01/04/2007 | Villanueva Larre, Arantxa | PhD in Telecommunications Engineering from the Public University of Navarra

(Photo: From archive)
Eye monitoring technology ranges from computer science to psychology. The process of image, electronics, optics and the analysis of cognitive processes have to do with the design and use of these systems. But... What objective can one have to follow the gaze of a human being and analyze it?... What kind of systems and techniques allow you to know a person's eye movement? Let's respond slowly to these questions.

Applications of observational systems

With regard to the applications of these systems, it can be classified in uses for diagnostic purposes and uses for interactive purposes.

Diagnostic uses

Attention or attention is a process that focaliza the ability to understand our environment in a concrete stimulus. It has to do directly with our cognitive part and know the movement of the eyes helps to a great extent to understand these mechanisms. The use of an eye tracking system as a diagnostic tool has generated tools to measure the relationship between eye movement and attention. They can be applied in psychology but also in other areas, especially in marketing and advertising.

Interesting works have been carried out in this field. Recently, relevant diagnostic results have been obtained in neuroscience and psychology. One of the most studied sections is that of eye movements in the processes of reading texts. The analysis of eye movements during reading helps to detect certain errors and pathologies, with dyslexia being one of the best known. The objective of eye tracking systems in this field would be to record the person's visual trajectory to the text so that the psychologist or the corresponding specialist interprets the data. In the same way, studies and works carried out consider the study of eye movements as a valuable tool for the early diagnosis of schizophrenia and strabismus.

The blue points represent the views recorded on the text.
D. D. Salvucci/Drexel Univ.

Continuing with diagnostic applications, more complex works have also been found that explore smart environments. Each human being follows a pattern by exploring its surroundings. The analysis of eye movements in free perception has positive consequences to understand the mechanisms we use to assimilate the environment.

Points observed by a specialist when analyzing a mammogram and with the eyes.
C.E. Nodine et al./Pendergrass Lab. and Breast Imaging Study in the Univ. from Pennsylvania

In general, these systems are a powerful tool for understanding and measuring human intelligence. Depending on the application, the consequences can positively modify the behavior of the human being in certain actions. It is known that lack of attention causes accidents in driving. In recent times, important efforts have been made in automotive. Undoubtedly, the analysis of the eye movements of the driver is a perfect tool to detect the lack of attention and the sleep of the driver. The experimental results will serve to get safer cars in the future.

Similar uses can be found in industry and medicine. In the industry, the registration and quality control of the products is often done through sight, and a bad analysis can have serious consequences. However, it may be more serious than a specialist to explore a little resonance or other medical imaging. The analysis of eye movements, both in industry and medical imaging studies, can be used to detect repetitive or scarce inspection strategies of the human being.

In the two ads on the left, the biggest blue spots are the ones that have aroused the most attention. In the image on the right are marked the most explored parts of a web page.
Consumer Marketing Research Institute of Japan; M. Russel/Accessible Software Research Laboratory/Wichita State Unit.
Finally, but perhaps with greater force, a wide field has been opened around the world of advertising and marketing. The consumer's gaze is a source of information of great value. In advertising, the path traveled by the eyes is an undeniable data to know if a certain part of the ad has been seen and assimilated.

Along the same lines, studies on web pages have already begun to establish certain design principles. According to the studies carried out, in general, the upper left section is first explored on the website. The results indicate that we try to search for capital letters, which appear to be normally in that area.

Interactive uses

The interactive uses of eye tracking systems should be understood within the context of human-computer communication. In this sense, in some situations in which it is not possible to use the hands are presented as an interesting option.

The motor capacity of the human being, that is, motor control, is affected by numerous diseases and pathologies such as multiple sclerosis, amyotrophic lateral sclerosis, cerebral palsy, bone marrow damage and cerebral infarction, among others. Despite their peculiarities, regardless of their origin, they have as remarkable characteristic the reduction of the motor capacity. Often, this deterioration can reach the maximum measures, provoke total immobility and turn man into a prisoner of his body.

However, usually, even in advanced stages of the disease, the controlled eye movement remains intact and becomes a single way of communication. In these cases, the previous location of the screen of the look can be used as instruction for the computer. With this objective numerous specific software have been created. The most well-known applications are the so-called virtual keyboards. In them, the user of the eye tracking system can select letters and words by looking on the keyboard that appears on the screen and thus complete the phrases. This would allow, to a large extent, to overcome their communication difficulties.

A simple example is shown in the figure. Thanks to the eye tracking system, the film stops when the viewer takes the look out of the screen, because the system understands that the viewer draws attention to something else.
Human Media Lab. Univ. of Queens

The application of eye tracking systems is broad in the field of disabilities and every day new possibilities appear.

However, there are interactive uses not related to immobility. Its base is the relationship between the point in which the gaze is corrected on the screen and the interest of the user. These are called Gaze Contingent Display (GCD) or interface under surveillance. In them you can adapt the environment of the scanned screen to the user, for example, show more details, use an automatic zoom or create new information related to the previous one.

Similarly, it is interesting to apply these techniques to virtual reality and to the world of cartoons. It is known that this type of work involves a large load of computing. Producing quality images is not such a simple process. The objective of the eye tracking systems would be to guess which part of the image the viewer observes to show this element with better definition and more detail. In the rest of the parts, however, the quality would be lost, thus facilitating the reproduction of the image.

Techniques and monitoring systems of the look

With the above, you can say that eye tracking systems have some application… but what is an eye tracking system? What does its operation consist of? Young and Sheena's work perfectly summarizes the resources offered by technology to follow the eye. In fact, there are several technologies that allow to analyze the human's gaze, being the most known electrooculography (EOG) and videooculography (VOG).

Example of OMR system.
Metro Vision
The techniques of the first group were widely accepted about forty years ago. Its foundation is to measure the electrical voltage changes that the body produces when moving the eye. To record these electrical signal changes it is necessary to glue electrodes around the eye. These variations occur between 15-200V. An average variation of 20V is assumed when turning a degree by the eye.

The opponents of this technique use as an argument of opposition interferences. It is undeniable that the muscle movements around have a noticeable influence on the signal. In addition, the dependency of the width of the pupil of the light alters the operation of the electrodes. Consequently, this technique requires very special conditions so that the results obtained are representative data of what happened.

The video techniques use a camera to record the images of the eye. The base is simple: the image of the eye changes as the eye changes. As for these systems, light sources operating in the near infrared (750-880 nm) have a remarkable use. The vision capacity of the human being reaches 700 nm, so this type of light is invisible, that is, we do not appreciate the effect produced in the eye. The objective of the light is, on the one hand, to generate eye images of an acceptable quality and, on the other, to provoke specific peculiarities in the image, which generate reflections on the surface of the cornea.

Example of VOG system. The camera records the image of the eye. To the right, image of the pupil. In this case two reflections are clearly seen in the image.
IRISCOM; Univ. from Navarra Public

Normally, using process techniques characteristic of the image, special features such as the shape of the pupil, the arrangement of the reflections, etc. The changes in these characteristics are directly related to the variation of the look.

Example of a system that is placed above as glasses on the head. Below, a system that fixes the head through a bracket.
SR Research Eyelink; Visual perception laboratory. Rochester Institute of Technology; Fourward Technologies.

One of the great limits of these systems is the movement of the head. The user must keep the head fixed in an area to not go outside the camera. Despite the scarce importance of this barrier in the field of immobility, in some users and applications it is not an easy task, since the lenses and field objectives that use these systems leave little space to freedom. With the aim of overcoming this barrier, several researchers have proposed new solutions. The best known are the systems that are applied directly on the head, such as a helmet or a scam. The head can move freely, as the camera moves with it.

We also have systems that keep the head fixed by means of a support. The problem disappears because it can be accepted that the head is still. On the part of the user is lost comfort.

Example of a multi-camera eye tracking system.
T. T. Ohno/NTT Cyber Solutions lab./ NTT Corporation
In the last decade many researchers have tried to overcome the barriers and limitations that these systems generate. In this sense, the most outstanding results have been the multicamera or stereo eye tracking systems. On the one hand, the position of the head is determined by two wide field cameras, located in the image (left, below) on the screen. If the head is placed in space, the other camera that follows the eye, the bottom of the screen, focuses towards that point using special motors to obtain a suitable image for processing.

With the above, we can affirm that the future of eye tracking systems is assured. As the techniques used are improved, we can expect a greater listening of these devices.

Be careful, therefore, when you put yourself in front of the shop window... Someone looks at you!

Attention Attention
(Photo: Unit Inst. Research Visual Applications/Derby)
Four years ago an interesting experiment was conducted at the National Gallery in London. David Wooding, a well-known researcher who died a couple of years ago, recorded eye movements of people in front of pictures using an eye tracking system. The stored data would be a direct measure of the person's interest. In the example, a spectator's journey with the eye is represented by stripes and points. It can be considered that the most observed sections are those that have paid more attention.
(Photo: Human Media Lab./Univ. of Queens.)
Curious works have also been carried out in this field. One of the most curious is Auramir118, from the team led by Roel Vertegal at the University of Queens in Canada. The goal is to measure, through eye movements, the attention between the listener and the speaker at a conference or interview. According to the researchers, eye contact could show some mutual interest and the duration of this contact would be the measure of attention. This attention is manifested by a virtual “cloud”.
Fundamentals of Video Ocuataphic Techniques
Apart from the most complex mathematical aspects, videoocuataphic techniques can be classified into several criteria. One of the best known is that of systems that use a clear pupil and a dark pupil. The difference between these techniques lies in the position of the light source compared to the camera. If the luminous source is located on the axis of symmetry of the camera, in the image appears the pupil light. It has the same base as a frequent effect on the use of flash in photos, the effect of red eyes. As the flash is near the camera, all the light reflected in the retina of the eye returns directly to the image and is represented with a prominent red pupil. In the case of eye tracking systems, since they work with black and white images, the effect is reflected in a light grey. It is not necessary to say that this effect disappears if the light source is placed away from the axis, then the pupil appears darker in the image.
(Photo: Univ. Public Navarre; Almadas Research Center of IBM)
Bibliography Bibliography Bibliography
Chapman, P. Underwood, G.
Eye Guidance in Reading and Scene Perception.
Elsevier, Oxford, England, 1998.
-------
Duchowski, T.
The Eye tracking Methodology. Theory and Practice.
Springer-Verlag London Ltd. 2003.
-------
Henderson, J.M. Ferreira, F.
The interface of Language, Vision, and Action.
Psychology Press, New York, 2004.
-------
Young, L.R. and Sheena, D.
Survey of eye movement recording methods.
Methods Designs, Behavior Research Methods and Instrumentation, 7, 5, 1975, 397-429.
Villanueva Larre, Arantxa
Services Services Services
More information More information
2007 2007 2007 2007 2007
Security security security security
041 041 041
Awards; Software; Technology; Communication
Dossier dossier
Services Services Services
Babesleak
Eusko Jaurlaritzako Industria, Merkataritza eta Turismo Saila