A child solves a computerized puzzle using a touchscreen.

iPad tablet computer on a stand

A touchscreen is an electronic visual display that can detect the presence and location of a touch within the display area. The term generally refers to touching the display of the device with a finger or hand. Touchscreens can also sense other passive objects, such as a stylus. Touchscreens are common in devices such as game consoles, all-in-one computers, tablet computers, and smartphones.

The touchscreen has two main attributes. First, it enables one to interact directly with what is displayed, rather than indirectly with a pointer controlled by a mouse or touchpad. Secondly, it lets one do so without requiring any intermediate device that would need to be held in the hand (other than a stylus, which is optional for most modern touchscreens). Such displays can be attached to computers, or to networks as terminals. They also play a prominent role in the design of digital appliances such as the personal digital assistant (PDA), satellite navigation devices, mobile phones, and video games.

The popularity of smartphones, tablet computers and many types of information appliances is driving the demand and acceptance of common touchscreens, for portable and functional electronics. With a display of a simple smooth surface, and direct interaction without any hardware (keyboard or mouse) between the user and content, fewer accessories are required. Touchscreens are popular in the medical field, and in heavy industry, as well as kiosks such as museum displays or room automation, where keyboard and mouse systems do not allow a suitably intuitive, rapid, or accurate interaction by the user with the display's content.

Historically, the touchscreen sensor and its accompanying controller-based firmware have been made available by a wide array of after-market system integrators, and not by display, chip, or motherboard manufacturers. Display manufacturers and chip manufacturers worldwide have acknowledged the trend toward acceptance of touchscreens as a highly desirable user interface component and have begun to integrate touchscreens into the fundamental design of their products.

History[link]

The prototype^[1] x-y mutual capacitance touchscreen (left) developed at CERN^[2][3] in 1977 by Bent Stumpe, a Danish electronics engineer, for the control room of CERN’s accelerator SPS (Super Proton Synchrotron). This was a further development of the self-capacitance screen (right), also developed by Stumpe at CERN^[4] in 1972.

E.A. Johnson described his work on capacitive touch screens in a short article published in 1965^[5] and then more fully—along with photographs and diagrams—in an article published in 1967.^[6] A description of the applicability of the touch technology for air traffic control was described in an article published in 1968.^[7] Bent Stumpe with the aid of Frank Bech, both engineers from CERN, developed a transparent touch screen in the early 1970s and it was manufactured by CERN and put to use in 1973.^[8] A capacitive touch screen was developed by American inventor G Samuel Hurst and the first version produced in 1982.^[9]

From 1979–1985, the Fairlight CMI (and Fairlight CMI IIx) was a high-end musical sampling and re-synthesis workstation that utilized light pen technology, with which the user could allocate and manipulate sample and synthesis data, as well as access different menus within its OS by touching the screen with the light pen. The later Fairlight series IIT models used a graphics tablet in place of the light pen. The HP-150 from 1983 was one of the world's earliest commercial touchscreen computers. Similar to the PLATO IV system, the touch technology used employed infrared transmitters and receivers mounted around the bezel of its 9" Sony Cathode Ray Tube (CRT), which detected the position of any non-transparent object on the screen.

An early attempt at a handheld game console with touchscreen controls was Sega's intended successor to the Game Gear, though the device was ultimately shelved and never released due to the expensive cost of touchscreen technology in the early 1990s. Touchscreens would not be popularly used for video games until the release of the Nintendo DS in 2004.^[10] Until recently, most consumer touchscreens could only sense one point of contact at a time, and few have had the capability to sense how hard one is touching. This has changed with the commercialization of multi-touch technology.

Technologies[link]

There are a variety of touchscreen technologies that have different methods of sensing touch.

Resistive[link]

A resistive touchscreen panel comprises several layers, the most important of which are two thin, transparent electrically-resistive layers separated by a thin space. These layers face each other, with a thin gap between.The top screen or the screen which experiences our touch has a coating on the underside surface of the screen. Just beneath it is a similar resistive layer on top of its substrate. One layer has conductive connections along its sides, the other along top and bottom. A voltage is passed through one layer, and sensed at the other. When an object, such as a fingertip or stylus tip, presses down on the outer surface, the two layers touch to become connected at that point: The panel then behaves as a pair of voltage dividers, one axis at a time. By rapidly switching between each layer, the position of a pressure on the screen can be read.

Resistive touch is used in restaurants, factories and hospitals due to its high resistance to liquids and contaminants. A major benefit of resistive touch technology is its low cost. Disadvantages include the need to press down, and a risk of damage by sharp objects. Resistive touchscreens also suffer from poorer contrast, due to having additional reflections from the extra layer of material placed over the screen.

Surface acoustic wave[link]

Surface acoustic wave (SAW) technology uses ultrasonic waves that pass over the touchscreen panel. When the panel is touched, a portion of the wave is absorbed. This change in the ultrasonic waves registers the position of the touch event and sends this information to the controller for processing. Surface wave touchscreen panels can be damaged by outside elements. Contaminants on the surface can also interfere with the functionality of the touchscreen.^[11]

Capacitive[link]

Capacitive touchscreen of a mobile phone

A capacitive touchscreen panel consists of an insulator such as glass, coated with a transparent conductor such as indium tin oxide (ITO).^[12][13] As the human body is also an electrical conductor, touching the surface of the screen results in a distortion of the screen's electrostatic field, measurable as a change in capacitance. Different technologies may be used to determine the location of the touch. The location is then sent to the controller for processing. Unlike a resistive touchscreen, one cannot use a capacitive touchscreen through most types of electrically insulating material, such as gloves; one requires a special capacitive stylus, or a special-application glove with an embroidered patch of conductive thread passing through it and contacting the user's fingertip. This disadvantage especially affects usability in consumer electronics, such as touch tablet PCs and capacitive smartphones in cold weather.

Surface capacitance[link]

In this basic technology, only one side of the insulator is coated with a conductive layer. A small voltage is applied to the layer, resulting in a uniform electrostatic field. When a conductor, such as a human finger, touches the uncoated surface, a capacitor is dynamically formed. The sensor's controller can determine the location of the touch indirectly from the change in the capacitance as measured from the four corners of the panel. As it has no moving parts, it is moderately durable but has limited resolution, is prone to false signals from parasitic capacitive coupling, and needs calibration during manufacture. It is therefore most often used in simple applications such as industrial controls and kiosks.^[14]

Projected capacitance[link]

Projected Capacitive Touch (PCT; also PCAP) technology is a variant of capacitive touch technology. All PCT touch screens are made up of a matrix of rows and columns of conductive material, layered on sheets of glass. This can be done either by etching a single conductive layer to form a grid pattern of electrodes, or by etching two separate, perpendicular layers of conductive material with parallel lines or tracks to form a grid. Current applied to this grid creates a uniform electrostatic field, which can be measured. When a conductive object, such as a finger, comes into contact with a PCT panel, it distorts the local electrostatic field at that point. This is measurable as a change in capacitance. If a finger bridges the gap between two of the "tracks", the charge field is further interrupted and detected by the controller. The capacitance can be changed and measured at every individual point on the grid (intersection). Therefore, this system is able to accurately track touches.^[15] Due to the top layer of a PCT being glass, it is a more robust solution than less costly resistive touch technology. Additionally, unlike traditional capacitive touch technology, it is possible for a PCT system to sense a passive stylus or gloved fingers. However, moisture on the surface of the panel, high humidity, or collected dust can interfere with the performance of a PCT system. There are two types of PCT: mutual capacitance and self-capacitance.

Mutual capacitance[link]

This is common PCT approach, which makes use of the fact that most conductive objects are able to hold a charge if they are very close together. In mutual capacitive sensors, there is a capacitor at every intersection of each row and each column. A 16-by-14 array, for example, would have 224 independent capacitors. A voltage is applied to the rows or columns. Bringing a finger or conductive stylus close to the surface of the sensor changes the local electrostatic field which reduces the mutual capacitance. The capacitance change at every individual point on the grid can be measured to accurately determine the touch location by measuring the voltage in the other axis. Mutual capacitance allows multi-touch operation where multiple fingers, palms or styli can be accurately tracked at the same time.

Self-capacitance[link]

Self-capacitance sensors can have the same X-Y grid as mutual capacitance sensors, but the columns and rows operate independently. With self-capacitance, the capacitive load of a finger is measured on each column or row electrode by a current meter. This method produces a stronger signal than mutual capacitance, but it is unable to resolve accurately more than one finger, which results in "ghosting", or misplaced location sensing.

Infrared[link]

Infrared sensors mounted around the display watch for a user's touchscreen input on this PLATO V terminal in 1981. The monochromatic plasma display's characteristic orange glow is illustrated.

An infrared touchscreen uses an array of X-Y infrared LED and photodetector pairs around the edges of the screen to detect a disruption in the pattern of LED beams. These LED beams cross each other in vertical and horizontal patterns. This helps the sensors pick up the exact location of the touch. A major benefit of such a system is that it can detect essentially any input including a finger, gloved finger, stylus or pen. It is generally used in outdoor applications and point of sale systems which can not rely on a conductor (such as a bare finger) to activate the touchscreen. Unlike capacitive touchscreens, infrared touchscreens do not require any patterning on the glass which increases durability and optical clarity of the overall system. Infrared touchscreens are sensitive to dirt/dust that can interfere with the IR beams, and suffer from parallax in curved surfaces and accidental press when the user hovers his/her finger over the screen while searching for the item to be selected.

Optical imaging[link]

This is a relatively modern development in touchscreen technology, in which two or more image sensors are placed around the edges (mostly the corners) of the screen. Infrared back lights are placed in the camera's field of view on the other side of the screen. A touch shows up as a shadow and each pair of cameras can then be pinpointed to locate the touch or even measure the size of the touching object (see visual hull). This technology is growing in popularity, due to its scalability, versatility, and affordability, especially for larger units.

Dispersive signal technology[link]

Introduced in 2002 by 3M, this system uses sensors to detect the piezoelectricity in the glass that occurs due to a touch. Complex algorithms then interpret this information and provide the actual location of the touch.^[16] The technology claims to be unaffected by dust and other outside elements, including scratches. Since there is no need for additional elements on screen, it also claims to provide excellent optical clarity. Also, since mechanical vibrations are used to detect a touch event, any object can be used to generate these events, including fingers and stylus. A downside is that after the initial touch the system cannot detect a motionless finger.

Acoustic pulse recognition[link]

In this system, introduced by Tyco International's Elo division in 2006, the key to the invention is that a touch at each position on the glass generates a unique sound. Four tiny transducers attached to the edges of the touchscreen glass pick up the sound of the touch. The sound is then digitized by the controller and compared to a list of prerecorded sounds for every position on the glass. The cursor position is instantly updated to the touch location. APR is designed to ignore extraneous and ambient sounds, since they do not match a stored sound profile. APR differs from other attempts to recognize the position of touch with transducers or microphones, in using a simple table lookup method rather than requiring powerful and expensive signal processing hardware to attempt to calculate the touch location without any references.^[17] The touchscreen itself is made of ordinary glass, giving it good durability and optical clarity. It is usually able to function with scratches and dust on the screen with good accuracy. The technology is also well suited to displays that are physically larger. Similar to the dispersive signal technology system, after the initial touch, a motionless finger cannot be detected. However, for the same reason, the touch recognition is not disrupted by any resting objects.

Construction[link]

There are several principal ways to build a touchscreen. The key goals are to recognize one or more fingers touching a display, to interpret the command that this represents, and to communicate the command to the appropriate application.

In the most popular techniques, the capacitive or resistive approach, there are typically four layers:

1. Top polyester coated with a transparent metallic conductive coating on the bottom
2. Adhesive spacer
3. Glass layer coated with a transparent metallic conductive coating on the top
4. Adhesive layer on the backside of the glass for mounting.

When a user touches the surface, the system records the change in the electrical current that flows through the display.

Dispersive-signal technology which 3M created in 2002, measures the piezoelectric effect—the voltage generated when mechanical force is applied to a material—that occurs chemically when a strengthened glass substrate is touched.

There are two infrared-based approaches. In one, an array of sensors detects a finger touching or almost touching the display, thereby interrupting light beams projected over the screen. In the other, bottom-mounted infrared cameras record screen touches.

In each case, the system determines the intended command based on the controls showing on the screen at the time and the location of the touch.

Development[link]

Most touchscreen patents were filed during the 1970s and 1980s and have expired. Touchscreen component manufacturing and product design are no longer encumbered by royalties or legalities with regard to patents and the use of touchscreen-enabled displays is widespread.

The development of multipoint touchscreens facilitated the tracking of more than one finger on the screen; thus, operations that require more than one finger are possible. These devices also allow multiple users to interact with the touchscreen simultaneously.

With the growing use of touchscreens, the marginal cost of touchscreen technology is routinely absorbed into the products that incorporate it and is nearly eliminated. Touchscreens now have proven reliability. Thus, touchscreen displays are found today in airplanes, automobiles, gaming consoles, machine control systems, appliances, and handheld display devices including the Nintendo DS and multi-touch enabled cellphones; the touchscreen market for mobile devices is projected to produce US$5 billion in 2009.^[18]

The ability to accurately point on the screen itself is also advancing with the emerging graphics tablet/screen hybrids.

TapSense, announced in October 2011, allows touchscreens to distinguish what part of the hand was used for input, such as the fingertip, knuckle and fingernail. This could be used in a variety of ways, for example, to copy and paste, to capitalize letters, to active different drawing modes, and similar.^[19][20]

Ergonomics and usage[link]

Fingernail as stylus[link]

Pointed nail for easier typing. The concept of using a fingernail trimmed to form a point, to be specifically used as a stylus on a writing tablet for communication, appeared in the 1950 science fiction short story "Scanners Live in Vain".

These ergonomic issues of direct touch can be bypassed by using a different technique, provided that the user's fingernails are either short or sufficiently long. Rather than pressing with the soft skin of an outstretched fingertip, the finger is curled over, so that the tip of a fingernail can be used instead. This method does not work on capacitive touchscreens.

The fingernail's hard, curved surface contacts the touchscreen at one very small point. Therefore, much less finger pressure is needed, much greater precision is possible (approaching that of a stylus, with a little experience), much less skin oil is smeared onto the screen, and the fingernail can be silently moved across the screen with very little resistance,^{[citation needed]} allowing for selecting text, moving windows, or drawing lines.

The human fingernail consists of keratin which has a hardness and smoothness similar to the tip of a stylus (and so will not typically scratch a touchscreen). Alternatively, very short stylus tips are available, which slip right onto the end of a finger; this increases visibility of the contact point with the screen.

Fingerprints[link]

Touchscreens can suffer from the problem of fingerprints on the display. This can be mitigated by the use of materials with optical coatings designed to reduce the visible effects of fingerprint oils, or oleophobic coatings as used in the iPhone 3G S, which lessen the actual amount of oil residue, or by installing a matte-finish anti-glare screen protector, which creates a slightly roughened surface that does not easily retain smudges, or by reducing skin contact by using a fingernail or stylus.

Combined with haptics[link]

Touchscreens are often used with haptic response systems. An example of this technology would be a system that caused the device to vibrate when a button on the touchscreen was tapped. The user experience with touchscreens lacking tactile feedback or haptics can be difficult due to latency or other factors. Research from the University of Glasgow Scotland [Brewster, Chohan, and Brown 2007 and more recently Hogan] demonstrates that sample users reduce input errors (20%), increase input speed (20%), and lower their cognitive load (40%) when touchscreens are combined with haptics or tactile feedback [vs. non-haptic touchscreens].

"Gorilla arm"[link]

The Jargon File dictionary of hacker slang defined "gorilla arm" as the failure to understand the ergonomics of vertically mounted touchscreens for prolonged use. By this proposition the human arm held in an unsupported horizontal position rapidly becomes fatigued and painful, the so-called "gorilla arm".^[21] It is often cited as a prima facie example of what not to do in ergonomics. Vertical touchscreens still dominate in applications such as ATMs and data kiosks in which the usage is too brief to be an ergonomic problem.^{[citation needed]}

Discomfort might be caused by previous poor posture and atrophied muscular systems caused by limited physical exercise.^[22]

Installing a screen protector on a Nokia C2-02

Screen protectors[link]

Some touchscreens, primarily those employed in smartphones, use transparent plastic protectors to prevent any scratches that might be caused by day-to-day use from becoming permanent.

See also[link]

• Dual-touchscreen
• Energy harvesting
• Flexible keyboard
• Gestural interface
• Graphics tablet
• Graphics tablet-screen hybrid
• List of Touch Solution manufacturers
• Tablet PC
• Touch switch
• Touchscreen remote control

• Omnitouch
• SixthSense

Notes[link]

References[link]

• Holzinger, A. (2003). "Finger Instead of Mouse: Touch Screens as a means of enhancing Universal Access". In: Carbonell, N.; Stephanidis C. (Eds): Universal Access, Lecture Notes in Computer Science 2615: 387–397. 

External links[link]

Look up touch screen in Wiktionary, the free dictionary.

• Howstuffworks - How do touchscreen monitors know where you're touching?
• MERL - Mitsubishi Electric Research Lab (MERL)'s research on interaction with touch tables.
• Jefferson Y. Han et al. Multi-Touch Interaction Research. Multi-Input Touchscreen using Frustrated Total Internal Reflection.
• Dot-to-Dot Programming : Building Microcontrollers
• Knowledge base: Multi-touch hardware