An active-pixel sensor (APS) is an image sensor consisting of an integrated circuit containing an array of pixel sensors, each pixel containing a photodetector and an active amplifier. There are many types of active pixel sensors including the CMOS APS used most commonly in cell phone cameras, web cameras and in some DSLRs. Such an image sensor is produced by a CMOS process (and is hence also known as a CMOS sensor), and has emerged as an alternative to charge-coupled device (CCD) image sensors.

CMOS image sensor

The term active pixel sensor is also used to refer to the individual pixel sensor itself, as opposed to the image sensor;^[1] in that case the image sensor is sometimes called an active pixel sensor imager,^[2] active-pixel image sensor,^[3] or active-pixel-sensor (APS) imager.

History[link]

The term active pixel sensor was coined by Tsutomu Nakamura who worked on the Charge Modulation Device active pixel sensor at Olympus,^[4] and more broadly defined by Eric Fossum in a 1993 paper.^[5]

Image sensor elements with in-pixel amplifiers were described by Noble in 1968,^[6] by Chamberlain in 1969,^[7] and by Weimer et al. in 1969,^[8] at a time when passive-pixel sensors – that is, pixel sensors without their own amplifiers – were being investigated as a solid-state alternative to vacuum-tube imaging devices. The MOS passive-pixel sensor used just a simple switch in the pixel to read out the photodiode integrated charge.^[9] Pixels were arrayed in a two-dimensional structure, with access enable wire shared by pixels in the same row, and output wire shared by column. At the end of each column was an amplifier. Passive-pixel sensors suffered from many limitations, such as high noise, slow readout, and lack of scalability. The addition of an amplifier to each pixel addressed these problems, and resulted in the creation of the active-pixel sensor. Noble in 1968 and Chamberlain in 1969 created sensor arrays with active MOS readout amplifiers per pixel, in essentially the modern three-transistor configuration. The CCD was invented in 1970 at Bell Labs. Because the MOS process was so variable and MOS transistors had characteristics that changed over time (Vt instability), the CCD's charge-domain operation was more manufacturable and quickly eclipsed MOS passive and active pixel sensors. A low-resolution "mostly digital" N-channel MOSFET imager with intra-pixel amplification, for an optical mouse application, was demonstrated in 1981.^[10]

Another type of active pixel sensor is the hybrid infrared focal plane array (IRFPA) designed to operate at cryogenic temperatures in the infrared spectrum. The devices are two chips that are put together like a sandwich: one chip contains detector elements made in InGaAs or HgCdTe, and the other chip is typically made of silicon and is used to readout the photodetectors. The exact date of origin of these devices is classified, but by the mid-1980s they were in widespread use.

By the late 1980s and early 1990s, the CMOS process was well established as a well controlled stable process and was the baseline process for almost all logic and microprocessors. There was a resurgence in the use of passive-pixel sensors for low-end imaging applications,^[11] and active-pixel sensors for low-resolution high-function applications such as retina simulation^[12] and high energy particle detector.^[13] However, CCDs continued to have much lower temporal noise and fixed-pattern noise and were the dominant technology for consumer applications such as camcorders as well as for broadcast cameras, where they were displacing video camera tubes.

Eric Fossum, et al., invented the image sensor that used intra-pixel charge transfer along with an in-pixel amplifier to achieve true correlated double sampling (CDS) and low temporal noise operation, and on-chip circuits for fixed-pattern noise reduction, and published the first extensive article^[5] predicting the emergence of APS imagers as the commercial successor of CCDs. Between 1993 and 1995, the Jet Propulsion Laboratory developed a number of prototype devices, which validated the key features of the technology. Though primitive, these devices demonstrated good image performance with high readout speed and low power consumption.

In 1995, personnel from JPL founded Photobit Corp., who continued to develop and commercialize APS technology for a number of applications, such as web cams, high speed and motion capture cameras, digital radiography, endoscopy (pill) cameras, DSLRs and of course, camera-phones. Many other small image sensor companies also sprang to life shortly thereafter due to the accessibility of the CMOS process and all quickly adopted the active pixel sensor approach.

Comparison to CCDs[link]

This unreferenced section requires citations to ensure verifiability.

APS pixels solve the speed and scalability issues of the passive-pixel sensor. They generally consume less power than CCDs, have less image lag, and require less specialized manufacturing facilities. Unlike CCDs, APS sensors can combine the image sensor function and image processing functions within the same integrated circuit. APS sensors have found markets in many consumer applications, especially camera phones. They have also been used in other fields including digital radiography, military ultra high speed image acquisition, security cameras and optical mice. Manufacturers include Aptina Imaging (independent spinout from Micron Technology, who purchased Photobit in 2001), Canon, Samsung, STMicroelectronics, Toshiba, OmniVision Technologies, Sony, and Foveon, among others. CMOS-type APS sensors are typically suited to applications in which packaging, power management, and on-chip processing are important. CMOS type sensors are widely used, from high-end digital photography down to mobile-phone cameras.

Advantages of CMOS compared to CCD[link]

The biggest advantage of a CMOS sensor is that it is typically less expensive than a CCD sensor. A CMOS camera is immune to the blooming effect where a light source has overloaded the sensitivity of the sensor, causing the sensor to bleed the light source onto other pixels.

Disadvantages of CMOS compared to CCD[link]

Since a CMOS video sensor typically captures a row at time within approximately 1/60th or 1/50th of a second (depending on refresh rate) it may result in a "rolling shutter" effect, where the image is skewed (tilted to the left or right, depending on the direction of camera or subject movement). For example, when tracking a car moving at high speed, the car will not be distorted but the background will appear to be tilted. A frame-transfer CCD sensor does not have this problem, instead capturing the entire image at once into a frame store.

Architecture[link]

This section needs additional citations for verification. Please help improve this article by adding citations to reliable sources. Unsourced material may be challenged and removed. (September 2007)

Pixel[link]

A three-transistor active pixel sensor.

The standard CMOS APS pixel today consists of a photodetector (a pinned photodiode), a floating diffusion, a transfer gate, reset gate, selection gate and source-follower readout transistor—the so-called 4T cell. The pinned photodiode was originally used in interline transfer CCDs due to its low dark current and good blue response, and when coupled with the transfer gate, allows complete charge transfer from the pinned photo diode to the floating diffusion (which is further connected to the gate of the read-out transistor) eliminating lag. The use of intrapixel charge transfer can offer lower noise by enabling the use of correlated double sampling (CDS). The Noble 3T pixel is still often used since the fabrication requirements are easier. The 3T pixel comprises the same elements as the 4T pixel except the transfer gate and the pinned photo diode. The reset transistor, M_rst, acts as a switch to reset the floating diffusion which acts in this case as the photo diode. When the reset transistor is turned on, the photodiode is effectively connected to the power supply, V_RST, clearing all integrated charge. Since the reset transistor is n-type, the pixel operates in soft reset. The read-out transistor, M_sf, acts as a buffer (specifically, a source follower), an amplifier which allows the pixel voltage to be observed without removing the accumulated charge. Its power supply, V_DD, is typically tied to the power supply of the reset transistor. The select transistor, M_sel, allows a single row of the pixel array to be read by the read-out electronics. Other innovations of the pixels such as 5T and 6T pixels also exist. By adding extra transistors, functions such as global shutter, as opposed to the more common rolling shutter, are possible. In order to increase the pixel densities, shared-row, four-ways and eight-ways shared read out, and other architectures can be employed. A variant of the 3T active pixel is the Foveon X3 sensor invented by Dick Merrill. In this device, three photodiodes are stacked on top of each other using planar fabrication techniques, each photodiode having its own 3T circuit. Each successive layer acts as a filter for the layer below it shifting the spectrum of absorbed light in successive layers. By deconvolving the response of each layered detector, red, green, and blue signals can be reconstructed.

APS using TFTs[link]

A two-transistor active/passive pixel sensor

For applications such as large area digital x-ray imaging thin-film transistors (TFTs) can also be used in APS architecture. However, because of the larger size and lower transconductance gain of TFTs compared to CMOS transistors, it is necessary to have fewer on-pixel TFTs to maintain image resolution and quality at an acceptable level. A two-transistor APS/PPS architecture has been shown to be promising for APS using amorphous silicon TFTs. In the two-transistor APS architecture on the right, T_AMP is used as a switched-amplifer integrating functions of both M_sf and M_sel in the three-transistor APS. This results in reduced transistor counts per pixel, as well as increased pixel transconductance gain.^[14] Here, C_pix is the pixel storage capacitance, and it is also used to capacitively couple the addressing pulse of the "Read" to the gate of T_AMP for ON-OFF switching. Such pixel readout circuits work best with low capacitance photoconductor detectors such as amorphous selenium.

Array[link]

A typical two-dimensional array of pixels is organized into rows and columns. Pixels in a given row share reset lines, so that a whole row is reset at a time. The row select lines of each pixel in a row are tied together as well. The outputs of each pixel in any given column are tied together. Since only one row is selected at a given time, no competition for the output line occurs. Further amplifier circuitry is typically on a column basis.

Size[link]

The size of the pixel sensor is often given in height and width, but also in the optical format.

Design variants[link]

This unreferenced section requires citations to ensure verifiability.

Many different pixel designs have been proposed and fabricated. The standard pixel is the most common because it uses the fewest wires and the fewest, most tightly-packed transistors possible for an active pixel. It is important that the active circuitry in a pixel take up as little space as possible to allow more room for the photodetector. High transistor count hurts fill factor, that is, the percentage of the pixel area that is sensitive to light. Pixel size can be traded for desirable qualities such as noise reduction or reduced image lag. Noise is a measure of the accuracy with which the incident light can be measured. Lag occurs when traces of a previous frame remain in future frames, i.e. the pixel is not fully reset. The voltage noise variance in a soft-reset (gate-voltage regulated) pixel is Failed to parse (Missing texvc executable; please see math/README to configure.): V_n^2= kT/2C , but image lag and fixed pattern noise may be problematic. In rms electrons, the noise is Failed to parse (Missing texvc executable; please see math/README to configure.): N_e= \frac{\sqrt{kTC/2}}{q} .

Hard reset[link]

Operating the pixel via hard reset results in a Johnson–Nyquist noise on the photodiode of Failed to parse (Missing texvc executable; please see math/README to configure.): V_n^2= kT/C

or Failed to parse (Missing texvc executable; please see math/README to configure.): N_e= \frac{\sqrt{kTC}}{q}

, but prevents image lag, sometimes a desirable tradeoff. One way to use hard reset is replace M_rst with a p-type transistor and invert the polarity of the RST signal. The presence of the p-type device reduces fill factor, as extra space is required between p- and n-devices; it also removes the possibility of using the reset transistor as an overflow anti-blooming drain, which is a commonly-exploited benefit of the n-type reset FET. Another way to achieve hard reset, with the n-type FET, is to lower the voltage of V_RST relative to the on-voltage of RST. This reduction may reduce headroom, or full-well charge capacity, but does not affect fill factor, unless V_DD is then routed on a separate wire with its original voltage.

Combinations of hard and soft reset[link]

Techniques such as flushed reset, pseudo-flash reset, and hard-to-soft reset combine soft and hard reset. The details of these methods differ, but the basic idea is the same. First, a hard reset is done, eliminating image lag. Next, a soft reset is done, causing a low noise reset without adding any lag. Pseudo-flash reset requires separating V_RST from V_DD, while the other two techniques add more complicated column circuitry. Specifically, pseudo-flash reset and hard-to-soft reset both add transistors between the pixel power supplies and the actual V_DD. The result is lower headroom, without affecting fill factor.

Active reset[link]

A more radical pixel design is the active-reset pixel. Active reset can result in much lower noise levels. The tradeoff is a complicated reset scheme, as well as either a much larger pixel or extra column-level circuitry.

References[link]

Further reading[link]

• John L. Vampola (January 1993). "Chapter 5 - Readout electronics for infrared sensors". In David L. Shumaker. The Infrared and Electro-Optical Systems Handbook, Volume 3 - Electro-Optical Components. The International Society for Optical Engineering. ISBN 0-8194-1072-1. http://stinet.dtic.mil/stinet/XSLTServlet?ad=ADA364023.  — one of the first books on CMOS imager array design

• Mary J. Hewitt; John L. Vampola, Stephen H. Black, and Carolyn J. Nielsen (June 1994). Eric R. Fossum. ed. "Infrared readout electronics: a historical perspective". Proceedings of SPIE (The International Society for Optical Engineering) 2226 (Infrared Readout Electronics II): pages 108–119. DOI:10.1117/12.178474. http://link.aip.org/link/?PSISDG/2226/108/1. 

• Mark D. Nelson; Jerris F. Johnson and Terrence S. Lomheim (November 1991). "General noise processes in hybrid infrared focal plane arrays". Optical Engineering (The International Society for Optical Engineering) 30 (11): 1682–1700. DOI:10.1117/12.55996. http://link.aip.org/link/?OPEGAR/30/1682/1. 

• Martin Vasey (September 2009). "CMOS Image Sensor Testing: An Integrated Approach". Jova Solutions. San Francisco, CA. http://www.jovasolutions.com/isl-white-paper/82-isl-3200-white-paper. 

External links[link]

Wikimedia Commons has media related to: CMOS sensors

• Active Pixel Sensors (APS) for the detection of ionizing particles Use of CMOS Active Pixel Sensors in high energy physic experiments
• CMOS camera as a sensor Tutorial showing how low cost CMOS camera can replace sensors in robotics applications

Bedabrata Pain is an Indian film director,^[2] producer and screenwriter.^[3]

Biography[link]

Early life and education[link]

Bedabrata's father was born in Dhaka and his mother came from Faridpur. Bedabrata Pain did his schooling in St.Lawrence High School in Calcutta and then studied in IIT Kharagpur(1982-1986),^[4] and was one of the good students. Later he went to Columbia University for Ph.D.His future wife Shonali Bose also did her Masters Degree in Political Science from Columbia University. Then he along with his four friends invented the active pixel sensor technology that produced the world's smallest camera and has been inducted to the US Space Technology Hall of Fame.^[5]Now it is used in mobiles.^[6] Later he worked for NASA for 18 years as senior research scientist before quitting the job in 2008.^[7][8]

Personal life[link]

Bedabrata Pain is married to Shonali Bose.^[9] Now he is based in Los Angeles.^[10] Bedabrata and Shonali have lost their son who died at a young age in an accident.^[11][12]

Film career[link]

Bedabrata was the executive producer of the award-winning film Amu in 2005.^[13] He is now directing film Chittagong starring Manoj Bajpai,^[14] Vega Tamotia,^[15] Nawazuddin Siddiqui, Barry John and Dibyendu Bhattacharya.^[16] Bedabrata,shot the film Chittagong with the same digital imaging technology that he with other NASA scientists had invented.^[17]

Filmography[link]

See also[link]

• Center for Detectors
• California Institute of Technology’s Jet Propulsion Laboratory
• Space Technology Hall of Fame
• Active pixel sensor
• NASA

References[link]

External links[link]

• http://www.emirates247.com/news-in-images/indian-film-festival-los-angeles-2012-04-12-1.453593