Samsung SARI AR SDK markerless tracker used in the
AR EdiBear game (
Android OS)
Augmented reality map on iPhone
Augmented reality (AR) is a live, direct or indirect, view of a physical, real-world environment whose elements are augmented by computer-generated sensory input such as sound, video, graphics or GPS data. It is related to a more general concept called mediated reality, in which a view of reality is modified (possibly even diminished rather than augmented) by a computer. As a result, the technology functions by enhancing one’s current perception of reality. By contrast, virtual reality replaces the real world with a simulated one.
Augmentation is conventionally in real-time and in semantic context with environmental elements, such as sports scores on TV during a match. With the help of advanced AR technology (e.g. adding computer vision and object recognition) the information about the surrounding real world of the user becomes interactive and digitally manipulable. Artificial information about the environment and its objects can be overlaid on the real world. The term augmented reality is believed to have been coined in 1990 by Thomas Caudell, working at Boeing.[1]
Research explores the application of computer-generated imagery in live-video streams as a way to enhance the perception of the real world. AR technology includes head-mounted displays and virtual retinal displays for visualization purposes, and construction of controlled environments containing sensors and actuators.
Augmented Reality is considered an extension of Virtual Reality. Virtual Reality (VR) is a virtual space in which players immerse themselves into that space and exceed the bounds of physical reality. In virtual reality, time, physical laws and material properties may no longer be thought of as true, in contrast to the real-world environment. Instead of considering AR and VR as exact opposite concepts, Milgram et al. claim them as the Reality-Virtual (RV) continuum (Milgram, Takemura, Utsumi and Kishino, 1994).
Ronald Azuma offered a definition in 1997.[2] R. Azuma, A Survey of Augmented Reality Presence: Teleo. AR is about augmenting the real world environment with virtual information by improving people’s senses and skills. AR mixes virtual characters with the actual world. He identified three common characteristics of AR scenes: combination of the real and virtual, interactive in real-time, and having the scenes registered in 3D.[3]
On a graph, the origin R at the bottom left denotes unmodified reality. A continuum across the Virtuality axis V includes reality augmented with additional information (AR), as well as virtual reality augmented by reality (Augmented Virtuality or AV). Unmediated AV simulations are constrained to match the real world behaviorally if not in contents.
The mediality axis measures modification of AV, AR and mixes thereof. Moving away from the origin on this axis, the depicted world becomes increasingly different from reality. Diagonally opposite from R are virtual worlds that have no connection to reality. (at right) It includes the virtuality reality continuum (mixing) but also, in addition to additive effects, also includes modulation and/or diminishment of reality. Mediation encompasses deliberate and/or unintentional modifications.[4]
AR has become common in sports telecasting. The yellow "first down" line seen in television broadcasts of American football games shows the line the offensive team must cross to receive a first down using the 1st & Ten system. The real-world elements are the football field and players, and the virtual element is the yellow line, which augments the image in real time. AR is also used in association football to show the result (or an advertisement) in the center circle. It is also used to display offside situations. Similarly, in ice hockey an AR colored trail shows location and direction of the puck. Sections of Rugby fields and cricket pitches display sponsored images. Swimming telecasts often add a line across the lanes to indicate the position of the current record holder as a race proceeds to allow viewers to compare the current race to the best performance. As an example of mediated (diminished) reality, the network may hide a real message or replace a real ad message with a virtual message.
Nintendo 3DS and PlayStation Vita come with "AR Cards" (fiduciary markers) allowing to play games which use device camera (Nintendogs + Cats, Tetris Axis, AR Combat DigiQ).
Head-up displays in AR cars such as some BMW 7 Series models or on airplanes are typically integrated into the windshield.[citation needed]. Passenger planes, like the Boeing 787 Dreamliner and the newest Boeing 737 Next Generation feature fold-down Head-up displays coming from just in front of the pilot's head so he doesn't have to look down while he is flying.
The F-35 Lightning II instead display information in the pilot's helmet mounted display, which allows the pilot to look through the aircraft's walls as if the pilot was floating in space.[5]
- 1901: L. Frank Baum, an author, first mentions the idea of an electronic display/spectacles that overlays data onto real life (in this case 'people'), it's named a 'character marker'. [6]
- 1957-62: Morton Heilig, a cinematographer, creates and patents a simulator called Sensorama with visuals, sound, vibration, and smell.[7]
- 1966: Ivan Sutherland invents the head-mounted display and positions it as a window into a virtual world.
- 1975: Myron Krueger creates Videoplace to allow users to interact with virtual objects for the first time.
- 1989: Jaron Lanier coins the phrase Virtual Reality and creates the first commercial business around virtual worlds.
- 1990: Tom Caudell coins the phrase 'Augmented Reality' while at Boeing helping workers assemble cables into aircraft.[8]
- 1992: L.B. Rosenberg develops one of the first functioning AR systems, called Virtual Fixtures, at the U.S. Air Force Research Laboratory—Armstrong, and demonstrates benefits to human performance.[9][10]
- 1992: Steven Feiner, Blair MacIntyre and Doree Seligmann present the first major paper on an AR system prototype, KARMA, at the Graphics Interface conference. A widely cited version of the paper is published in Communications of the ACM in 1993.
- 1993: Loral WDL, with sponsorship from STRICOM, performed the first demonstration combining live AR-equipped vehicles and manned simulators. Unpublished paper, J. Barrilleaux, "Experiences and Observations in Applying Augmented Reality to Live Training", 1999.[11]
- 1994: Julie Martin creates first 'Augmented Reality Theater production', Dancing In Cyberspace, funded by the Australia Council for the Arts, features dancers and acrobats manipulating body–sized virtual object in real time, projected into the same physical space and performance plane. The acrobats appeared immersed within the virtual object and environments. The installation used Silicon Graphics computers and Polhemus sensing system.
- 1998: Spatial Augmented Reality introduced at University of North Carolina at Chapel Hill by Raskar, Welch, Fuchs.[12]
- 1999: Hirokazu Kato (加藤 博一) created ARToolKit at HITLab, where AR later was further developed by other HITLab scientists, demonstrating it at SIGGRAPH.
- 2000: Bruce H. Thomas develops ARQuake, the first outdoor mobile AR game, demonstrating it in the International Symposium on Wearable Computers.
- 2008: Wikitude AR Travel Guide launches on Oct. 20, 2008 with the G1 Android phone.[13]
- 2009: ARToolkit was ported to Adobe Flash (FLARToolkit) by Saqoosha, bringing augmented reality to the web browser.[14]
- 2009: project SixthSense from MIT showcased projection based wearable AR pendent device.[15]
- 2011 : LASTER Technologies, a French start-up from University of Paris Sud (Orsay), has developed first augmented reality ski goggles[16] in the market, demonstrating it at SIGGRAPH.
The main hardware components for augmented reality are: processor, display, sensors and input devices. These elements, specifically CPU, display, camera and MEMS sensors such as accelerometer, GPS, solid state compass are often present in modern smartphones, which make them prospective AR platforms.
Some examples of spatial augmented reality displays include shader lamps, mobile projectors, virtual tables, and smart projectors, described by O. Bimber and R. Raskar in 2005. Shader lamps, developed by Raskar et al. in 1999, mimic and augment reality by projecting imagery onto neutral objects, providing the opportunity to enhance the object’s appearance with materials of a simple unit- a projector, camera, and sensor. Handheld projectors further this goal by enabling cluster configurations of environment sensing, reducing the need for additional peripheral sensing.[17]
Other tangible applications include table and wall projections. One such innovation, the Extended Virtual Table, separates the virtual from the real by including beam-splitter mirrors attached to the ceiling at an adjustable angle. Virtual showcases, which employ beam-splitter mirrors together with multiple graphics displays, provide an interactive means of simultaneously engaging with the virtual and the real. Altogether, current augmented reality display technology can be applied to improve design and visualization, or function as scientific simulations and tools for education or entertainment. Many more implementations and configurations make spatial augmented reality display an increasingly attractive interactive alternative.
A head-mounted display (HMD) places images of both the physical world and registered virtual graphical objects over the user's view of the world. The HMD's are either optical see-through or video see-through. Optical see-through employs half-silver mirrors to pass images through the lens and overlay information to be reflected into the user's eyes. The HMD must be tracked with sensor that provides six degrees of freedom. This tracking allows the system to align virtual information to the physical world. The main advantage of HMD AR is the user's immersive experience. The graphical information is slaved to the view of the user. The most common products employed are as follows: MicroVision Nomad, Sony Glasstron, Vuzix,[18] Lumus, LASTER Technologies[19] , and I/O Displays.
While the The New York Times reported Google wished to start selling virtual eyeglasses not only for entertainment but also for information and augmented reality by the end of 2012,[20] more recent statements from Google about "Project Glass" (as it is now called) have said a 2012 commercial release is unlikely. [21]
Handheld displays employ a small display that fits in a user's hand. All handheld AR solutions to date opt for video see-through. Initially handheld AR employed fiduciary markers, and later GPS units and MEMS sensors such as digital compasses and six degrees of freedom accelerometer–gyroscope. Today SLAM markerless trackers such as PTAM are starting to come into use. Handheld display AR promises to be the first commercial success for AR technologies. The two main advantages of handheld AR is the portable nature of handheld devices and ubiquitous nature of camera phones. The disadvantages are the physical constraints of the user having to hold the handheld device out in front of them at all times as well as distorting effect of classically wide-angled mobile phone cameras when compared to the real world as viewed through the eye.[22]
Instead of the user wearing or carrying the display such as with head-mounted displays or handheld devices, Spatial Augmented Reality (SAR)[12] makes use of digital projectors to display graphical information onto physical objects. The key difference in SAR is that the display is separated from the users of the system. Because the displays are not associated with each user, SAR scales naturally up to groups of users, thus allowing for collocated collaboration between users. SAR has several advantages over traditional head-mounted displays and handheld devices. The user is not required to carry equipment or wear the display over their eyes. This makes spatial AR a good candidate for collaborative work, as the users can see each other’s faces. A system can be used by multiple people at the same time without each having to wear a head-mounted display.
Spatial AR does not suffer from the limited display resolution of current head-mounted displays and portable devices. A projector based display system can simply incorporate more projectors to expand the display area. Where portable devices have a small window into the world for drawing, a SAR system can display on any number of surfaces of an indoor setting at once. The drawbacks, however, are that SAR systems of projectors do not work so well in sunlight and also require a surface on which to project the computer-generated graphics. Augmentations cannot simply hang in the air as they do with handheld and HMD-based AR. The tangible nature of SAR, though, makes this an ideal technology to support design, as SAR supports both a graphical visualisation and passive haptic sensation for the end users. People are able to touch physical objects, and it is this process that provides the passive haptic sensation.[2][12][23][24][25]
Modern mobile augmented reality systems use one or more of the following tracking technologies: digital cameras and/or other optical sensors, accelerometers, GPS, gyroscopes, solid state compasses, RFID and wireless sensors. These technologies offer varying levels of accuracy and precision. Most important is the position and orientation of the user's head. Tracking the user's hand(s) or a handheld input device can provide a 6DOF interaction technique.[26]
Techniques include the pinch glove,[27] a wand with a button and a smartphone that signals its position and orientation from camera images.
The computer analyzes the sensed visual and other data to synthesize and position augmentations.
A key measure of AR systems is how realistically they integrate augmentations with the real world. The software must derive real world coordinates, independent from the camera, from camera images. That process is called image registration and is part of Azuma's definition of Augmented Reality.
Image registration uses different methods of computer vision, mostly related to video tracking. Many computer vision methods of augmented reality are inherited from visual odometry. Usually those methods consist of two parts. First detect interest points, or fiduciary markers, or optical flow in the camera images. First stage can use feature detection methods like corner detection, blob detection, edge detection or thresholding and/or other image processing methods.
The second stage restores a real world coordinate system from the data obtained in the first stage. Some methods assume objects with known geometry (or fiduciary markers) present in the scene. In some of those cases the scene 3D structure should be precalculated beforehand. If part of the scene is unknown simultaneous localization and mapping (SLAM) can map relative positions. If no information about scene geometry is available, structure from motion methods like bundle adjustment are used. Mathematical methods used in the second stage include projective (epipolar) geometry, geometric algebra, rotation representation with exponential map, kalman and particle filters, nonlinear optimization, robust statistics.
Augmented reality has many applications, and many areas can benefit from the usage of AR technology. At the beginning AR had a military, industrial, and medical focus but soon it was introduced for commercial and entertainment usage.
Complex tasks such as assembly, maintenance, and surgery can be simplified by inserting additional information into the field of view. For example, labels can be displayed on parts of a system to clarify operating instructions for a mechanic who is performing maintenance on the system.[28][29] Assembly lines gain many benefits from the usage of AR; let’s not forget that the coined of the term augmented reality came from two scientists working on Boing so that the workers could had an easier job wiring. Boing is not the only company using AR in assembly, BMW is known for incorporating this technology in their assembly line to improve the welding process of their cars. Volkswagen also uses AR to analyze interfering edges, plan production lines and workshops, compare variance and verify parts. Big machines are difficult to maintain because of the multiple layers or structures they have. With the use of AR the workers can complete their job in a much easier way because AR permits them to look through the machine as if it was with x-ray, pointing them to the problem right away.
AR can provide the surgeon with information of the heartbeat, the blood pressure, the state of the patient’s organ, etc. It can also help the doctor identify the problem with the patient right away. This approach works in a similar as the technicians doing maintenance work. Examples include a virtual X-ray view based on prior tomography or on real time images from ultrasound and confocal microscopy probes[30] or open NMR devices. AR can enhance viewing a fetus inside a mother's womb.[31] See also Mixed reality.
AR can augment the effectiveness of navigation devices. Information can be display on the car indicating information of where the user is going. Not only can information of how to get to the place be offer but about the weather or about the terrain that the person is cruising. AR can provide traffic information to drivers as well as alert the driver in case of an emergency or highlight objects on the road that might not be caught by the driver’s eyes at a first glance. It can also be used in the sea where fishermen can use the technology to display information about the amount of fish that are in the area and how to get to them[32]. Currently some car manufacturers (e.g. BMW and GM) are using this technology in car windshields to display meter information and traffic information[33].
Aboard naval and maritime vessels, AR can allow bridge watch-standers to continuously monitor important information such as a ship's heading and speed while moving throughout the bridge or performing other tasks.[34]
In the area of industrial design AR can provide crucial help, AR can help designer experience the final product before is complete or can help with the testing part of it. Volkswagen is already using AR for comparing calculated and actual crash test imagery. But AR can also be used to visualize and modify a car body curvature or the engine layout of it. AR can also be used to compare digital mock-ups with physical mock-ups for efficiently finding discrepancies between them.[citation needed]
In combat AR provide useful information to the soldiers on where they are, how many enemies are surrounding them and it can spot an enemy that the soldier might not be looking at. AR can be a third eye for the soldier indicating him if there is someone on his back. Not only this but with the usage of AR a soldier doesn’t have to stop to look at a map since the technology can indicate him at all time his location without him taking his eyes out of the field. Snipers can benefit particularly because they can get the information they need to make an accurate shooting without taking the sight of target.[citation needed]
AR can help create art in real time integrating reality such as painting, drawing and modeling. AR art technology has helped disabled individuals to continue pursuing their passion.[35]
AR can simulate planned construction projects.[36]
Augmented reality is being use highly in application for touring. In this case AR is use to highlight information of important places and provide the connection between the real world with an historic event. Meaning that Historical events such as battle reenactments can be augmented onto current landscapes. AR can also provide information of museums and monuments.
The use of AR in this area has enhanced the experience of users when they go traveling by providing not only information of the place they are but comments made by other users that have been there before. AR system in the touring industry can connect different platforms to provide a richer experience to the final user of the system.[37]
Another application given to AR in this field is the possibility for users to rebuild ruins, buildings, or even landscapes as they formerly existed.[38]
AR can help facilitate collaboration among distributed team members via conferences with real and virtual participants.[39]. This technology can also be useful in the case of discussing plans and progress data such as, environmental planners discussing geographical data and urban development, or in a distributed control rooms such as Air Traffic Control operating through a common visualization.[40]
In entertainment not only video games have improve because of AR but also sport broadcasting. Swimming pools, football fields, race tracks and other sports environments are well-known and easily prepared, which video see-through augmentation through tracked camera feeds easy. One example is the Fox-Trax system[41], used to highlight the location of a hard-to-see hockey puck as it moves rapidly across the ice, but AR is also applied to annotate racing cars, snooker ball trajectories, life performances, etc.
AR can enhance concert and theater performances. For example, artists can allow listeners to augment their listening experience by adding their performance to that of other bands/groups of users.[42][43][44]
The gaming industry has benefited a lot form the development of this technology, a number of games have been developed for prepared indoor environments. Early AR games also include AR air hockey, collaborative combat against virtual enemies, and an AR-enhanced pool games. A significant number of games incorporate AR in it and with the introduction of smartphone this has had a bigger impact.
AR can be used to display certain products at another way. For example, the lego-boxes in the lego-store at Schaumburg are fitted with a QR code which show the product when it's assembled.[45] AR can also be used as an aid in picking clothing.[46]
Usage of AR to promote products via interactive AR applications is becoming popular now. For example Nissan (2008 LA Auto Show),[47] Best Buy (2009),[48] and others used webcam based AR to connect 3D models with printed materials. There are numerous examples of connecting mobile AR to outdoor advertising[49][50]
AR systems can provide dynamic subtitles in the user's language.[51][52]
- Ivan Sutherland invented the first AR head-mounted display at Harvard University.
- Steven Feiner, Professor at Columbia University, is a leading pioneer of augmented reality, and author of the first paper on an AR system prototype, KARMA (the Knowledge-based Augmented Reality Maintenance Assistant), along with Blair MacIntyre and Doree Seligmann.[53]
- L.B. Rosenberg developed one of the first known AR systems, called Virtual Fixtures, while working at the U.S. Air Force Armstrong Labs in 1991, and published first study of how an AR system can enhance human performance.[9][10]
- Dieter Schmalstieg and Daniel Wagner jump started the field of AR on mobile phones. They developed the first marker tracking systems for mobile phones and PDAs.[54]
- Bruce H. Thomas and Wayne Piekarski develop the Tinmith system in 1998.[55] They along with Steve Feiner with his MARS system pioneer outdoor augmented reality.
- Reinhold Behringer performed important early work in image registration for augmented reality, and prototype wearable testbeds for augmented reality. [56] [57]He also co-organized the First IEEE International Symposium on Augmented Reality in 1998 (IWAR'98), and co-edited one of the first books on augmented reality.[58]
The primary academic conference in the field is the IEEE International Symposium on Mixed and Augmented Reality (ISMAR).
- 1st International Workshop on Augmented Reality (IWAR'98), San Francisco, United States, November 1998.
- 2nd International Workshop on Augmented Reality (IWAR'99), San Francisco, United States, October 1999.[59]
- 1st International Symposium on Mixed Reality (ISMR'99), Yokohama, Japan, March 1999.
- 2nd International Symposium on Mixed Reality (ISMR'01), Yokohama, Japan, March 2001.
- 1st International Symposium on Augmented Reality (ISAR 2000), Munich, Germany, October 2000.[60]
- 2nd International Symposium on Augmented Reality (ISAR 2001), New York, New York, United States, October 2001.[61]
- 1st International Symposium on Mixed and Augmented Reality (ISMAR 2002), Darmstadt, Germany, October 2002.[62]
- 2nd International Symposium on Mixed and Augmented Reality (ISMAR 2003), Tokyo, Japan, October 2003.[63]
- 3rd International Symposium on Mixed and Augmented Reality (ISMAR 2004), Arlington, Virginia, United States, November 2004.[64]
- 4th International Symposium on Mixed and Augmented Reality (ISMAR 2005), Vienna, Austria, October 2005.[65]
- 5th International Symposium on Mixed and Augmented Reality (ISMAR 2006), Santa Barbara, United States, October 2006.[66]
- 6th International Symposium on Mixed and Augmented Reality (ISMAR 2007), Nara, Japan, November 2007.[67]
- 7th International Symposium on Mixed and Augmented Reality (ISMAR 2008), Cambridge, United Kingdom, September 2008.[68]
- 8th International Symposium on Mixed and Augmented Reality (ISMAR 2009), Orlando, Florida, United States, October 2009.[69]
- 9th International Symposium on Mixed and Augmented Reality (ISMAR 2010), Seoul, Korea, October 2010.[70]
- 10th International Symposium on Mixed and Augmented Reality (ISMAR 2011), Basel, Switzerland October 2011[71]
- 11th International Symposium on Mixed and Augmented Reality (ISMAR 2012), Atlanta, Georgia, United States, November 2012[72]
- Argon, augmented reality browser by Georgia Tech's GVU Center that uses a mix of KML and HTML/JavaScript/CSS to allow developing AR applications; any web content (with appropriate meta-data and properly formatted) can be converted into AR content;[73] as of November 2011[update], available for iPhone only[74].
- ARToolKit, an open source (dual-license: GPL, commercial) C-library to create augmented reality applications; was ported to many different languages and platforms like Android, Flash or Silverlight; very widely used in augmented reality related projects.
- ArUco, a minimal library for augmented reality applications based on OpenCv; licenses: BSD, Linux, Windows[75].
- Goblin XNA, a platform for researching 3D user interfaces, including mobile augmented reality and virtual reality, emphasizing games; written in C#, based on Microsoft XNA Game Studio 4.0, BSD license[76].
- GRATF, open-source (GPLv3) project, which includes C# library for detection, recognition and 3D pose estimation of optical glyphs. The project includes application, which does 2D and 3D augmented reality[77].
- mix Augmented Reality Engine (mixare), open-source (GPLv3) augmented reality engine for Android and iPhone; works as an autonomous application and for developing other implementations[78].
- Open Mobile Augmented Reality (OpenMAR), component framework for the Symbian platform, EPL license;[79] as of November 2011[update], website is down but some information exists elsewhere[80].
- PTAM, non-commercial use only[81].
- metaio Mobile SDK offers free natural features tracking that is available for both Android and iOS. [82]
- Qualcomm AR SDK (QCAR) (renamed to Vuforia) is a free AR solution for detection and tracking of reference images and markers using natural feature detection that is available for both Android and iOS.
- buildAR.com, a web based content platform for building geolocation and natural feature tracking based mobile augmented reality.
- Hoppala Augmentation, a web based content platform for creating geolocation based mobile augmented reality.
- DINOS, hybrid (web and android) based content platform for creating offline and online digital cultural content and geolocation mobile augmented reality, combined with artifical intelligence.
- Woodrow Barfield, and Thomas Caudell, eds. Fundamentals of Wearable Computers and Augmented Reality. Mahwah, NJ: Lawrence Erlbaum, 2001. ISBN 0-8058-2901-6.
- Oliver Bimber and Ramesh Raskar. Spatial Augmented Reality: Merging Real and Virtual Worlds. A K Peters, 2005. ISBN 1-56881-230-2.
- Michael Haller, Mark Billinghurst and Bruce H. Thomas. Emerging Technologies of Augmented Reality: Interfaces and Design. Idea Group Publishing, 2006. ISBN 1-59904-066-2, publisher listing
- Rolf R. Hainich. "The end of Hardware: A Novel Approach to Augmented Reality" 2nd ed.: Booksurge, 2006. ISBN 1-4196-5218-4. 3rd ed. ("Augmented Reality and Beyond"): Booksurge, 2009, ISBN 1-4392-3602-X.
- Stephen Cawood and Mark Fiala. Augmented Reality: A Practical Guide, 2008, ISBN 1-934356-03-4
- Lester Madden. "Professional Augmented Reality Browsers for Smartphones: Programming for junaio, Layar and Wikitude", 2011, ISBN 978-1-119-99281-3
- Tony Mullen. "Prototyping Augmented Reality", 2011, ISBN 978-1-118-03663-1
- Borko Furht. "Handbook of Augmented Reality", 2011, ISBN 978-1-4614-0063-9
- Raghav Sood. "Pro Android Augmented Reality", 2012 ISBN 978-1-4302-3945-1
- R. Behringer, G. Klinker,. D. Mizell (eds.). Augmented Reality - Placing Artificial Objects in Real Scenes. Proceedings of IWAR '98. A.K.Peters, Natick, 1999. ISBN 1-56881-098-9
- The television series Dennō Coil depicts a near-future where children use AR glasses to enhance their environment with games and virtual pets.
- In the Terminator movie series, all Terminator models, beginning with T-800 series, use augmented reality systems to "see".
- The television series Firefly depicts numerous AR applications, including a real-time medical scanner which allows a doctor to use his hands to manipulate a detailed and labeled projection of a patient's brain.
- In the 1993 ABC miniseries Wild Palms, a Scientology-like organization used holographic projectors to overlay virtual reality images over physical reality.
- In the movie Iron Man, Tony Stark (Robert Downey Jr.) uses an augmented reality system to design his super-powered suit. The suit itself also uses augmented reality technology.
- In the Philippines, during their first automated elections (2010), ABS-CBN News and Current Affairs used augmented reality during the counting of votes for all national and local candidates and in delivering news reports. ABS-CBN still uses augmented reality in its TV Patrol and Bandila news programs. In year 2011, TV5 is now also using augmented reality in its flagship newscast Aksyon for the news related informations.
- In Minority Report, Tom Cruise stands in front of a supercomputer using AR technology.
- In the movie RoboCop, RoboCop uses Augmented Reality tech via his head-mounted display to get into the details of a particular person or status quo.
- In the movie, They Live, aliens on Earth use a hypnotic radio frequency causing the human population to see generated images and adverts which mask billboards that actually contain subliminal messaging. Curiously, it takes wearing a head-mounted display (in this case, a pair of sunglasses) in order not to be able to see the AR.[83]
- NBC School Pride debuts AR alive: Letters Alive invented by Randall Self in the Communication & Media Arts High School in Detroit, Michigan[84]
- The television series Fractale occurs in a world where AR is a part of everyday life thanks to the Fractale System.
- Yu-Gi-Oh!'s new series Yu-Gi-Oh! Zexal, duelists uses AR to project duel cards which can be viewed when players wear D-Gazers.
- The unnamed fictional extraterrestrial species featured in the Predator_(franchise) wear an AR Head-mounted_display that allows them to see in multiple spectra of light, as well as acting as a HUD interface with a worn computer.
- The books Halting State by Charles Stross and Rainbows End by Vernor Vinge and the Daemon series by Daniel Suarez include augmented reality primarily in the form of virtual overlays over the real world. Halting State mentions Copspace, which is used by cops, and the use by gamers to overlay their characters onto themselves during a gaming convention. Rainbows End mentions outdoor overlays based on popular fictional universes from H. P. Lovecraft and Terry Pratchett among others. The Daemon series features the "Darknet", which connects human followers and allows them to create their own ranking system and economy among other features.
- William Gibson's novel Spook Country coined the term "Geohacking", where artists use a mix of GPS and 3D graphics technology to embed rendered meshes in real world landscapes.
- In The Risen Empire, by Scott Westerfeld, most—if not all—people have their own "synesthesia". An AR menu unique to the user that is projected in front of them, but they can only see their own synesthesia menus. It is controlled by hand gestures, blink patterns, where the user is looking, clicks of the tongue, etc.
- In the Greg Egan novel Distress, the 'Witness' software used to record sights and sounds experienced by the user can be set up to scan what the user is seeing and highlight people the user is looking out for.
- In the Revelation Space series of novels, Alastair Reynolds characters frequently employ "Entoptics" which are essentially a highly developed form of augmented reality, going so far as to entirely substitute natural perception.
- The book The California Voodoo Game by Larry Niven and Steve Barnes, the game players use LCD displays for what the book calls Dreamtime technology to add virtual overlays to the real world.
- The books Illium and Olympos by Dan Simmons refer to numerous vision and information functions that have been become incorporated into the human body through design (Though the humans in question have no knowledge of these functions, rediscovering them as the story progresses). Augmented reality is taken to an extreme in the 'allnet' function which bombards the viewer with a torrent of data about the surrounding environment.
- Certain gaming devices, such as the PlayStation Eye, Kinect, Nintendo 3DS, PlayStation Portable, PlayStation Vita and some mobile devices, use cameras to augment computer graphics onto live footage. The majority of AR software uses special cards which are read by the device to pinpoint where the graphics will form.
- The table top role-playing game, Shadowrun, introduced AR into its game world. Most of the characters in the game use viewing devices to interact with the AR world most of the time.
- Cybergeneration, a table top role-playing game by R. Talsorian, includes "virtuality", an augmented reality created through v-trodes, cheap, widely available devices people wear at their temples.
- In the video game Heavy Rain, Norman Jayden, an FBI profiler, possesses a set of experimental augmented reality glasses called an "Added Reality Interface", or ARI. It allows him to rapidly investigate crime scenes and analyze evidence, and Norman can use it as a form of entertainment. However, prolonged use will cause side effect such as hallucinations. At one point in the game, overuse of the ARI can kill Norman.
- In Dead Space the RIG worn by Isaac Clarke is thoroughly equipped with augmented reality technology, including a navigation system that projects a line along the best route to his destination, and a system that displays images, video and text in front of him.
- The New Batman: Arkham City game uses AR.
- The new Ubisoft game, Raving Rabbids: Alive & Kicking will feature AR.
- Hydrophobia (video game) from Dark Energy Digital features the MAVI (Mobile Automated Visual Interface), which is a tool used to enhance environmental geometry among other purposes.
- Bandai's 2008 Tuttuki Bako minigame system is described as featuring augmented reality.[85]
see Augmented reality#Software
- ^ "The interactive system is no longer a precise location, but the whole environment; interaction is no longer simply a face-to-screen exchange, but dissolves itself in the surrounding space and objects. Using an information system is no longer exclusively a conscious and intentional act."Brian X. Chen (2009-08-25). "If You’re Not Seeing Data, You’re Not Seeing". Wired. http://www.wired.com/gadgetlab/tag/augmented-reality/. Retrieved 2009-08-26.
- ^ a b R. Azuma, A Survey of Augmented Reality Presence: Teleoperators and Virtual Environments, pp. 355–385, August 1997.
- ^ Ronald T. Azuma (1997-08). "A Survey of Augmented Reality". Presence: Teleoperators and Virtual Environments: 355-385. http://www.cs.unc.edu/~azuma/ARpresence.pdf.
- ^ [1]
- ^ "F-35 Distributed Aperture System EO DAS." Youtube.com. Retrieved: 07 October 2010.
- ^ http://en.wikipedia.org/wiki/The_Master_Key_%28novel%29
- ^ http://www.google.com/patents?q=3050870
- ^ Tom Caudell
- ^ a b L. B. Rosenberg. The Use of Virtual Fixtures As Perceptual Overlays to Enhance Operator Performance in Remote Environments. Technical Report AL-TR-0089, USAF Armstrong Laboratory, Wright-Patterson AFB OH, 1992.
- ^ a b L. B. Rosenberg, "The Use of Virtual Fixtures to Enhance Operator Performance in Telepresence Environments" SPIE Telemanipulator Technology, 1993.
- ^ Experiences and Observations in Applying Augmented Reality to Live Training
- ^ a b c Ramesh Raskar, Greg Welch, Henry Fuchs Spatially Augmented Reality, First International Workshop on Augmented Reality, Sept 1998
- ^ Wikitude AR Travel Guide
- ^ Saqoosha
- ^ BBC SixthSense blurs digital and the real.
- ^ [2] First real augmented reality goggles with informative transparent glass
- ^ Bimber, Oliver. "Spatial augmented reality : merging real and virtual worlds". AK Peters.
- ^ Vuzix
- ^ LASTER Technologies
- ^ "Behind the Google Goggles, Virtual Reality". http://www.nytimes.com/2012/02/23/technology/google-glasses-will-be-powered-by-android.html. Retrieved 2012-02-23. , New York Times.
- ^ "Google Unveils Project Glass: Wearable Augmented-Reality Glasses". http://allthingsd.com/20120404/google-unveils-project-glass-wearable-augmented-reality-glasses/. Retrieved 2012-04-04. , All Things D.
- ^ Feiner, Steve. "Augmented reality: a long way off?". AR Week. Pocket-lint. http://www.pocket-lint.com/news/38869/augmented-reality-interview-steve-feiner. Retrieved 3 March 2011.
- ^ David Drascic of the University of Toronto is a developer of ARGOS: A Display System for Augmenting Reality. David also has a number of AR related papers on line, accessible from his home page.
- ^ Augmented reality brings maps to life July 19, 2005
- ^ Feiner, Steve. "Augmented reality: a long way off?". AR Week. Pocket-lint.com. http://www.pocket-lint.com/news/38802/augmented-reality-maintenance-and-repair. Retrieved 3 March 2011.
- ^ Stationary systems can employ 6DOF track systems such as Polhemus, ViCON, A.R.T, or Ascension.
- ^ Tinmith
- ^ The big idea:Augmented Reality
- ^ Steve Henderson, Steven Feiner. "Augmented Reality for Maintenance and Repair (ARMAR)". http://graphics.cs.columbia.edu/projects/armar/. Retrieved 2010-01-06.
- ^ Peter Mountney, Stamatia Giannarou, Daniel Elson and Guang-Zhong Yang. "Optical Biopsy Mapping for Minimally Invasive Cancer Screening. In proc MICCAI(1), 2009, pp. 483-490". http://www.sciweavers.org/external.php?u=http%3A%2F%2Fwww.doc.ic.ac.uk%2F%7Epmountne%2Fpublications%2FMICCAI%25202009.pdf&p=springer. Retrieved 2010-07-07.
- ^ "UNC Ultrasound/Medical Augmented Reality Research". http://www.cs.unc.edu/Research/us/. Retrieved 2010-01-06.
- ^ Tönnis, M, Sandor, C, Klinker, G, Lange, C and Bubb, H. Experimental evaluation of an augmented reality visualization for directing a car driver‟s attention. In ISMAR’05: Proc. 4th Int’l Symp. on Mixed and Augmented Reality, Vienna, Austria, Oct. 5-8 2005. IEEE CS Press, pp. 56–59
- ^ GM's Enhanced Vision System
- ^ Cheney-Peters, Scott (April 12, 2012). "CIMSEC: Google's AR Goggles". http://cimsec.org/bridgegoggles/. Retrieved 2012-04-20.
- ^ One such example of this phenomenon is called Eyewriter that was developed in 2009 by Zachary Lieberman and a group formed by members of Free Art and Technology (FAT), OpenFrameworks and the Graffiti Research Lab to help a graffiti artist, who became paralyzed, draw again. Zachary Lieberman. "The Eyewriter". http://www.eyewriter.org/. Retrieved 2010-04-27.
- ^ Anish Tripathi. "Augmented Reality: An Application for Architecture". http://www.usc.edu/dept/architecture/mbs/thesis/anish/. Retrieved 2010-01-06.
- ^ Bartie, P and Mackaness, W. Development of a speech-based augmented reality system to support exploration of cityscape. Trans. GIS, 10(1):63–86, 2006
- ^ Patrick Dähne, John N. Karigiannis. "Archeoguide: System Architecture of a Mobile Outdoor Augmented Reality System". http://portal.acm.org/citation.cfm?id=854948. Retrieved 2010-01-06.
- ^ The Hand of God is a good example of a collaboration system. Aaron Stafford, Wayne Piekarski, and Bruce H. Thomas. "Hand of God". http://www.hog3d.net/. Retrieved 2009-12-18.
- ^ Benford, S, Greenhalgh, C, Reynard, G, Brown, C and Koleva, B. Understanding and constructing shared spaces with mixed-reality boundaries. ACM Trans. Computer-Human Interaction, 5(3):185–223, Sep. 1998
- ^ Cavallaro, R. The FoxTrax hockey puck tracking system. IEEE Computer Graphics and Applications, 17 (2):6–12, Mar./Apr. 1997
- ^ Pop group Duran Duran included interactive AR projections in their stage show during their 2000 Pop Trash concert tour. Pair, J., Wilson, J., Chastine, J., Gandy, M. "The Duran Duran Project: The Augmented Reality Toolkit in Live Performance". The First IEEE International Augmented Reality Toolkit Workshop, 2002. (Duran Duran Collaboration: Augmented Reality Technology in Live Performance (2000-2001))
- ^ Sydney band Lost Valentinos launched the world's first interactive AR music video on 16 October 2009, where users could print out 5 markers representing a pre-recorded performance from each band member which they could interact with live and in real-time via their computer webcam and record as their own unique music video clips to share viaYouTube Gizmodo: Sydney Band Uses Augmented Reality For Video Clip
- ^ cnet: Augmented reality in Aussie film clip
- ^ Lego using AR for commercial purposes
- ^ Disney's AR mirror
- ^ Nissan website
- ^ Vlad Savov. "Best Buy goes 3D, even augmented reality isn't safe from advertising". http://www.engadget.com/2009/08/06/best-buy-goes-3d-even-augmented-reality-isnt-safe-from-adverti.
- ^ AR at Disney
- ^ "Futuristic Super 8 Ads Remind Us of Minority Report". PC World. http://www.pcworld.com/article/230118/futuristic_super_8_ads_remind_us_of_minority_report.html.
- ^ iPhone application Word Lens injects subtitles into the desired language in video. [3] Alexia Tsotsis "Word Lens Translates Words Inside of Images. Yes Really." TechCrunch (December 16, 2010)
- ^ [4] N.B. "Word Lens: This changes everything" The Economist: Gulliver blog (December 18, 2010)
- ^ "Knowledge-based augmented reality". ACM. July, 1993. http://portal.acm.org/citation.cfm?id=159587.
- ^ Wagner, Daniel (September 29, 2009). "First Steps Towards Handheld Augmented Reality". ACM. http://portal.acm.org/citation.cfm?id=946910. Retrieved 2009-09-29.
- ^ Pikarski, Wayne and Thomas, Bruce (October 1, 2001). "Tinmith-Metro: New Outdoor Techniques for Creating City Models with an Augmented Reality Wearable Computer". IEEE. http://www.computer.org/portal/web/csdl/doi/10.1109/ISWC.2001.962093. Retrieved 2010-11-09.
- ^ R. Behringer, and N. Ahuja. Image registration for Augmented Reality. Advanced Displays and Interactive Displays Federated Laboratory First Annual Symposium, College Park, MD, January 1997.
- ^ R. Behringer, C. Tam, J. McGee, V. Sundareswaran, Marius Vassiliou. Two Wearable Testbeds for Augmented Reality: itWARNS and WIMMIS. ISWC 2000, Atlanta, October 16-17, 2000.
- ^ R. Behringer, G. Klinker,. D. Mizell (eds.). Augmented Reality - Placing Artificial Objects in Real Scenes. Proceedings of IWAR '98. A.K.Peters, Natick, 1999. ISBN 1-56881-098-9
- ^ "IWAR'99". http://ieeexplore.ieee.org/xpl/tocresult.jsp?isNumber=17413.
- ^ "ISAR 2000". http://ieeexplore.ieee.org/xpl/tocresult.jsp?isNumber=19065.
- ^ "ISAR 2001". http://ieeexplore.ieee.org/xpl/tocresult.jsp?isNumber=20930.
- ^ "ISMAR 2002". http://ieeexplore.ieee.org/xpl/tocresult.jsp?isNumber=24594.
- ^ "ISMAR 2003". http://ieeexplore.ieee.org/xpl/tocresult.jsp?isNumber=27815.
- ^ "ISMAR 2004". http://ieeexplore.ieee.org/xpl/tocresult.jsp?isnumber=30137.
- ^ "ISMAR 2005". http://ieeexplore.ieee.org/xpl/tocresult.jsp?isnumber=32972.
- ^ "ISMAR 2006". http://www.ismar06.org.
- ^ "ISMAR 2007". http://www.ismar07.org/.
- ^ "ISMAR 2008". http://ismar08.org/wiki/doku.php.
- ^ "ISMAR 2009". http://www.ismar09.org.
- ^ "ISMAR 2010". http://www.ismar10.org.
- ^ "ISMAR 2011". http://www.ismar11.org.
- ^ "ISMAR 2012". http://www.ismar12.org.
- ^ "Argon". http://argon.gatech.edu/.
- ^ "Argon". iTunes. Apple Inc. http://itunes.apple.com/app/argon/id396105088. Retrieved 15 November 2011.
- ^ "ArUco". http://www.uco.es/investiga/grupos/ava/node/26.
- ^ "Goblin XNA". http://goblinxna.codeplex.com/.
- ^ "GRATF". http://www.aforgenet.com/projects/gratf/.
- ^ "mixare". http://www.mixare.org/.
- ^ "OpenMAR". http://OpenMAR.org.
- ^ "Symlab.org: OpenMAR". http://www.symlab.org/wiki/index.php/OpenMAR.
- ^ "PTAM". http://www.robots.ox.ac.uk/~gk/PTAM/.
- ^ http://www.metaio.com/software/mobile-sdk/
- ^ Miles, Stuart. "Top 10 uses of augmented reality in the movies". AR Week. Pocket-lint.com. http://www.pocket-lint.com/news/38805/best-augmented-reality-in-movies. Retrieved 1 March 2011.
- ^ Dybis, Karen (August 6, 2010). "Some Genuine Detroit 'School Pride'". Time. http://detroit.blogs.time.com/2010/08/06/some-genuine-detroit-school-pride/. Retrieved October 7, 2010.
- ^ Toto, Serkan. Augmented Reality? The Tuttuki Bako box needs your finger to play with virtual characters. CrunchGear. 8 October 2008.
Azuma, R. T. (1997). A Survey of Augmented Realty. Presence, 6(4), 355-385.
Azuma, R. T., Baillot, Y., Behringer, R., Feiner, S., Julier, S., & MacIntyre, B. (2001). Recent Advances in Augmented Reality. IEEE Computer Graphics and Applications, 21(6), 34-47.
Milgram, P., et al. Augmented reality: a class of displays on the reality-virtuality continuum. in SPIE Volume 2351: Telemanipulator and Telepresence Technologies. 1994.
Augmented reality at the Open Directory Project
Media related to Augmented reality at Wikimedia Commons
|
|
|
| Concepts |
|
|
| Technology |
|
|
| Tracking |
|
|
| Applications |
|
|
| See also |
|
|
![Mobile Augmented Reality Is The Future [ColdFustion TV Ep 2]](http://web.archive.org./web/20130822020442im_/http://i.ytimg.com/vi/jelW5phB2r4/default.jpg "Mobile Augmented Reality Is The Future [ColdFustion TV Ep 2]")
