Augmented Reality (AR) System Basics

This article explores the fundamentals of Augmented Reality (AR) and how it functions. It outlines the key components of an AR system and its operation. The concept of AR gained significant attention with the popularity of the online game “Pokemon Go.” Since then, numerous applications for Android and iOS devices have been developed utilizing AR technology.

AR essentially blends the real environment with virtual objects, as illustrated in Figure 1.

The physical environment around us is enhanced by overlaying virtual elements, as depicted in the image below:

Key characteristics of Augmented Reality Systems:

• Overlapping of real and digital worlds.
• Registration and alignment in 3D space.
• Real-time interaction.

Examples of Augmented Reality applications:

• Virtual Dressing Rooms: Potential buyers can select clothing and accessories and “try them on” virtually without physically needing to do so.
• Military Applications: Soldiers can access real-time battlefield data on AR-enabled goggles, helping them navigate potentially dangerous situations.
• Online Games and Apps: Popular examples include Pokemon Go and similar AR-based entertainment.

How Augmented Reality Works: AR System Components

Figure 2 illustrates the primary components of an augmented reality system. It includes sensors/tracking, user input devices, a CPU, and display/output devices.

• Sensors/Tracking: This includes accelerometers, optical sensors (capturing visual images of the user’s environment), GPS receivers (tracking the user’s geographical location), compasses (determining geographical orientation), and gyroscopes (determining rotational movement including roll, yaw, and pitch).
• User Input Devices: These include microphones, touch screens, and gesture recognition devices.
• CPU: Various types of CPUs can be used in AR systems.
• Display/Output Devices: These are wearable devices that provide outputs in visual, audible, and haptic forms.

Types of Augmented Reality Systems

Different augmented reality systems exist. While their specific operations vary, they all share the same basic components as described above.

• Marker-based Augmented Reality: This utilizes QR code scanning via a mobile camera. The software recognizes the QR code pattern, superimposes a digital image on the mobile screen, and provides a 3D image.
• Location-based Augmented Reality: This utilizes a smartphone and a GPS app. The GPS software recognizes the device’s location within the app. This digital information is then matched with the real-world scene captured by the smartphone’s camera. Navigation is a common application of this method.
• Superimposition-based Augmented Reality: In this type, an augmented view is superimposed directly onto the real view of an object.
• Projection-based Augmented Reality: This type projects virtual images onto physical objects, allowing users to interact with and even “touch” the virtual image with their hands.