IoT Enabled Mixed Reality Advertising Using AR Glasses
IoT Enabled Mixed Reality Advertising Using AR Glasses
Author: Syed Muzammiluddin
Syed Muzammiluddin is a passionate Flutter developer and tech innovator from Karimnagar, Telangana, India. He completed his B.Tech in Engineering from VITS College (affiliated with JNTUH). His interests include IoT, Artificial Intelligence, Augmented and Mixed Reality, and their applications in real-world problem solving. He is the founder of Diwage, a construction-related digital platform, and aims to build smart, connected systems that merge the physical and digital worlds through advanced technology.
Abstract:
Traditional advertising methods are increasingly losing effectiveness as audiences demand more immersive and personalized experiences. This research presents an IoT-enabled Mixed Reality (MR) advertising framework that utilizes AR glasses to project intelligent, context-aware 3D advertisements directly into the user’s physical environment. The proposed system integrates ARCore-based spatial mapping, computer vision for object detection, and IoT sensor networks to collect real-time environmental and behavioral data. These data points such as location, temperature, and user interaction history enable precise ad personalization, ensuring each advertisement is relevant to the user’s surroundings and preferences. Experimental simulations indicate improved engagement, attention retention, and brand recall compared to traditional advertising methods. The findings highlight the potential of combining IoT, AI, and Mixed Reality to create adaptive, intelligent, and highly immersive advertising experiences that bridge the digital and physical worlds.
Keywords: Mixed Reality, Augmented Reality, AR Glasses, Immersive Advertising, IoT
1.INTRODUCTION
Traditional outdoor advertising such as billboards, flex boards, and posters has long dominated marketing spaces in cities. However, these static ads lack interactivity, personalization, and adaptability to user contexts. With the rise of Mixed Reality (MR) and Internet of Things (IoT) technologies, advertising can now move beyond physical limitations. This research proposes an MR-based advertising system using AR glasses that overlays digital ads seamlessly onto real-world environments. By leveraging IoT data, the system personalizes advertisements based on user location, preferences, and surroundings, creating a dynamic, immersive, and intelligent marketing experience.
2.EXISTING SYSTEM:
Current digital advertising systems primarily rely on two major platforms: traditional physical billboards and screen-based digital ads (mobile apps, web platforms, and smart displays). Outdoor advertisements such as hoardings, printed banners, and digital LED billboards are static in nature and deliver the same content to every viewer irrespective of their interests, context, or real-time environment. Even modern programmatic advertising, which operates on smartphones and web browsers, remains limited to two-dimensional screens and lacks integration with the user’s physical surroundings.
Some early implementations of Augmented Reality advertising exist in mobile applications for example, AR try-on features in retail apps or AR filters in social media platforms like Snapchat and Instagram. However, these systems are device-dependent, require active user participation through smartphones, and do not operate continuously in real-world environments. Similarly, IoT-enabled advertising solutions such as smart billboards can change content based on traffic or time-of-day data, but they still cannot personalize ads at the individual user level nor embed advertisements within the user’s direct field of view.
In summary, the existing systems suffer from several limitations:
Ads are non-immersive and disconnected from real surroundings
Personalization is either minimal or based only on digital browsing behavior
No support for continuous mixed-reality overlays in real physical spaces
IoT-based ads are limited to macro-level context, not user-level targeting
User engagement and interaction remain low due to passive delivery methods
These gaps highlight the need for a more advanced solution that combines Mixed Reality visualization, IoT-driven context, and real-time personalization, which the proposed system aims to address.
3.MY APPROACH:
In the real world, when we walk or drive, we constantly encounter static advertisements on roadsides, buildings, shop boards, traffic dividers, and even public spaces. These ads are non-interactive, location-fixed, and same for everyone, regardless of who’s looking.
But in the Mixed Reality (MR) world, this can be completely reimagined. Using AR glasses (like Meta Quest 3, Apple Vision Pro, or Android XR), users can experience virtual billboards or floating ads perfectly aligned with real-world surfaces like walls, shop fronts, or bus stops but visible only through the glasses.
Now here’s the smart part of your idea
With IoT integration, these MR ads can change based on time, weather, location, or user preferences.
For example:
A person walking near a coffee shop at 8 AM might see an ad for hot cappuccino.
The same location at night could display a pizza or movie ad.
4.SYSTEM ARCHITECTURE:
The proposed Mixed Reality (MR) advertising framework operates through multiple integrated layers that connect hardware, software, IoT, and intelligent decision-making modules. This architecture ensures real-time rendering of personalized advertisements within the user’s physical environment.
4.1) Hardware Layer (User Device – AR Glasses)
This layer comprises the physical components responsible for capturing environmental data and displaying virtual advertisements.
Camera & LiDAR Sensors capture visuals and depth information for spatial understanding.
Motion Sensors (IMU, Gyroscope) detect head movement and orientation for accurate alignment of virtual ads.
Onboard Processor (e.g., Snapdragon XR2) handles AR computations and rendering tasks.
Optical Display Module projects digital content seamlessly into the real-world view.
Wireless Connectivity (Wi-Fi/Bluetooth) enables synchronization with IoT devices and local data sources.
4.2) On-Device Software Layer
This layer manages spatial mapping, ad rendering, and user interaction directly on the AR glasses, ensuring low latency and autonomy.
Operating Environment (Android XR Platform) Provides system-level support for MR experiences and optimized performance for XR hardware.
AR Framework (ARCore / ARKit) Performs surface detection, spatial tracking, and environmental understanding.
Rendering Engine (Unity / Unreal Engine) Renders interactive 2D/3D advertisement assets in real time.
Computer Vision Module Identifies surfaces, landmarks, or contextual objects for ad placement.
User Interaction Interface Facilitates gesture, gaze, or voice-based engagement with the ads.
4.3) IoT Integration Layer
This layer brings real-world context into the MR environment through connected sensors and devices.
Environmental Sensors (Weather, Traffic, GPS Beacons) Supply contextual triggers for dynamic ad updates.
Smart Retail / Smart City Systems Provide proximity and time-based advertising cues.
IoT Gateway / MQTT Broker Enables secure data transmission between IoT networks and the AR device.
4.4) Ad Personalization & Decision Layer
Determines which advertisement is most relevant for a particular user and context.
Context Analysis Engine Evaluates environmental and sensor data.
User Behavior Model Considers gaze duration, movement patterns, and prior interactions.
Ad Selection Algorithm Uses machine-learning or rule-based logic to select the most suitable ad in real time.
4.5) Analytics & Feedback Layer
Measures performance and continuously refines the advertising strategy.
Engagement Tracking (View Time, Gestures) Records user interaction metrics.
Performance Analytics Dashboard Visualizes impressions and engagement data.
Reinforcement Feedback Loop Updates personalization algorithms based on historical insights.
5.CONCLUSION:
This research presents a new idea for using IoT and Mixed Reality to make advertising more interactive, personalized, and engaging. Instead of static billboards and flex boards, digital ads can appear directly in the user’s surroundings through AR glasses. By using real-time data like location and weather, ads can be shown according to the user’s context and interest. This concept can change the way people experience ads, making them more effective and immersive in the future.
6.REFERENCES:
[1] Azuma, R. T. (1997). A Survey of Augmented Reality. Presence: Teleoperators and Virtual Environments.
[2] Craig, A. B. (2013). Understanding Augmented Reality: Concepts and Applications. Morgan Kaufmann.
[3] Milgram, P., & Kishino, F. (1994). A Taxonomy of Mixed Reality Visual Displays. IEICE Transactions on Information Systems.
[4] Billinghurst, M., Clark, A., & Lee, G. (2015). A Survey of Augmented Reality. Foundations and Trends in Human–Computer Interaction.
[5] Flavián, C., Ibáñez-Sánchez, S., & Orús, C. (2019). The Impact of Virtual, Augmented and Mixed Reality Technologies on Marketing. Journal of Business Research.
[6] López, G., & Pardo, A. (2018). Personalized Digital Advertising Using IoT and Context Awareness. IEEE Internet of Things Journal.
[7] Huang, T.-L., & Liao, S. (2015). A Model of Acceptance of Augmented-Reality Interactive Technology: Applications in Advertising. Journal of Interactive Marketing.
[8] Van Krevelen, D. W., & Poelman, R. (2010). A Survey of Augmented Reality Technologies, Applications and Limitations. International Journal of Virtual Reality.
[9] Google ARCore Developer Guide. (2023). ARCore: Augmented Reality SDK Documentation. Google Developers.
[10] Firebase Documentation. (2023). Cloud Firestore for Real-Time Data Synchronization. Google Cloud.
[11] Xu, H., Teo, H. H., Tan, B. C., & Agarwal, R. (2009). The Role of Push–Pull Technology in Privacy Calculus: The Case of Location-Based Advertising. Journal of Management Information Systems.
[12] Perera, C., Liu, C. H., Jayawardena, S., & Chen, M. (2014). A Survey on Internet of Things From Industrial Market Perspective. IEEE Access.
[13] Atzori, L., Iera, A., & Morabito, G. (2010). The Internet of Things: A Survey. Computer Networks.
[14] Ali, M., & Awad, A. I. (2018). Cyber Physical Systems in Advertising: Context-Aware IoT-Enabled Smart Billboards. IEEE Communications Magazine.
[15] Rauschnabel, P. A., Felix, R., & Hinsch, C. (2022). Augmented Reality Marketing: How to Optimize Consumer Experiences Using Immersive Technologies. Journal of Business Research.