AR+AI: Evolution from tool to “second brain”

In an era of rapid technological development, soon you will no longer need to frequently look down at your phone. With just a pair of lightweight glasses, you can obtain information, translate, perceive situations, think, and even predict your needs in real time. This is not a science fiction movie, but a real experience brought about by the integration of AI and AR technology.

The integration of AI and AR technology provides consumers with a more natural and convenient interactive experience and is leading a smart hardware revolution. Andrew Bosworth, CTO of Meta Company, once told the media: “Always-online AI experience will allow smart glasses to replace smartphones” [1], and this future is accelerating.

01. AI Big Model: Technical Inclusion and Personalized AI

The rapid development of AI technology is profoundly changing our world. The emergence of large-scale reasoning models has given AI the ability to "think like humans." It can not only understand the surface meaning of text, but also gain in-depth insight into context and logic, and generate responses that are closer to human thinking. This breakthrough capability has greatly improved the basic application level of AI and shown great potential in people's daily work.

The emergence of DeepSeek is particularly eye-catching. It significantly improves the pre-training efficiency and inference speed of large inference models through optimized algorithm and architecture design, and significantly reduces the training time and inference cost of the model. This enables AI applications to be more widely deployed on a variety of devices, including mobile devices with limited resources, truly realizing the universalization of AI technology.

Some capabilities of AI large models

With the continuous enhancement of AI capabilities and the increasing abundance of tools, "how to use AI more efficiently and conveniently" has become an important issue that needs to be solved urgently. However, everyone's needs are unique, such as different use cases such as text, images, videos, code generation, etc. Multi-modal large models that integrate different types of data can provide personalized services for everyone and meet the needs of diverse application scenarios.

Therefore, AI applications are evolving from "smarter" to "understanding you better". By continuously analyzing behavioral data, the AI ​​system can continuously optimize its own performance and services and truly realize "personalized AI", which will promote the penetration of AI into wider application fields and deeper application scenarios.

02. All-weather AI assistant, from “omnipotent” to “anywhere, anytime”

In AI applications, “input” and “output” are equally important. "Input" is what you tell the AI ​​to analyze and execute, while "output" is the results that the AI ​​feeds back to you, which can be text, sound, pictures, or videos. at present, The most frequently used device for AI is still the PC, but this is not the most “natural” way to interact with AI.

"All-Weather AI Assistant" allows users to obtain information and interact anytime and anywhere without relying on mobile phones or PCs. This kind of convenience and naturalness is unmatched by traditional equipment. Today, the voice mode of ChatGPT has been widely used and has become a high-frequency input method. In other words, the flexibility and convenience of AI applications should no longer be limited by the form of the device.

Based on this concept, brooch-type and handheld AI terminals including AI Pin and Rabbit R1 have previously appeared. The consistent goal of these devices is to improve the flexibility of AI use. However, these AI-specific devices have not received good market feedback. In addition to the experience differences in the form of the devices themselves, an important decisive factor is "interaction convenience."

When AI becomes "omnipotent", the more ideal way of interaction is to initiate commands and return results "anytime and anywhere". For example, in the kitchen when your hands are busy When you're busy, you can look up recipes or set a virtual timer at any time. This means that the 24/7 AI assistant needs an “Always On” device to sense your needs.

Payment Scenario - Rokid Glasses

From the perspective of convenience, although TWS headsets are currently widely used and perform well, smart glasses clearly have more advantages in terms of comfort and functional integration for long-term wearing, and are an ideal carrier of AI technology. AR glasses not only have the "Always On" capability, but also provide a "visual display output window" for AI, which can integrate visual, auditory and other multi-modal information, thereby providing a more natural interactive experience.

The cameras, microphones and other sensors equipped with smart glasses provide AI with a data dimension that far exceeds that of smartphones, making it more powerful in supporting multi-modal large models. As Meta CEO Zuckerberg said: "(Smart glasses) are ideal AI terminals. Its unique positioning allows you to see what you see and hear what you hear." [2]

03. AR+AI: Reshaping the boundaries of human-machine collaboration

Not only that, AI further transforms AR glasses into your "personal assistant" and even your "second brain." It can provide personalized information based on your preferences or historical behavior Personalized content and services, such as recommended book lists or movie and TV series based on your reading habits or movie-watching preferences. The Verge mentioned in an article on the experience of Android XR and smart glasses prototype devices: "In this hour, I felt like Tony Stark (Iron Man), and Gemini was my J.A.R.V.I.S." [3].

When AI is combined with the visual display and perception capabilities of AR glasses, it can also predict your needs in advance, bringing a more transformative experience. For example, when you are traveling, it will remind you of your hotel room number; when you look at a foreign language menu in a restaurant, it will prompt you whether translation is needed; when you install furniture, it will highlight the tools used in each step and inform you of the next steps.

However, for AR glasses to become the best carrier of AI, the key challenge is to achieve lightweight and ergonomic design to support all-weather wear.

For a wearable device, especially "glasses", it is "Always On" is not an easy task. Every inch of space in glasses is extremely valuable, among which: optical display solutions have the most significant impact on the form of AR glasses products. Many AR glasses based on LCoS, DLP display solutions or BirdBath optical solutions are not only larger in size, but are not conducive to miniaturization and lightweighting, and cannot meet the aesthetic requirements of AR daily wear.

Even G1 A [4]

MicroLED microdisplay solution plays an important role in providing users with "all-weather AI assistant". With its advantages of "small size, high brightness, and low power consumption", it has become an ideal optical solution for lightweight AR glasses. Currently, the smallest MicroLED light engine is only 0.15 cubic centimeters in size and as light as 0.3 grams, which can easily help terminal manufacturers create AR glasses that are more in line with daily wearing habits. For example, Vuzix Z100, OPPO Air Glass 2 and other AR products based on JBD MicroLED microdisplays not only look like ordinary glasses, but also weigh as light as more than 30 grams, providing a perfect foundation for all-weather wear.

Through innovative breakthroughs in extreme lightweight, MicroLED new display technology is driving AR glasses into the mainstream field of vision. At the same time, the rapid iteration of AI technology, all-weather online, and natural and smooth interactive experience are driving smart glasses to integrate into all aspects of people's lives at an unprecedented speed.

AR+AI not only reshapes our connection with the world The connection method has opened up a new generation of human-computer interaction experience, and will evolve into the "second brain" of human beings, bringing more convenience and innovation to people, and leading us towards a smarter and better future.