After the release of “Meta Quest 3” in 2023, Meta willMR(Mixed Reality)We are focusing on expanding the On April 23, 2024, the company announced that it would deploy the platform it had been developing for the Quest series as “Horizon OS” as the OS for XR devices of partner companies. Additionally, the app store will also be open to third parties.
With Apple releasing its spatial computer “Vision Pro” and rumors that Google will announce an XR device, Meta is showing rapid movement. Furthermore, at the end of April, Meta’s VP of Mixed Reality, who was visiting Japan,mark lovekinHe gave a joint interview to Japanese media.
Mogura VR News participated in this interview. In this article, the content will be reorganized and delivered.
(Mark Rabkin, VP of Mixed Reality at Meta)
“Quest 3 sales are higher than expected” in Japan
——Please tell us why you came to Japan this time.
Mr. Mark Lovekin (hereinafter referred to as Lovekin):
I always look forward to coming to Japan. and,We are paying close attention to the Japanese market.Before launching a new device, we predict sales in each country.Sales of Meta Quest 3 in Japan are exceeding expectations. For Meta,Japan ranks among the top countries expected to expand in the future.Japan is a country with a large population, an economic powerhouse, a deep knowledge of technology, and a passion for the virtual world.
On this visit to Japan, I brought along members of my team, from engineering to product design. It’s a kind of “immersive trip” where we come to learn more about the Japanese market.
Last weekend, we visited the homes of 12 Japanese Quest 3 users to see how they actually experience the Quest 3.One of the people I visited was a university student living in Edogawa Ward, Tokyo, and a gamer who also owned a PlayStation 4, 5, and Vita. After he finished playing games, he used his Quest 3 to work on his university assignments for five hours every day. This is a very interesting usage.
We also communicated with developers and creators in Japan this time.
——Was there anything impressive about you when you met Japanese creators?
Lovekin:
I also met a VTuber who uses Quest to stream. The VTuber trend is a very interesting trend that originated in Japan and is spreading all over the world. Everyone is streaming using Quest 3 and Quest Pro. Currently, I am distributing a combination of about 5 pieces of software.If we improve the software, wouldn’t it be possible to complete the process with less software or just a headset?I thought.
Meta is working on easier whole-body tracking (full body tracking, abbreviated as “Furutra”) technology by making full use of cameras and AI. In the future, it may be possible to become a VTuber without wearing multiple sensors.
——So you’re also paying attention to VTubers.
Lovekin:
VTuber is popular mainly in Japan, but I think it’s a field that will grow worldwide. We’re also passionate about supporting creators, and we’re looking forward to providing more tools.
We are also actively investing in Avatar. The default avatar system will be more customizable, allowing you to express yourself in a variety of ways. A VTuber I met the other day said, “I met people through avatars and developed friendships with them, and I even met them in real life.” Her friends are a cute anime-style avatar of a girl and a billiard ball avatar.This is… Great communication. There should be no limits to expression in the world of the Metaverse. I would like to be able to express various things with avatars.
MR is the beginning of a new era different from VR
——Rabkin-san is currently in charge of MR, but originally you were the VP in charge of VR. Why was it changed?
Lovekin:
Since the launch of Quest 3,MR realized that “it’s not just a VR headset with a camera, it’s something completely new.”The experience is different and the use case is different. People want to try MR, so they ask people who have a Quest 3, “Can I try it?” In other words, they are interested in MR.
MR headsets and VR headsets are different types of devices, and I believe we have entered a new era. We changed the name of the department to let the world know.The skin of inari sushi eaten in Japan (deep-fried tofu) is made from the same ingredients as tofu. But it tastes different from tofu. The relationship between MR and VR may be like inari sushi and tofu.
——I think that analogy is apt (lol). By the way, what kind of worldview does “MR” refer to?
Lovekin:
In MR,It’s completely “mixed”.I thought a 2D panel was appearing, but a 3D object pops out while the same app is open. Sometimes you are completely immersed in the world, and other times you are immersed only 180 degrees in front of you, and the real world spreads out on the other side. It is difficult to define in detail “what is MR and what is not,” but MR allows you to see the real world through pass-through and also see the virtual world. What connects them is Horizon OS, which was announced this morning.
and,Not only the world but also relationships with people will become a seamless blend of reality and virtuality.
We are a data-driven company. Up until now, we have been looking at length of stay as an indicator. From now on, I think we need to be even more conscious of other indicators. We need a different measure of how people experience the world, with apps floating in their “home” environment.
——When compared to Apple Vision Pro (AVP), I get the impression that AVP is a more general-purpose computing device, while Quest 3 is a content-oriented device.
Lovekin:
Actually, I think the Quest 3 is a general-purpose device that can do a lot more than the AVP. The users we saw this week were not only playing games, but also watching movies and anime, and using it for work. Sometimes the device was used alone, and sometimes it was connected to a PC.
We believe there are five major use cases for MR. This time, we actually confirmed that Quest 3 is being used in these five ways in Japan as well.
The first one is of coursegamingis. We already have a lot of content. Games made by Japanese developers are also being released. I think it would be great if more content came out from Japan.And the second issocialis. In the United States, gaming and social networking are strongly connected, but in Japan, they are separate from each other. People access social VR with avatars, hang out, and enjoy communication.
The presence of real space in MR has created a large demand formedia viewingandfitness,andProductivity (work)is. Fitness has always been in demand in VR, but it’s even more popular in MR. The same goes for media viewing and productivity. With MR, you can put a big screen in your house, or if you don’t want to see inside your house, you can put it in a virtual environment. This switching is a characteristic of MR.
I think this alone is used for quite a variety of purposes, but we feel that users have even more expectations, so we decided to collaborate with a partner (*Editor’s note: For games, ASUS and Xbox , productivity seems to refer to Lenovo, respectively).
(Mr. Rabkin tried to lighten the mood by saying, “The children’s lunch bag I bought in Japan is perfect for putting the Quest 3 in, so I’m hesitant to give it to my child.”) He also joked throughout the interview. (He was a friendly person)
What is Meta challenging with “Horizon OS”? “Windows”?
——Mr. Lovekin, please give us your comments regarding the Horizon OS that was just announced.
Lovekin:
MR is the beginning of a new era. Looking at the sales of Quest 3, there is no doubt that we have entered a new phase. We are confident that this market will grow more than 10 times its current size. I also believe that we have reached a sufficient level technologically. From now on, we would like to further accelerate this market together with many partner companies.
Lovekin:
So we decided to open up both the hardware and software. Quest 3 is a mid-range device. We strive to provide devices that are as easy to use and reach as possible for everyone. On the other hand, we also know that there is a strong need to use MR for specific purposes. Developing an MR headset is a series of compromises. You have to give up something else in order to achieve something.
Quest 3 aimed to be a universal device. To match use cases, we decided to work with partners who are passionate in their respective fields to develop devices that are more specialized in the market and suited to each company’s customer base.
I am a gamer myself and have an ASUS ROG branded device. Therefore, the headset coming from ROG will be aimed at the most hardcore gamers. Lenovo will roll out devices aimed at increasing productivity for businesses. And not to mention the Xbox. Quest 3 is the perfect device for enjoying games on a big screen.
——What about software?
Lovekin:
Regarding software, I would like to see more developers participate in MR app development. The Horizon OS store is open. Unlike so-called game console stores, approvals are fast and apps can be distributed quickly.
The “Spatial Framework” we provide is a small extension that allows you to add 3D elements to 2D apps. It will also be possible to create 3D expressions within a rectangular frame, which can be called “2.5D.” Although it is a small expression, the lighting in the environment is clearly reflected.
We believe Meta Horizon OS is the world’s best Spatial Social Operating System. It encompasses the worlds of VR, MR, 2D and 3D, and allows you to experience these worlds together rather than through video calls. It also makes it easier to incorporate social elements through avatars.
——Are there any plans for linking with 2D apps for Android? CTO Andrew Bosworth has even talked about introducing the Google Play Store. Is there any possibility of it happening?
Lovekin:
We want Meta Horizon Store to be one of the largest 2D app stores in the world. Even Android developers can add 3D functionality to 2D apps using Meta Horizon OS’s Spatial Framework. There’s nothing better than giving your users more app options.
If Google were to join our open platform, we would be very welcome (lol), but I think it’s something that Google has to decide on as well.
——What does the “open” concept that Meta aims for with Horizon OS mean? Simply put, Android and Windows have different degrees of openness. To what extent will Horizon OS open up and develop partnerships?
Lovekin:
If we were to compare Android and Windows—although they are strictly different—If anything, I think the style will be more similar to Windows.It already allows side loading. We already have Steam Link for connection with the PC as well.
We believe that it is better to have as much content as possible that is compatible with devices. The range of things that the devices themselves can do is expanding. That’s why we want to further pursue use cases with our partners. We also want to increase the number of partners as much as possible, but this announcement is the first step. In the future, we would like to monitor the situation and expand.
In terms of openness,What we value most is the user’s perspective.I would like to create a path where users can do what they want. Steam Link and Xbox Live are perfect examples. We also make it possible to do things in the browser that cannot be done in the app.
The store will continue to be activated so developers can continue to monetize it. I think competition creates value and makes the store easier for users to use.
——From a developer’s perspective, why do you think the Meta platform is chosen?
Lovekin:
You already have a large audience, which means you can reach as many people as possible with your content. I also think that the key point is to be able to repeat the cycle of learning in order to grow further.I am confident that if we release it on Quest, we will definitely get a positive response from users.
Furthermore, we would like to make development even easier. If you’re a game developer, use Unity or Unreal Engine; if you’re a mobile developer, use Android. If you are a creator who doesn’t do much coding, you can use Horizon Worlds to create a metaverse game world or a comedy club world without code. MR content can also be developed on the web.We plan to roll out a generative AI tool for creators within the next year.
Quest series continues to be developed as affordable devices
——How will the Quest series develop in the future while collaborating with external partners?
Lovekin:
Our goal is to “deliver devices that everyone around the world can experience.” This is Meta’s philosophy.Even if you spend thousands of dollars on a device packed with cutting-edge technology, not everyone can afford it. We’re thinking about removing one zero from the price tag. With so many technologies available, we create devices that are the easiest to use, most affordable, most versatile, and most affordable.
Horizon OS will also be integrated into the Metaverse. We aim to make it easy to use, easy to operate, easy to connect with friends, and easy to communicate with new people.
We will continue to provide devices that are cheap and easy to use. Of course it’s not easy. Mark (Meta CEO Mark Zuckerberg) has high standards (lol). We are always asked to adopt the cutting edge of each generation. But prices have to be kept down. This is also Mark’s request, so we always work hard.
Mark is passionate and excited about this area. We present a vision and use it as the driving force to move forward.
——What will Meta’s hardware product strategy be in the future?
Lovekin:
I can’t reveal the specific strategy here, but we are making a large number of prototypes. We will continue to take a broad approach as we roll out devices like Quest. Glass-style devices like the Rayban-Meta are one such device. Ray-ban Meta features built-in Meta AI to interactively navigate what you’re looking at.
As for true smart glasses, we’re still pretty close.On the other hand,In order to mount a screen on the camera, there are still several technical points that must be overcome, and we are currently working on them.However, I feel that the time it takes for a device to become truly usable has been shortened by five years due to generation AI.
We are researching and developing multiple glass devices and multiple headsets simultaneously. Among them, we will continue to develop the ones that are most suitable for the market at the time.
—— Regarding semiconductors, Quest uses Qualcomm technology for its SoC. Is there a possibility that you will design AI-related chips in-house in the future?
Lovekin:
I’m not a semiconductor expert, but I’ll give you a general answer. We’re always striving to make your devices perform like magic. Many things must be considered at the same time, such as size, power consumption, and heat. At Quest, our partnership with Qualcomm allows us to use SoCs that provide optimal performance for us. I think customization is a must for AR and MR, so I’m very happy with this partnership.
(“Snapdragon are preferentially adopted)
Lovekin:
The Quest 3 generation uses a more customized chip to achieve MR. Quest 3 has a design that emphasizes heat exhaustion, consumes twice as much power as Quest 2, but achieves 2.5 times the GPU performance.
If there is demand for a new feature, it should be implemented immediately.
——The other day, Meta posted a blog that talks about the history of Oculus, as it has been 10 years since the company acquired it. What has the last 10 years been like for you?
Lovekin:
First of all, I started to have gray hair (lol).And I think it’s been a great 10 years.Ten years ago, it started with a very small number of “True Believers.” And (with the first Oculus Rift released in 2016) you installed sensors in your room and connected them with cables, but even then the tracking range was limited… Now, tracking is wider, devices are lighter and more affordable. It is used by ordinary people all over the world, and it is now possible to visit their homes. We watch anime, do fitness, and play games on our devices. When we ask them, “Is it difficult to use the headset? Is there anything else that needs to be fixed?” the answer is that they are quite satisfied. We are proud of how far we have come.
(This photo was taken in 2014 of using the Oculus Rift DK2. At that time, there was not even an official Oculus 6DoF controller.)
Lovekin:
Personally, I have never worked in a job that involved me in such a deep way. We have received many requests this past week. It would be better to make the sensor stronger. It would be better to change the coating of the lens. It would be better to reduce the delay between camera and screen synchronization. I want the avatars to be cuter. etc…….
We must respond to a wide variety of issues at the same time. By facing and solving all the problems, the level of the experience will increase. This is a really great process.
——The realization of XR is a long journey. Meta has been investing for 10 years, but for players in the industry, it is necessary to “survive” through ups and downs. What do you think is important for XR players to continue to survive and move into the future?
Lovekin:
We’ve come a very long way in the 10 years since we acquired Oculus. Then Quest emerged as a mainstream device. In Japan, you can also buy it at Yodobashi Camera. At Meta, we’ve done our best to do what we can in this area and provide what we can to developers.
Lovekin:
If you had any advice to give to developers, what would it be?New demands are emerging one after another in this area.about it. We have been creating new devices to meet demand. Devices can do more and more things. Users want these features.We recommend that you respond quickly to new features and let a variety of users try them out.
The world is changing. Rather than spending three years creating content as in traditional game development, you should aim to respond quickly to new features through trial and error.
And we continue to work to reduce costs and risks for developers. Until now, and from now on.
(completed)
Tags: Sales Meta Quest Japan expected Horizon OSs aims advice developers Metas talks Mogura News
-
