Breaking news
SIGGRAPH Asia 2023 Technical Papers Program Preview -

What I felt about mobile in the near future after actually attending Snapdragon Summit 2023[PR]


Hello, MATTU(@sunmattu)is.

Qualcomm’s “Snapdragon Summit 2023” was held on Maui, Hawaii for three days starting October 24, 2023 (local time).

Every year, new models of the flagship smartphone chip Snapdragon 8 series are announced, but this year two major highlights were announced: the SoC “Snapdragon X Elite” for PCs and the “Snapdragon 8 Gen 3” for smartphones. It has been.

This time, I was actually invited to Snapdragon Summit 2023 as a Japanese representative of Snapdragon Insiders.
I would like to report on the image of mobile in the near future that I felt while actually experiencing various things through presentations and demonstrations.

Provided by: Qualcomm

▼The entire Snapdragon Summit is explained in detail in the video.


▼[Until 11/30]Pixel 8 is 16,500 yen off when you change the model! Great value! TORQUE/iPhone also discounted by 11,000 yen!!

It’s not just about performance! Optimized for AI, especially “on-device AI”

This time, the “Snapdragon

The further evolution of performance is overwhelming

The most important thing about Snapdragon’s evolution is its performance.
It has evolved considerably!

“Snapdragon X Elite” for PC

What was particularly impressive about the Snapdragon X Elite for PC is that it achieves considerable power savings and high performance.

Single-threaded peak performance of Oryon CPU compared to M2 Max
Twice the performance in multi-thread comparison with M2!

The “Oryon CPU” for PCs developed by Qualcomm claims that it exceeds Apple’s M2 Max in CPU performance and consumes 30% less power.
Above all, even though I am a Windows user myself, I can’t help but feel the excitement of being able to experience the excitement of Windows, which exceeds the impact of the Apple Silicon M1 when it first appeared.

In addition, Oryon CPU has announced a policy to be installed not only in PCs but also in Snapdragon smartphone models that will be released in 2024.

GPU performance is also 2x higher than Intel Core i7-13800H and 1.8x higher than Ryzen 9-7940HS.
What’s also great is that it saves 80% of power.

Both the CPU and GPU offer extremely powerful performance.

“Snapdragon 8 Gen 3” for smartphones

For smartphones, Snapdragon 8 Gen 3 has been announced.

Kryo CPU configuration has changed.
The combination of Prime Core 1 – High Performance Core 4 – High Efficiency Core 3 in Snapdragon 8 Gen 2 has changed to the combination of Prime Core 1 – High Performance Core 5 – High Efficiency Core 2 in Snapdragon 8 Gen 3.
With a focus on performance, performance has increased by 30% and power efficiency has increased by 20%.

Adreno GPU also offers 25% higher performance and power efficiency.

What I was surprised to see at the venue was the further evolution of ray tracing in terms of graphics.
Newly supports global illumination. It reproduces not only direct light from the light source, but also complex effects such as reflections and light reflections that occur between objects.

▼Video of the demonstration at the venue is included in the video

At the demo at the venue, I was reminded of the power of Snapdragon 8 Gen 3, with a breathtakingly beautiful difference.

Very impressive “Built for AI”

In this announcement, a lot of emphasis was placed on the “Snapdragon

AI is attracting a lot of attention, especially generative AI, as seen in the rapid spread of ChatGPT.

The most notable thing about this generative AI is that it is On-Device (it can operate on the device rather than in the cloud).

The AI ​​engine Hexagon NPU has 45TOPS (45 trillion operations per second), 100 times more than 5 years ago.
Over 13 billion parameters also run within the device.

I had a chance to actually try out the generation AI, and although it was only available in English at the moment, I was very impressed with the quick response time.

▼Actual report in video

Although it is difficult to answer questions about proper nouns, it is extremely fast when generating images using common words.

They also announced that the process that used to take 15 seconds can now be completed in 0.57 seconds, and we are very happy to see On-device AI working without stress.

A future where you can “capture things you can’t see” by connecting your smartphone with AI

“Snapdragon 8 Gen 3” for smartphones also has significantly enhanced AI functions.
At the time of the announcement at Snapdragon Summit 2023, there was even an effect called “Gen AI”

We are so focused on AI that we describe Gen 3 as “Gen AI”

For example, you can run the image generation AI “Stable Diffusion” on your smartphone.

Even in the demonstration at the Spotlight presentation, image generation time was significantly less than 1 second, and was in the 0.5 second range.
It was processing very fast.

There was also a demonstration where you could take a photo of yourself with the front camera and an AI-generated image.

The Video Object Eraser function, which uses AI to erase unnecessary objects in a captured video, has been implemented with other companies for still images and audio, but Snapdragon has achieved this with video.

Furthermore, it is a matter of great concern that generated AI will lead to a flood of “fake” images, especially since images have such an impact.
Snapdragon 8 Gen 3 supports C2PA, and it is now possible to add “processed with generation AI” to file information.

I was very interested to see that Qualcomm itself is clearly planning a future life that blends with generative AI.

Important points of evolution of “Snapdragon 8 Gen 3” for smartphones[Camera]

Great advances have also been made for cameras.
Cognitive ISP, which identifies each object in video in real time, has evolved from last year’s 8 layers to 12 layers.

Furthermore, with “Vloggers View,” you can record a video of yourself from the front camera combined with the image from the main camera (while effectively erasing the background).

▼You can see it moving in the video

When I actually watched the demo, I was so amazed.

Sony’s LYTIA sensor has also been announced to optimize depth information.
With support for 3D ToF sensor, you can get more than 3000 times more resolution when measuring depth.

A Snapdragon-optimized Dual Conversion Gain sensor will also be released by Sony under the LYTIA brand.

With the combination of Samsung’s ISOCELL HP3 and Snapdragon 8 Gen 3,
・Automatically track the selected subject in real time without moving your smartphone
・Maintains 4K resolution even when zooming, allowing you to shoot zoomed footage and full-screen video at the same time

Features that are likely to be included in the next generation of flagship smartphones are being announced one after another.

Especially focused on PC! I have high expectations for the future of Windows and Snapdragon.

Even during Snapdragon Summit 2023, you can see that they are spending a lot of time announcing the Snapdragon X Elite for PC, and are putting a lot of effort into it.
There were some special programs for Snapdragon Insiders, and among them was the introduction of the latest beta tester program, the “Windows Insider Program,” which highlighted the collaboration between Microsoft and Snapdragon. I could see that it was.

Jeremy Sinclair (left), Microsoft MVP and Snapdragon Insiders member, explains the Windows Insider Program.
Qualcomm Greg (right) in charge of Snapdragon Insiders Program

The most impactful ARM-compliant Windows device to date is the Surface Pro
(Later, Surface Pro X (SQ2 model) and Surface Pro 9 equipped with SQ3 were also released.)

I also bought the first-generation Surface Pro

Surface Pro X unboxing review!! Jet black and high quality body, this is a divine machine!!

Hello, this is MATTU (@sunmattu). The long-awaited Surface Pro X is finally here. I bought it with the idea that it would be a portable PC so I could work anywhere and anytime. First, it’s thin. The bezel is narrow. Stylish…

The key Microsoft 365 (Microsoft Office) apps are now optimized for ARM64, and the environment has been gradually improving over the past few years.

video editing softwareNative ARM64 version of Davinci Resolve also announced at Snapdragon Summit, scheduled for release in 2024doing.
I also use Davinci Resolve itself, and I’m really happy with it!
I’m also very excited to see the lineup of apps that will take full advantage of its powerful performance.

As a Windows user, I want it as soon as possible, and I want to use it as soon as possible… ! !
We hope that many manufacturers will commercialize PCs equipped with Snapdragon X Elite.

Snapdragon seamlessly connects devices around you, such as PCs, smartphones, earphones, and cars!

There were various announcements in addition to Snapdragon X Elite for PCs and Snapdragon 8 Gen 3 for smartphones.

Enjoy music anywhere in the house! Snapdragon Sound “S7 Pro” supports seamless switching between Wi-Fi and Bluetooth!

Snapdragon Sound has announced the “Qualcomm S7 pro sound platform” and “Qualcomm S7 sound platform.”

The most noteworthy point is the “Qualcomm XPAN” technology.
In the past, it was common to enjoy music by connecting headphones/earphones to a smartphone, PC, etc. using Bluetooth communication.
However, the drawback is that the music cuts out when you are away from the device at home.

In such cases, XPAN allows you to seamlessly switch between Wi-Fi and Bluetooth, allowing you to enjoy it even over Wi-Fi.
Wi-Fi and Bluetooth are automatically switched by the S7 Pro chip’s NPU (AI specialized engine), so the user does not need to do anything.

You can enjoy music with the same earphones anywhere in your house without having to change connections.

Additionally, at Snapdragon Summit, a demo was held for Snapdragon Insiders to experience the ultra-low latency of Snapdragon Sound.

Demo using Xperia 5 V and Audio-Technica ATH-TWX9
Mr. Fukui from Qualcomm Japan was in charge.

When you press the piano keyboard with earphones connected with AAC codec and aptX Adaptive, the difference in delay is immediately obvious!
I was very impressed with the low latency of aptX Adaptive.

▼You can check the video of the demo

There was also a demonstration of “Auracast”, which transmits audio from one device to multiple Bluetooth earphones.
Normally, smartphones and Bluetooth earphones communicate on a one-to-one basis, but Auracast enables one-to-many communication, such as 1:20, which can be used for interpreting radio and recitals.

The future expands with smartphones and AR/XR glasses

The future of XR, including AR that augments reality, is about to arrive.
At Snapdragon Summit 2023, we got a glimpse of the future created with smartphones and AR/XR.

The future of AR in fitness

For example, it is useful to use AR glasses in fitness.
Inside the AR glasses, you can watch your training with your coach in real time.
Furthermore, if you project your whole body on your smartphone, you can check which muscles you are currently using in real time, even in the glass.
Your smartphone will also provide analysis and feedback.

When using AR glasses for fitness (actually looks like this)

More powerful VR content and games with Meta Quest 3

In VR, Meta Quest 3 is also introduced in collaboration with Meta.

Equipped with Snapdragon XR2 Gen2, the GPU power is doubled for a faster and smoother experience.
Including the power of 3D audio, you can enjoy a more immersive gaming experience.

Meta | Ray-Ban’s smart glasses “Ray-Ban Meta smart glasses”

In collaboration with Meta, the smart glasses “Ray-Ban Meta Smart Glasses” were also introduced.
Although it is not available in Japan, it can be purchased overseas at a reasonable price starting from $299 (40,000 yen).

The Ray-Ban Meta smart glasses are also equipped with Snapdragon AR1 Gen 1.
Although images are not actually projected inside the glasses as sunglasses, the 12MP camera allows you to take very high-definition photos and videos.

Ray-Ban Meta smart glasses are also equipped with high-quality speakers and microphones near your ears.
When you look back at the video taken with the camera in front of your eyes on your smartphone, you can hear the video and the audio right in your ears, and it’s impressive that you can feel as if you were actually there.

▼Example of video shot with Ray-Ban Meta smart glasses

Snapdragon Insiders participants, including myself, are actually provided with Ray-Ban Meta smart glasses.
I plan to review it separately.

Future cars with an eye on the AI ​​era!

At the venue, the BMW i7, which uses Qualcomm’s Snapdragon Digital Chassis solution, was on display.

Although it is covered with a screen, all car controls such as controlling the car stereo and reclining the seats can be done from the driver’s seat using gestures.

The rear seats have a very large 32:9 touchscreen ultrawide display.
It can be used not only for movies, but also for work with an HDMI connection.

Nowadays, cars are equipped with various devices and become convenient, but what would happen if we could seamlessly connect to various devices such as smartphones, watches, and PCs and enjoy driving without having to be conscious of anything, coupled with autonomous driving? I’m very happy!

What will smartphones and gadgets be like in the future? A glimpse of the near future of mobile!

Qualcomm CEO Cristiano Amon (left) and author MATTU (right)

This time, I had the opportunity to participate in Snapdragon Summit 2023, and experienced an overseas presentation for the first time.
Important chips such as Snapdragon
I feel like I’ve gotten a glimpse of a future created by “on-device AI” that also ensures security, and a future where various devices around us, such as Android, Windows, earphones, and cars, are seamlessly connected.

Group photo with CEO Cristiano Amon and all Snapdragon Insiders

Also, this time I was able to participate as a Japanese representative of “Snapdragon Insiders”, and 25 Snapdragon Insiders who love Snapdragon gathered from all over the world, transcending national and language differences, and it was very stimulating. Ta.
The love for Snapdragon and gadgets is universal!

It was a very meaningful Snapdragon Summit 2023.

▼The entire Snapdragon Summit is explained in detail in the video.

Tags: felt mobile future attending Snapdragon Summit #2023PR


NEXT Nitrided iron minerals found on asteroid Ryugu | JAMSTEC | Japan Agency for Marine-Earth Science and Technology