Intelligent Exploration of Multi-mode Interaction in Automobile Cockpit

In the 100-year history of the automobile industry, the cockpit has experienced the evolution from mechanization to electronic and then intelligent. On the basis of the traditional cockpit, the intelligent cabin has become more convenient and diversified through human-computer interaction, and has also achieved a significant improvement in the level of automation and interconnection. The interaction methods are diversified, including voice interaction, gesture recognition, face recognition, voice print recognition, heart rate detection, AID holographic projection, ChatGPT, and brain machine technology. With the integration of more and more innovative technologies, the immersive smart cockpit experience is constantly enhanced. So how can multimodal technology be used to create the driving experience of the future?

In this workshop, based on this background, we will focus on "Intelligent exploration of multi-modal interaction in the cockpit" to share how the polar Krypton cockpit technology experience team integrates multi-modal technology into user experience and scene insight. We will mainly share the "scenario-based multimodal" design thinking. Combined with specific cases, this paper introduces how to use this design thinking to create multi-modal interaction scenarios, and group activities to help designers, engineers and product managers learn from innovative business scenario design, so as to better play and enhance the impact and value of design in business.

The details are as follows:
1. What is Multimodal interaction
1.1 Transition from single interaction mode to multi-mode interaction mode
1.2 Three forms of cabin multi-modal interaction

2. Cabin multi-mode interaction industry trends and technical insights
2.1 Multi-modal interactive development route of Chinese automobiles
2.2 Multi-modal technology classification and application
2.3 Industry Analysis The current multi-mode status of China's new energy vehicles

3. Exploration and innovation of cabin multi-mode interaction
3.1 Fully understand the needs and pain points of users
3.2 Create the value of cockpit multi-modal interaction experience: brain blast

1、Workshop Introduction: Content Summary
2、Theoretical Method Explanation: Multimodal Interaction Technology and Application
3、Case Study: analysis of multi-mode interaction in new energy vehicle cockpit
4、Practice interaction: group proposition to explore multi-mode interactive innovation scenario design
5、Open answer: Q&A Free Exchange

1、3-5 years experience as a user researcher
2、3-5 years experience as product manager
3、Medium/senior interaction experience designer
4、AI industry-related practitioners, people interested in the AI field

1、To understand the application case of multi-modal interaction technology in automotive intelligent cockpit
2、To understand the application case of multi-modal interaction technology in automotive intelligent cockpit
3、The innovation breaks the situation, raises the diversification angle of view to help the product to create the extreme experience