Fang Xumei
Alibaba Cloud Computing Ltd.
Experience Design Specialist
With over a decade of experience in enterprise (B2B) and government (B2G) product experience design, Xumei specialises in crafting user-centered strategies for complex digital transformation initiatives. Her work applies systems thinking to address intricate design challenges across large-scale public sector projects.
In the past five years, Xumei has played a pivotal role in driving intelligent transformation across key sectors such as government, finance, and energy. Her work spans foundational model architecture, industry-specific application innovation, and the implementation of commercial solutions, creating a comprehensive design framework that connects technology, real-world scenarios, and business value. Her research has been published at CHI, the premier international conference on Human-Computer Interaction, offering both theoretical models and practical benchmarks for the industry’s intelligent evolution.
Design Philosophy: Using design as a lever to reshape the paradigm of public and enterprise services in the era of intelligence.
With the rapid advancement of large models and Agent technologies, enterprise digital-intelligent transformation is entering a new phase. The deployment of AI Agents is not only reshaping product forms, but also raising new demands on how content effectiveness is evaluated and how user experience design paradigms are defined. Meanwhile, the boundaries of a designer's work are expanding — beyond traditional interface and interaction experiences, the effectiveness of model-generated content is becoming a critical factor in user experience, and a key frontier for future design. Designers need to explore product design paths where effects are measurable and experiences are evolvable, grounded in an understanding of the capabilities and limitations of intelligent technologies, to help enterprises truly unlock the value of AI in their intelligent transformation.
This workshop draws on real-world case studies from enterprise-grade AI Agent products, focusing on two main threads: building a content effectiveness evaluation framework, and exploring the design of AI-native product forms. It aims to help designers and product practitioners develop a systematic understanding of AI Agent products, learn methodologies spanning from effectiveness measurement to product design, and discover new design opportunities in the era of intelligent transformation.
1. Building a Content Effectiveness Evaluation Framework for AI Agents
● 1.1 Why content effectiveness needs to be measured — the critical link from model output to user experience
● 1.2 Approaches to defining evaluation metrics and designing a measurement framework
● 1.3 Case study: hands-on experience implementing effectiveness evaluation in enterprise-grade Agent products
2. Design Exploration of AI-Native Product Forms
● 2.1 From traditional software to AI-native — the evolution of product forms and the shift in design paradigms
● 2.2 Design practices and case studies under new interaction paradigms
● 2.3 How to drive AI-native products from concept to implementation in enterprise scenarios
3. Expanding the Boundaries of Design Competency
● 3.1 From interface experience to content effectiveness — the designer's new frontier
● 3.2 Understanding the capabilities and limitations of intelligent technologies to build a design competency map for the AI era
● 3.3 Methodology transfer: how to apply effectiveness measurement and product design thinking to your own business
1、Opening: overview of the workshop theme and background
2、Methodology: Constructing an AI Agent content effectiveness evaluation framework — approaches and measurement methods
3、Case Studies: AI-native product design practices and exploration of new interaction paradigms
4、Hands-on Workshop
5、Group Presentations
6、Q&A & Wrap-up
1、Experience designers and interaction designers with 3–5 years of experience, looking to expand their design boundaries in the AI area
2、AI product managers
3、AI industry practitioners
4、Students majoring in design or computer science
1、Understand the core principles of AI Agent content effectiveness evaluation and master a systematic methodology — from defining metrics to building a measurement framework
2、Gain insight into new interaction paradigms and design practices for AI-native products, broadening your perspective on intelligent product forms
3、Redefine the designer's competency landscape in the AI era — extending from traditional interface experience to the design and optimization of model-generated content quality
Intelligence Evaluation Methods
Business Scenario Mapping
AI Capability Cards
Technical Explainability Methods