Indice

• How to Use This Book
• Frequently Asked Questions
• Foreword
• Introduction

CHAPTER 1

• Creating the World We Want to Live In
• The Criticality of Context
• Defining Multimodality
• Fluidity over Rigidity 7
• Fix the System, Not the Person
• Leading with Anti-neutrality and Anti-racism
• A Gender Equity Lens
• Where No Design Has Gone Before
• Apply It Now

CHAPTER 2

• Capturing Customer Context
• Blending Theatricality with Design
• Storytelling for Design
• The Building Blocks of Storytelling
• Story as Shared Understanding
• Apply It Now

CHAPTER 3

• Understanding Busy Humans
• Turn Contextual Awareness into Activity Models
• Passive Activities: Zoning Out
• Sustained Activities: Passing the Time
• Discrete Activities: Getting Things Done
• Focused Activities: Going with the Flow
• Live Activities: Can’t Miss a Thing
• Apply It Now

CHAPTER 4

• Activity, Interrupted
• When Interruptions Attack
• Leaving an Activity Behind
• Build an Interruption Matrix in Three Easy Steps
• Putting It All Together
• Apply It Now

CHAPTER 5

• The Language of Devices
• Visual Output: Displays and Indicators
• Auditory Output: Sound Effects, Speech, and
• Music
• Haptic Output: Touch and Force
• Kinetic Output: Movement and Motion
• Ambient Output: The World Around You
• Apply It Now

CHAPTER 6

• Expressing Intent
• Auditory Input
• Visual Input
• Haptic Input
• Kinetic Input
• Ambient Input
• Apply It Now

CHAPTER 7

• The Spectrum of Multimodality
• Dimensions of Multimodal Experiences
• Mapping the Multimodal Quadrants
• Adaptive Interactions (Quadrant 1)
• Anchored Interactions (Quadrant 2)
• Direct Interactions (Quadrant 3)
• Intangible Interactions (Quadrant 4)
• Choosing Your Interaction Models
• Orchestrating Multimodal Transitions
• Apply It Now

CHAPTER 8

• It’s a (Multimodal) Trap!
• Synchronization: Do You Have a Shared State?
• Context: What Just Happened?
• Discoverability: How Will People Learn?
• Ergonomics: Are You Hurting People?
• Identity and Privacy: Whose Turn Is It, Anyway?
• Apply It Now

CHAPTER 9

• Lost in Transition
• Between Modalities
• Between Network Connections
• Between Devices
• Apply It Now

CHAPTER 10

• Let’s Get Proactive
• Taxonomy of Interruption
• Manifesting Proactive Interactions
• Interruption and Action
• Cross-Device Considerations
• Apply It Now

CHAPTER 11

• Breathe Life into the Unknown
• Opti-Pessimism: Explore the Extremes
• Storyboards: Bring Customer Context to Life
• Playing Pretend: Put Yourself in Their Shoes
• Prototyping: Proving Your Concept
• Apply It Now

CHAPTER 12

• From Envisioning to Execution
• Interactions over Time
• Voice Design: Visualizing the Invisible
• Gesture Design: Documenting the Wave
• Multimodal Design Systems
• Apply It Now

CHAPTER 13

• Beyond Devices: Human + AI Collaboration
• Defining AI
• Machine Learning
• Responding with Confidence
• The Why of AI
• Exploring Algorithmic Bias
• Question Everything
• (Dis)Embodied Agents
• Apply It Now

CHAPTER 14

• Beyond Reality: XR, VR, AR, and MR
• No Such Thing as New Ideas
• An Extended Reality Lexicon
• Dimensional Interactions
• Input for Another Dimension
• The Reality of Virtual Space
• Apply It Now

CHAPTER 15

• Should You Build It?
• What Harm Could It Do?
• P: Solve the Right PROBLEM
• I: Pursue INCLUSION
• C: CHANGE and Consequences
• S: A SYSTEMS Perspective
• Apply It Now

• Index
• Acknowledgments
• About the Author