Top

When AI Gets Physical

Conscious Experience Design

Designing for the evolving human+machine relationship

A column by Ken Olewiler
September 21, 2026

As physical artificial intelligence (AI) moves into our homes, workplaces, and public spaces, UX design must evolve from designing user interactions to designing how intelligent systems behave around people.

Last month, I stood at a crosswalk behind a sidewalk delivery robot. It rolled to the curb, sat for a second, edged forward, then stopped again. Two people stepped back from it. A third walked around it, going into the street. This robot had no screen and nothing to say. All the robot did have was its behavior, which was broadcasting that it did not know what to do next, making everyone near it feel the same way.

Champion Advertisement
Continue Reading…

Most UX designers have built careers designing things that people operate. Screens, workflows, states, and controls. When AI showed up, it complicated all that with autonomous chats and copilots, but the basic equation held. The system lived behind glass, and the person went first. 

That dynamic is shifting. AI is moving off the screen into robots, vehicles, wearables, medical devices, homes, and workplaces. These new AI systems perceive, decide, and act in spaces that people also occupy. Some can move. Others stay put but still reach into a room by watching, listening, and adjusting. None of them is waiting for us to do something.

The stakes are rising. A confusing screen can waste someone’s afternoon. A confusing machine in a hallway could block a doorway, startle a child, crowd a wheelchair, or convince an older adult that the technology is not meant for her.

Designing for Relationships

For physical AI, behavior is the user interface. This means we need to expand from interaction design to relationship design.

Not for the companion app. Not the onboarding. Not the light ring. People must read something else first: how the thing moves, how close it comes, which way it faces, when it pauses, and what it does when something surprises it. People read all of these behaviors regardless of who designed them. For example, a robot that accelerates toward a person to save two seconds is announcing who owns that hallway. Movement, proximity, timing, orientation, sound, gesture, attention, and the autonomy a system claims are now design materials, as the type and color have always been.

Trust changes, too. In software, it is mostly about accuracy and privacy. But, when someone is with a robot, people ask more fundamental questions, and they ask them fast. Can I predict what this robot is about to do? Does it see me? Will it stop? Does it know when it is unsure? Can I take over? What does the machine do while a person is waiting for answers to her questions. It’s not anything we write.

Champion Advertisement
Continue Reading…

Six Principles for Physical AI

At Punchcut, we’re designing physical AI across robotics, environments, and autonomous mobility. This work is teaching us that physical AI requires new principles that govern how intelligent systems behave, communicate, and relate to people. Here are six principles that that have been guiding our approach.

  1. Signal intent. People need to know what a system will do before it does it. We solved a version of this problem for cars with turn signals, and drivers still read body language and interpret behaviors—drifting toward the lane line, slowing down at an intersection. Machines need their equivalent. Pausing before taking an action or moving. Decelerating on approaching. After the fact, intent is just a surprise.
  2. Respect human space. Proximity, speed, orientation, and boundaries carry meaning and always have. How close is too close depends on the room, the task, and what person is standing there. We would experience a machine that treats a hospital corridor like a warehouse aisle as rude. This is a design decision, not a path-planning default.
  3. Calibrate autonomy. There is a range autonomy across observing, suggesting, asking, acting, and standing down and the right spot on this continuum moves with the stakes, the system’s confidence, and who is present. Every product I have used that has gotten this wrong makes people uncomfortable—acting when it should have asked or asking about things nobody cared about.
  4. Preserve human agency. People need an obvious way to interrupt, redirect, or take back control, and they need to know the appropriate behavior before they actually need it. Knowing you can stop the machine is what makes the fact that you probably never will bearable.
  5. Communicate through all behaviors at once. Movement, sound, light, voice, and gesture. Each of these says something. When these behaviors do not align, people believe the movement. A cheerful voice from a machine that is crowding you does not read as friendly. It reads as oblivious or even intrusive. We must compose all these channels of communication together—just as we would for a visual system.
  6. Earn trust slowly. First impressions matter, but consistency is what holds—that is, the same behaviors in the same situations, honest uncertainty instead of false confidence, or a graceful recovery when something goes wrong. One good recovery earns more trust than a hundred smooth interactions. One violated boundary can end it.

Designing for Shared Space

Underneath these six principles sits a question: how social should these machines be? People read intent into anything that responds to them. We do it with pets and vending machines, and we will certainly do it with something that turns to look at us. So, whether we mean to or not, we are designing a robot’s perceived qualities: confident or hesitant, attentive or indifferent, polite or pushy. The obvious move might be to make these systems seem human. However, that would be wrong. Faces and simulated warmth promise an understanding that the system does not have, and people quickly feel this gap. What a robot needs is enough social intelligence to behave appropriately around people. To yield in a doorway. Wait for someone to finish talking. Know the difference between a hallway and a bedroom. This is not about personality. It is about manners, which are a design problem.

Another thing that changes is who counts as a user. Physical AI encounters coworkers, children, guests, bystanders who have agreed to nothing, pets, and other machines. Most of the people it affects will never open the app or read the settings. Our unit of design is no longer one person and one product. It is a person, a system, and an environment full of others who have never opted in.

The Next Dimension of UX Design

We are good at asking what a system can do. The harder question is how an intelligent machine should behave around people. That pressing question requires UX design. Not because we need to make machines feel more human, but because we need to make their behavior understandable, appropriate, and accountable.

It also means expanding what we think of as a user interface. A machine’s movements, proximity, timing, uncertainty, and decisions all communicate something. Whether the machine waits, approaches, interrupts, or stands down is part of the user experience.

For many years, we’ve designed the space between people and screens. Physical AI asks UX designers to design the relationship between intelligent systems and people and the environment around them. While this is a bigger responsibility, it also presents an exciting opportunity to expand the impact of UX design.

Physical AI won’t succeed on its capabilities alone. It will succeed when intelligent machines can operate in the world in ways that people can understand, predict, and live with. Figuring out what this looks like is a job that UX designers cannot avoid. 

Managing Partner at Punchcut

San Francisco, California, USA

Ken OlewilerKen was a co-founder of Punchcut and has driven the company’s vision, strategy, and creative direction for over 20 years—from the company’s inception as the first mobile-design consultancy to its position today as a design accelerator for business growth and transformation. Punchcut works with many of the world’s top companies—including Samsung, LG, Disney, Nissan, and Google—to envision and design transformative product experiences in wearables, smart home Internet of Things (IoT), autonomous vehicles, and extended reality (XR). As a UX leader and entrepreneur, Ken is a passionate advocate for a human-centered approach to design and business. He believes that design is all about shaping human’s relationships with products in ways that create sustainable value for people and businesses. He studied communication design at Kutztown University of Pennsylvania.  Read More

Other Columns by Ken Olewiler

Other Articles on Artificial Intelligence Design

New on UXmatters