Matt Banks Interaction Design and Engineering

I create experiences where new technology meets human interaction.

  • Spatial Design
  • Computer Vision
  • Motion Design
  • Graphics
  • AI Interaction

Work

A first person view recorded using a Meta Quest headset. The user is in a real world office using passthrough, and there is a floating virtual browser window in front of them. The user uses their hands in a pinch gesture to move the panel near the wall. As the panel gets near the wall, a colorful grid of dots appears on the wall, and the virtual panel aligns then snaps to the wall.

Window Management for the Physical World

This is display and window management in Quest OS, extended to the room itself. Pinch a window toward a wall and it aligns and snaps to it, with no scanning step first. I built the real-time surface detection behind it and designed the interaction thresholds that make the snap feel seamless across hands, controllers and gaze, combining computer vision, depth and shader feedback in one system. It brings people's physical and digital worlds together for the first time on Quest headsets.

A first person view recorded using a Meta Quest headset. The user looks around a dining room where a virtual rainbow colored mesh covers the walls and furniture, indicating where the user has scanned. When the room is covered in mesh, boxes appear on the walls and around the furniture.

Human-Machine Communication Through Motion and Color

Room scanning on Quest only works if the scan meets specific requirements for coverage, viewing angle and time spent looking. The wearer can't see what the machine learning algorithm needs, so I designed and built a shader that makes it visible: a mesh fills in over walls and furniture as each requirement is met. Guided only by the mesh, people complete scans that satisfy all of them without ever being told what the requirements are. Shipped on select Quest headsets.

A first person view recorded using a Meta Quest headset. The user is in a virtual void with a gradient and clicks an icon labelled "Passthrough". A wave of color then wipes away from them, revealing their real world. The wave wraps around their walls and furniture, conforming to the shape as it moves away.

Depth-Aware Transitions Between Virtual and Physical Space

Passthrough is a chance for a headset to show what XR hardware can do. I built that transition on real-time depth: a wave of color crawls along the real shape of the user's walls and furniture, carrying them smoothly into their room. The depth data was coarse and noisy, so I turned it into a signal clean enough to ship, and designed the effect to carry the system's design language.

About and contact

Hello! I'm Matt, an interaction designer and engineer. I'm driven by finding the purpose in a design, from the user needs and the problem behind them to the technology that can solve it. I build across software, electronics and automotive, learning new skills and making sure the design intent survives to the final product.