PhysiCAD

Interactive 3D Model Making Using Hand Gestures.

Overview

PhysiCAD is an interactive interface that enables users to create 3D models through physical gestures. By translating hand movements into digital geometry, the system reimagines 3D modeling as an embodied and intuitive experience rather than a technical skill. It lowers the barrier to entry while maintaining the precision and logic required for computational design.

Role

Interaction & Technical Lead

Team

Ben Kazer, Joe Tu

Institution / Year

Harvard University - Graduate School of Design 2023

Tools

Grasshopper | C#

Background

Traditional 3D modeling tools often come with steep learning curves, requiring familiarity with complex interfaces, commands, and workflows. This creates a gap between creative intent and technical execution, especially for beginners or those outside computational fields. PhysiCAD emerges from the need to make digital modeling more accessible, immediate, and engaging, while still retaining its underlying rigor.

Concept

The project reframes modeling as a performative act, where the body becomes the primary interface. Instead of navigating menus or writing scripts, users shape geometry through gestures—pinching, dragging, and moving in space. This shifts the process from abstract manipulation to spatial intuition. At the same time, the system embeds computational constraints, ensuring that the generated forms remain structured, editable, and compatible with parametric workflows.

The Project

PhysiCAD is an interactive interface that enables users to create 3D models through physical gestures. By translating hand movements into digital geometry, the system reimagines 3D modeling as an embodied and intuitive experience rather than a technical skill. It lowers the barrier to entry while maintaining the precision and logic required for computational design.

Process

The system was developed using Grasshopper as the computational backend, combined with a hand-tracking camera and custom gesture recognition algorithms. Hand movements are captured in real time and mapped to geometric operations, enabling users to generate and manipulate forms directly in 3D space. Iterations focused on refining gesture vocabulary, responsiveness, and the translation between continuous motion and discrete parametric logic. The result is a hybrid workflow that bridges physical interaction with computational modeling.

Documentation

Media Carousel

1 / 7

2 / 7

3 / 7

4 / 7

5 / 7

6 / 7

7 / 7

Slide 1 of 7

Continue exploring

Algorithm Prison Experiment

2026 | Academics

Interactive installation that explores how technological systems classify individuals, construct narratives, and ultimately shape human behavior.

FlashSight

2026 | Academics

A software–hardware system that uses AI to generate and project new textures onto real objects in real time, turning physical space into a living canvas.

InMySkin

2025 | Academics

A VR experience that lets users perceive the world through altered visual conditions, transforming empathy into an embodied perceptual experience.