Temple of Fortune

Introduction


Fortune-telling is a rich cultural tradition in Chinese heritage. Temple of Fortune is an interactive shrine installation that brings this experience to life using physical computing, projection mapping, and real-time user interactions.

Through RFID sensors, Unity and Blender animations, Arduino-controlled interactions, and TouchDesigner projection mapping, this project bridges cultural storytelling with modern technology in an intuitive, immersive way.


The Challenge


Many individuals are unfamiliar with the nuances of Chinese fortune-telling traditions. How can we bridge cultural storytelling with modern interactive technology to create an engaging and meaningful user experience? Additionally, how do we make the interaction intuitive, immersive, and seamless while integrating physical and digital components?

overall resource experience

WHEN WAS THIS?

Nov - Dec 2024 (3 weeks)


WHAT DID I DO?

As my team's Physical Computing & Programming Lead, I led the full technical development, ensuring seamless interaction between sensors, software, and projection mapping.

My responsibilities include:

The Solution: Step-by-Step User Journey


Full User Interaction Flow

Step 1: Initiating the Experience (Seat Sensor Activation)

Seat sensor setup under cushion

When a user sits down, a pressure sensor detects presence, triggering an audio introduction in Unity.

Step 2: Selecting an Offering

Altar with five offering bowls

The user chooses from five symbolic offerings (e.g., oranges for luck, lotus for new beginnings).

Step 3: Placing the Offering on the Altar (RFID Activation)

Hand placing an offering on the altar

The RFID sensor detects the offering, sending data to Unity to trigger a matching animation and audio response.

Step 4: Projection Mapping & Cabinet Illumination

TouchDesigner Interface Projection-mapped cabinet lighting up after offering placement

After the fortune animation, a specific cabinet lights up, guiding the user to their physical fortune scroll.

Step 5: Retrieving the Fortune

Open cabinet with fortune scroll inside

The user opens the illuminated cabinet and retrieves a physical fortune, completing the ritual.

Final Outcome & Impact

Show 1 Show 2 Show 3

Detailed documentation of this project can be found on my NYU blog here, here, and here!