身体剧场点开后.jpg

Body Theater

New Media Design & Interaction Design

Body Theater regains somatic rhythm and enables everyone to make art with their body as well as interact with their soul. Participant was invited to dance with sound. With participant's motion and depth data captured by Kinect, it generates audio and visual effects feeding back to the participant in real-time.

桌面端 HD备份 14.png

OVERVIEW

4 weeks (2020.12)

Adviser: Zhigang Wang

TERMINAL

 projector, kinect,

camera, pc projector,

kinect, camera, pc

 MY ROLE

Team leader

Interaction designer

Max map/jit developer

Music production

截屏2022-01-17 下午11.58.05.png
椭圆形备份 2.png

KEY FEATURE

movement and visual effects both act on the human eye. It is necessary to find the correlation between human movement and images, so that the movement and visual effects can be synchronized.

dance moves and auditory stimuli, body curves and movement,  and the melody and rhythm in music.

Movement to auditory

Movement to vison

Body movement

VIsion

Sound

椭圆形备份 2.png

 THE VIDEO OF BODY THEATER

Video duration: 2'29''

截屏2021-12-27 下午9.54.21.png

"Embodied Cognition" in Psychology

The absence of the body as a protagonist

&

In the era of screens, the body itself and the interaction of the body are "ignored", being role of the audience for a long time, as “bystanders" when listening and watching.

&

Emphasizes on the role of the body playing in the cognitive processes.

The anatomy of the body, how the body movement, how the body feels and experiences the movement, they determine how we perceive the world.

Cognitions are shaped by our bodies and how they move.

    The concept of body theatre

In the theater, the participant is the audience as well as the performer, in order to break the audience identity and increase the sense of participation, immersion and leading.

Give everyone the opportunity to use their body to create music, video and interact with their souls.

椭圆形备份 2.png

WHY WE WANT TO DISCUSS BODY?

截屏2021-12-28 上午9.15.04.png
截屏2022-01-15 上午12.02.03.png
截屏2022-01-15 上午12.01.54.png
截屏2022-01-15 上午12.02.28.png
12721640664280_.pic_hd.jpg

Speakerx5

Screenx3

Kinect

椭圆形备份 2.png

EXPERIENCE DESCRIPTION

椭圆形备份 2.png

LOGIC OF MAPPING

46741640660143_.pic.jpg
截屏2021-12-27 下午9.54.51.png

1

Select musics

2

The participant observes and experiment with the music + images in the space,

Discover the logic of interaction and start “creation’

3

Participant’s movement & real-time generated music and video, overlayed with each other

4

New visual and auditory stimuli act on the participant on and on…

椭圆形备份 2.png

HOW TO REALIZE BODY THEATER

Step1.

Ableton Live 10 Suite

11011640613081_.pic_hd.jpg
8581640270949_.pic_hd.jpg

Step5.

Max

Kinect skeleton nodes, depth information for classification

Control sound effects with Max msp (volume, delay, sine wave value, vibration depth/value)

Control Visual Effects with Max Jit

Step2.3

Kinect、KinectStudio

Kinect as a signal input capture the movement of the participant, & categorize movement according to rules.

Step2.4

Visual Studio

Use Visual Studio code to read Kinect's .xef file, analyze human skeleton information and depth information, compile data into .csv, and send it into Max for interaction

椭圆形备份 2.png

BEHIND THE PROCESS

椭圆形备份 2.png

HOW TO BUILD BODY THEATER?