AI-Driven Additive Manufacturing in Cultural Heritage Conservation
Author: Chenshu Liu
Project Description: This research explores the integration of additive manufacturing (AM) and artificial intelligence (AI) to streamline the fabrication of hydrogel-based conservation materials tailored for artifact conservation, restoration, and preservation.
Posture2Melody: Mapping human posture to music melody
Author: Chenshu Liu
Project Description: Posture2Melody is a project that uses a GAN-Transformer-based architecture to generate melodies from human postures. Inspired by the idea that body postures, specifically expansiveness of human posture, reflects emotional states, this project seeks to create a seamless interaction between bodily movement and music.
AERIS: Adaptive Emotional Response and Interactive System
Author: Chenshu Liu
Project Description: AERIS is an AI-in-the-loop emotionally-aware personal assistant powered by light-weight language model that can locally deploy. The smart personal assistant is can detect your emotions through micro-movements and facial expressions with a built-in emotion detector driven by mediapipe, and can provide empathetic responses.
TangibleMIDI: A Human-Machine-Interaction-enabled Music Interface
Author: Chenshu Liu
Project Description: TangibleMIDI uses hand landmarks, captured by Mediapipe, to dynamically control audio data. Breaking the constraint from physical musical instruments.