Performative Media
Performative Media.pdf，作者 tian dongWEEK 1-Welcome to Performative Media
This week, the teacher began by focusing on the core concepts of the course:
1. Core Definition: As an artistic practice, its core is to design spaces and environments, creating interactive experiences that integrate humans, moving spaces, and primitive elements. The core difference lies in transforming the audience from "passive observers" to "active participants."
2. Three Key Elements: The course must be structured around an "input-processing-output" logic. Input relies on sensors (such as microphones and motion sensors), processing relies on code and programming logic, and output is presented as visual, audio, or dynamic interactive effects.
The teacher introduced the course software tools to download this semester.
The focus will be on TouchDesigner, a node-based real-time programming tool that supports sensor data integration and can be used to create visual and audio content and interactive effects. It is a core tool for creating interactive installations and performances in the industry.
The teacher explained the course assignments:
- Assignment 1: Proposal Revision
- Assignment 2: Prototype Layout
- Final Project: Performative Media Interaction
- e-Portfolio
WEEK 2—Creative Coding and Generative Art
The teacher reviewed last week's content:
Last week, we learned about the concept of performative media and the principles of input-process-output interaction and explored the interplay between people, space, sound, and images.
Creative Coding and Generative Art Concepts
- Creative Coding: Using programming to create art, not just solve functional problems.
- Generative Art: Setting rules and algorithms to allow a system to automatically generate images or sounds.
- Core elements include:
- Rules and Algorithms
-Randomness and Noise
- Repetition and Iteration
-Emphasis on the "balance between order and chaos": too much randomness leads to chaos, while too many rules lead to rigidity.
The teacher played several artist videos to illustrate the thinking and process of generative art.
In class, the teacher guided us to download and install TouchDesigner (the main tool of the course).
And took us to practice using the software in class.
Practice process
Video after practice saved
The teacher explained the content of Assignment 1 in class：
We need a team of four to complete this, with a deadline of October 17, 2025. Teams are required to select two international/regional/local media artists or groups (each artist should research two representative works, for a total of four works). The presentation should be completed using a 15-20 page PPT (exported as PDF). The presentation must include three sections: artist background (2-3 pages per artist), case study (4 pages per work, covering six dimensions: background and purpose, technical tools, IPO model mapping, audience role experience, aesthetic atmosphere analysis, and effectiveness evaluation), and reflection and application (3-4 pages). The presentation must also include relevant visual materials and references from at least three credible sources (APA/MLA format). The presentation will ultimately be evaluated based on six dimensions, including research depth, case analysis, and reflection on aesthetic experience, according to the corresponding scoring criteria.
Week 3: TOPs Deep Dive in TouchDesigner
This week's Media Arts class focused on further studying TouchDesigner's visual generation and compositing logic. The teacher first reviewed the basic concepts of TOP (Texture Operators), CHOP (Channel Operators), and SOP (Surface Operators) from last week, and further explained how to use them to achieve image overlays and dynamic visual effects.
The teacher reviewed the concept of "generative systems," discussed in the previous class, which involves generating variable visual results through the repeated execution of rules and algorithms.
• Randomness: Completely unpredictable numerical variations.
• Noise: Structured randomness with a certain degree of continuity and controllability.
In creation, the balance between randomness and order can create a visual sense of "liveliness," a key characteristic of generative art.
TouchDesigner Hands-on Exercise: Composite & Feedback
1. Composite Operations
Learn how to overlay multiple images (such as text, shapes, and backgrounds) on top of each other.
Understand how different compositing modes (Over, Multiply, Add, etc.) affect visual hierarchy
In actual operation, we use Constant, Circle, Transform, Composite and other nodes to create the effect of layer overlay.
Final product video
Document
2. Feedback
By re-inputting the output into the system, a continuously changing dynamic visual effect can be achieved.
This method can be used to create "smearing," "afterimages," or a sense of fluidity.
The instructor demonstrated how to adjust parameters and resolution to achieve subtle changes in the image within each frame.
Final product video
Document
Finally, the teacher reminded us that next week we would be conducting group presentations (analyzing two artists and two works each). Each group was required to prepare a 15-20 page slide deck and a 10-minute presentation. Individuals were also required to complete written reflections and applications.
Week 4: Assignment 1 pre and Working Towards Our Final Project
This week we gave presentations for each group on Assignment 1.
After the presentations, the teacher gave a brief introduction to Lecture 2.
The teacher mainly talked about an important transition—from the "concept stage" to the "practice and execution stage." In the past few weeks, we have been mainly doing concept research and experimental ideas (SP concept), but now we have to actually "make works" and enter a more practical stage.
The instructor mentioned that the past few weeks have helped us understand how to think about the concept, context, and form of our work.
Starting this week, the focus will shift to hands-on practice and execution.
At the same time, we will learn how to make more nuanced choices in our designs, such as materiality, lighting, and interactive methods.
The instructor encouraged us to try more experimental tools, such as TouchDesigner, and explained that further in-depth instruction will follow, allowing us to learn how to integrate visuals, sound, and interactivity into our work.
📌 Homework and Next Steps
The teacher mentioned that the next assignment is:
"Concept Proposal + Prototype."
The goals of this assignment are:
• Present a complete and clear design idea;
• Express the concept through experiments and small-scale models;
• Lay the foundation for the final project direction.
In other words, this assignment is the first attempt to move from "idea" to "product."
The teacher emphasized:
• Don't worry too much about whether your work is perfect; what's more important is to discover problems through experimentation;
• Keep a record and reflect on your practice, making every attempt a part of your research;
• A work isn't just about the "result"; what's more important is the "process" and the "depth of your thinking."
Week 5 Class Reflection—Perform & Interactive Audio Systems
This class primarily helped us transition from the research phase to the creative phase. The instructor explained that we now needed to begin conceptualizing and experimenting with our final interactive installation project. Having previously studied artist examples and theories, we now needed to translate these concepts into our own work.
Our task was to create interactive experiences through sound, sensors, and visual feedback, ultimately creating an engaging installation experience. The instructor emphasized that perfection wasn't necessary, but it had to "express the idea"—this was the most important goal during the conceptual prototyping phase.
TouchDesigner Technical Learning Content
This week's practical focus is TouchDesigner's CHOP (Channel Operator) and TOP (Texture Operator). The instructor guided us through the basics, gradually building an interactive visual system.
1. CHOP Basics (Green Nodes)
• CHOPs are used to process data and sensor input, such as the mouse, microphone, and keyboard.
• We learned operators such as Constant, Math, Select, Logic, Trigger, and Audio In.
• We understood the data flow: input → transformation → output.
2. TOP Basics (Blue Nodes)
• They are used to generate and blend images, such as Constant TOP, Circle TOP, and Over TOP.
• We learned how to control TOP parameters through CHOPs, such as moving a circle with the mouse position and controlling its size with the volume.
Practical Exercises
In class, the teacher walked us through two small systems:
System 1: Mouse-Interactive Circle
Move the mouse to control the circle's position, and click to change its transparency. Use Select and Map to adjust the input range.
System 2: Visualizing Sound Responses
Using Audio In CHOP, we convert sound waveforms into numerical values and then map them to the radius or position of a circle, achieving a sound-driven visual response.
Extended Application: Sound and Keyboard Interaction
The teacher demonstrated how to use Keyboard In CHOP to switch between different color visual outputs. Each keystroke can trigger a different color or image change. Multi-state control is achieved through Logic CHOP and Switch TOP.
This helped us understand how to combine multiple inputs (sound, motion, keyboard) to create more complex interactive logic.
In the second half of the class, the teacher demonstrated more advanced examples using Audio Spectrum CHOP and Trigger CHOP:
• Audio Spectrum can analyze frequency and rhythm to create visuals that move with the music.
• Trigger can trigger visual events based on volume thresholds, such as a drum beat lighting up or a shape flashing.
The teacher also introduced TouchDesigner's Palette (preset tool library), including the "Audio Analysis" module, which directly analyzes the rhythm, energy, and beat of music, making it ideal for performance and interactive lighting design.
Next Week's Plans
- Continue developing interactive concepts and visual prototypes.
- Begin thinking about the structure and theme of the final work.
- The instructor encouraged us to experiment with combining audio, visual, and sensor input to create a work that responds to audience behavior in real time.
Document
Week 6: Embodied Interactivity using Webcam in TouchDesigner
Through case studies and theory, the teacher helped us redefine the boundaries of "interaction"—no longer limited to traditional input devices like mice and keyboards; the body itself is the best tool for interaction.
The teacher showed us a particularly interesting case: an "interactive shadow installation" located in a city center square. Inspired by the perceptual techniques of Dutch painters, this installation uses a camera to capture ground shadows 20 times per second. When a pedestrian's shadow "reveals" a pre-set portrait pattern, the hotspot turns white and triggers a brief black screen, after which a new portrait appears in the new location. What impressed me most was its "naturalness"—pedestrians didn't need to learn any rules; they would instinctively adjust their bodies and shadows, even striking various creative poses, achieving truly "barrier-free interaction."
The teacher also emphasized that good interactive design should meet three key points:
1. Intuition: Users should be able to participate instinctively without complex learning.
2. Theme Relevance: For example, this installation uses "shadows" to echo the art theme of "perception and observation," ensuring the interaction and concept are not disconnected.
3. Surprise: The appearance of a black screen or a new portrait can continuously attract users, making the interaction less monotonous.
Practical Technical Training: Implementing Visual Interactive Effects
The teacher posted a link on mytimes about the steps we would be taking with Touch Designer in this lesson. Each step was explained very clearly. He first asked us to try it ourselves, and he would help us answer any questions we had.
The teacher then guided us through breaking down the implementation logic of "dynamic visual feedback," the core of which is "frame comparison using cache," with very clear steps:
1. Frame Cache (Cash): The program stores the most recent 32 frames (or 128 frames, adjustable), essentially "saving historical frames";
2. Frame Selection and Comparison: Select two frames from the cache (e.g., the current frame and frames from 6 frames ago) and calculate their differences. This step is crucial for "capturing dynamic changes";
3. Threshold Adjustment: Set a value to filter out background noise in the image, retaining only obvious dynamic edges (such as hand movements or body movements);
4. Effect Optimization: Add blur, displacement, saturation adjustments, etc., to make the visual feedback smoother and avoid a harsh feeling.
The teacher also encouraged us to do extended experiments, such as adding "audio response" to this visual effect—using the audio analysis tools learned last week to make the image change with the rhythm of the sound.
If anyone is struggling to keep up, the teacher said they would upload a complete demo file, and by adjusting the parameters, you can gradually get started.
Exercise Document
Key points of the assignment: Connection between Assignment 2 and the final project
The instructor clearly outlined the three main components of Assignment 2 (Prototype and Concept Proposal), which are directly related to the final project. Everyone should pay close attention to them in advance:
1. 10-Minute Presentation (Submitted by November 21st)
• Don't dwell on details; focus on the "core concept" and "key interactive methods," such as what problem your device aims to solve and how users can participate.
• Be clear, allowing the audience to quickly grasp your design logic. Don't strive for a "perfect presentation," but ensure your ideas are feasible.
2. Supporting Documentation
• Clearly explain the technical details (what sensors were used, how the interaction was implemented), and the team's division of labor (who was responsible for the creative idea, and who was responsible for the technical aspects).
• Include visual materials: flowcharts, technical sketches, and reference case images are all acceptable to help the audience understand your solution more intuitively.
• Anticipate "potential problems": For example, what if the camera's recognition is inaccurate in strong light? Clearly explaining the problems and solutions will earn you extra points.
3. Prototype (Proof of Concept)
• Key point: Perfection is not required; the goal is simply to "prove the idea is feasible!" For example, if you want to create a "gesture-controlled light" device, you don't need to build a complete installation. Just implementing the core interaction of "waving your hand → light changing color" through programming is sufficient.
• The instructor strongly encourages "trial and error": even if the prototype has bugs, as long as it demonstrates your experimental direction (such as trying new sensors or new visual effects), it's more valuable than "creating a perfect prototype without any highlights."
Additionally, the instructor offered a small suggestion: find at least five interactive examples from different fields for reference (such as art installations or interactive products). If you're unsure where to look, you can ask the instructor for a recommendation list.
Week 7: Integrating MediaPipe for Extra Interactivity
This week's course focused on the combined application of TouchDesigner and MediaPipe. The instructor guided us through an in-depth study of how to achieve interactive video control using body tracking and hand tracking.
At the beginning of the course, the instructor reviewed last week's concepts of body interaction systems:
A feedback loop is formed between the artwork and the viewer;
The viewer's body movements become the input, and the artistic response is the output;
Interactive instructions should be intuitive, natural, and easy to understand;
All interactions must support the artistic theme and expressive purpose, and cannot be merely complex technical effects.
Subsequently, the instructor introduced how to use the MediaPipe plugin in TouchDesigner and guided us step-by-step in building an interactive screen that tracks gestures. Key learning content included:
- The components of MediaPipe nodes: such as face tracking, hand tracking, and pose tracking.
- How to use output data: how to use hand coordinates (X/Y) to control the position and size of screen elements.
- Nodes such as CHOP, TOP, Math, and Limit are used to smooth motion, adjust numerical ranges, and control mapping.
- The addition of feedback and noise effects makes the images more fluid and artistic.
- Finally, the instructor demonstrated how to control the size of the "brush" using hand gestures, allowing the gestures to create ripples and color changes on the screen like a brush.
This lesson helped us gain a deeper understanding of the logic behind interactive system design and learn how to completely transform data flow into visual effects.
Practice finished product demonstration video
🧩 Project 2 and Final Project Explanation
Our instructor reminded us that the focus of Project 2 is on "demonstrating the concept and key interactive logic," without needing overly complex physical construction.
The demonstration video should simply showcase the interactive prototype.
The documentation will explain the concept, feel, and technical logic.
This project will directly help us prepare for the **Final Exhibition**.
The instructor also mentioned that the final exhibition is expected to be held in Week 15, possibly at GMBB, where we will actually showcase our work, combining software and physical space elements.
He suggested that we begin experimenting and testing the interactive logic in the coming weeks and finalize the concept and equipment requirements by early December.
Week 8: Designing an Effective Proposal & Prototype
This week's class marked the beginning of a crucial phase in project development. The instructor repeatedly emphasized that while our concept was taking shape, the most important thing now was to "concretize, make it actionable, and make it demonstrable." The entire lesson revolved around three core elements: concept refinement, interactive design structure, and space/materials and prototyping.
In the first half of the lesson, the instructor started by addressing the overall project direction, reminding us to return to the fundamental questions: What is the core concept of the work? What do we want the audience to feel from this work? Any action the audience takes during the interaction must be related to the concept; it can't be as simple as "pressing it to light up." Interaction should be an extension of emotions, experiences, and the story, and both visuals and actions must "express" the theme, rather than simply providing a rigid explanation in words. The instructor stressed that a mature work shouldn't require lengthy explanations, but rather allow users to understand it naturally through visuals, triggering methods, and spatial atmosphere.
Next, the instructor guided us to re-examine the structure of interactive design: Input → Process → Output → Meaning. Whether it's movement, gestures, images, touch, or multi-person participation, everything should be clearly recorded and drawn into an interactive flowchart. The teacher repeatedly reminded us that good interaction should be "intuitive and a little surprising," encouraging the audience to explore, not just a simple button-triggered relationship.
When discussing space and structure, the teacher pointed out that the physical space of the installation is not just a place to put equipment, but an extension of the concept. Projections, light and shadow, materials, and shapes should all speak the same language as the concept. For example, if the atmosphere of the work is soft and healing, then it's impossible to use sharp, industrial-textured materials; if projection is the primary medium, then fabrics, gauze, and reflective materials must be tested in advance. The teacher also gave many examples of how to create actual installations, including using PVC pipes, discarded objects, second-hand materials, fabrics, and plastic sheets, emphasizing that the prototype stage doesn't require perfection, but it must have clear functionality and a stable structure.
The second half of the class focused on planning the prototype development. The teacher asked us to clearly define priorities for next week's presentation: "Core interactions must be completed, secondary interactions can be reduced or postponed, and the art style can be gradually added later." Each group needed to write down their most important interactive goals, such as: head movement triggering visual changes, light affecting patterns, and positional changes causing interface transitions. He hoped to see a "usable, functional" prototype next week, not just a conceptual model.
During his rounds, the instructor offered numerous suggestions regarding our work. These included issues like shadow occlusion, projection angles, camera recognition areas, the need for Kinect, and how the prototype space should be isolated. He reminded us that discovering problems during testing was perfectly normal; the key was being able to propose solutions, such as changing the projection position, adding occlusion cloth, adjusting proportions, or clearly defining the interactive areas. He also emphasized writing a good "story and meaning" for the work, like a description on an exhibition wall, allowing viewers to understand the work's emotions, intentions, and the experiential value behind the interaction.
Overall, the biggest takeaway from this class was realizing that the focus of the prototyping stage is not "perfect visuals," but rather "clear, functional, and conceptually expressive core interactions." The work needs to integrate concept, space, materials, behavior, and the audience experience, and we are currently at a crucial turning point in piecing all these pieces together. Over the next week, we will strengthen the interactive process, revise the prototype logic, and tell the concept story more completely and coherently, based on the teacher's guidance.
Week 9: Assignment 2 - Presentation and introduction of the Final Assignment
Our group gave a presentation in class, and the teacher gave us some feedback.
He acknowledged that our technical direction is strong and that we already have a clear understanding of the interaction flow and touch-based logic. The prototype successfully demonstrates the main interactions, showing that our foundation is solid. He also appreciated our awareness of space, lighting, and materials, especially considering that we are working within a small installation area. However, he reminded us that projection visuals may be weakened by bright lighting, so we need to carefully decide whether to prioritize projection or shift toward lighting-based visual expression. He suggested exploring DMX lighting, explaining that even small and affordable fixtures can create layered and atmospheric effects. Moving forward, he encouraged us to enhance our visual presentation, further evaluate the relationship between light and space, and refine our installation sketches. Overall, he believes our direction is right and that with stronger visual strategy and lighting design, the project will become even more compelling.
After the presentation, we discussed the final design and the effects we wanted to achieve in Touch Designer.
There are approximately five effects in Touch Designer:
1. Blizzard
2. Blizzard weakening (controllable by moving both hands up and down)
3. Snow slowly melting into water (can be controlled by extending and lowering your hand)
4. Spring gradually arriving (controllable by opening and closing your hand)
5. Spring's revival (controllable by different hand gestures)
The teacher then explained the equipment usage and spatial planning requirements for the upcoming final assignment. The teacher also provided numerous specific suggestions regarding the narrative and spatial experience of the presentation, drawing on past student work.
1. Exhibition Space and Usage Arrangements
The instructor explained that this exhibition will utilize the white-walled space and tower-like structure within the same area of GFED.
In previous years, the exhibition would last approximately 7–10 days, but due to time constraints, this year it will only be on display for 3 days. During the exhibition, students will take turns guarding the artworks, explaining the concepts, and ensuring equipment safety. This is a crucial part of experiencing the real industry process.
2. Equipment Usage and Laptop Issues
All interactive content requires a laptop for playback. Therefore, each group needs to decide whose laptop will be used for the presentation or borrow one from the school. However, borrowing a laptop requires someone to be present and supervise the equipment throughout the presentation.
Furthermore, the instructor repeatedly emphasized the importance of pre-conference testing to avoid issues such as sensor malfunctions or playback failures.
3. Professional Requirements for the Presentation
The instructor showcased many outstanding works from previous years, emphasizing several points:
Physical elements are essential; it cannot rely solely on the screen.
The work needs to possess narrative, visual logic, and an experiential connection to space.
Simple sketches drawn up on the last night are unacceptable; it must undergo genuine thought, design, and testing.
The instructor repeatedly reminded:
"The final presentation is your first portfolio card in the industry."
Through the teacher's explanation, we gained some new initial ideas. Regarding the end-of-term assignment, we drew a simple sketch and showed it to the teacher.
We proposed a system consisting of three screens, ground reflective materials, and dynamic lighting:
The central screen: Presents more detailed dynamic winter visuals (e.g., snowflake particles, blizzards, etc.).
The side screens: Use more abstract, softer colors and prism/mirror-like refraction to create atmosphere.
Ground reflective materials: Place low-profile reflective surfaces to refract the image into the space, enhancing immersion.
Spatial lighting: Consider using subtle, low-brightness LEDs or DMX lights to create a sense of flowing light on the ground.
The goal is to present a semi-enclosed "winter emptiness" experience, allowing viewers to feel the "absent season" within a calm and gentle visual environment.
Teacher's feedback on our ideas
The teacher shared that our overall direction is promising, especially the idea of using layered visuals, reflective materials, and seasonal emotions, but emphasized that the project needs to move beyond technical sketches and become a fully imagined spatial experience. He encouraged us not to abandon our lighting ideas too quickly, explaining that subtle LED or DMX lighting on the floor could give our installation a more unique and immersive atmosphere, as long as it stays within our technical ability. At the same time, he stressed that our next sketches should not look like technical diagrams but instead clearly communicate the experience and mood we want visitors to feel—something that immediately makes people understand the “winter world” we are trying to create. The teacher also reminded us that a successful installation must include real physical components, not just screens; the reflective surfaces, spatial arrangement, and interactive elements must be designed intentionally and integrated into the narrative. He emphasized the importance of early testing, especially for reflection, lighting, and any sensors, so that we avoid issues like visuals not triggering or lights not working during the exhibition. He asked us to prepare a complete materials and equipment list, think about carefully cables and power, and produce clearer spatial layout diagrams. He hopes that by next week we will have sketches or simple 3D visuals that truly “sell the idea” and allow others to visualize the atmosphere we are aiming for. Overall, his feedback encourages us to refine our concept into something more visually convincing, technically grounded, and experientially strong.
The teacher posted two things on Times, which I will complete by next Friday.
Week 10: Assignment Briefing & Student Responsibilities
This week's class focused on preparations for the final exhibition, refining the concept of the artwork, and the overall project execution process.
The teacher first reiterated the core objective of this assignment: not only to complete an interactive piece, but more importantly, to clarify and unify the relationship between the concept, narrative, and physical installation, ensuring its stable operation in a real exhibition setting.
Therefore, a major focus of the class was to have each group further refine their concepts, clarify their technical plans, and begin considering the actual preparation of materials and the physical structure.
In the first half of the class, the instructor explained the overall process of the final exhibition in detail, including space opening and measurement on December 12th, actual construction on December 12th and 13th, public exhibition from December 13th to 15th, and the final presentation on December 26th.
Students were required to take turns overseeing the exhibition, each person only needing to work 1.5 hours, with the instructor providing supervision and technical support throughout.
In addition, the instructor specifically reminded everyone to complete three things at this stage: concept refinement, confirmation of technical requirements, and material selection, because once inside the space, a very specific plan must be implemented.
In the second half of the class, the instructor led everyone in a writing exercise of "Art Installation Description," using 3-6 complete paragraphs to clearly express the concept of the installation, the audience's experience, and the meaning of the work.
This description will be used for the exhibition presentation and will also help the team check whether the installation's visuals, interactivity, and narrative are consistent.
The instructor walked around the classroom checking and discussing with each group whether the written description matched the direction of the work.
Our group has finished writing and is waiting for the teacher to come so we can get some feedback.
Document
Teacher's Feedback on Our Group
After reviewing our group's initial presentation, the teacher indicated that the work showed potential and the visual presentation already had a good foundation in terms of atmosphere. However, the teacher noted the following points:
1. The visual feel of the interactive effects doesn't yet resemble "snow." The teacher liked our gesture controls and particle effects, but pointed out that the current visuals don't quite resemble snow. Therefore, if "snow/winter atmosphere" is a key concept, further adjustments to the colors, particle shapes, and sense of speed may be necessary. If not, we can consider adjusting the concept to make the visuals more consistent with the narrative.
2. The concept description needs to be clearer and more consistent. The teacher emphasized that our Art Description must truly reflect the interactive nature and visual form of the work. He suggested that we first complete a 3-6 sentence paragraph, and then check whether the visual effects match the description. This can help us avoid the situation where "the work is created but the concept doesn't match."
3. The structure and materials need more specific planning.
He mentioned:
• If a suspended structure is to be built, the materials must be lightweight yet stable.
• CDs, lightweight decorative spheres, metal frames, and soft materials are all possibilities, but their sturdiness needs to be assessed.
• The earlier the structure of the artwork is finalized, the faster it can enter the practical construction stage.
4. The idea of adding scent is interesting, but safety and audience behavior need to be considered.
The teacher believes that scent elements can enrich the spatial layers, but it's necessary to consider whether the audience will enter the structure, whether the scent needs to be triggered by interaction, and how to secure the device.
5. The overall direction is good, but a more defined final form is needed.
The teacher encouraged us to continue refining the sketches, ideally drawing more detailed structural diagrams so he could confirm the feasibility of the material and technical planning. Once the concept, interaction, and construction methods are further clarified, we can smoothly move to the next stage.
After we made the improvements, the teacher gave us feedback.
The instructor felt our story and design direction were quite clear, even taking shape last week. He particularly praised our design approach and thought placing the installation near human height was appropriate, as long as the props could be easily transported to GMDB. He suggested maintaining an overall footprint of approximately 1m x 1m, with the height adjustable. He also appreciated that we clearly marked the interactive areas, as this helps viewers understand "where to interact."
Regarding the presentation method (projection or screen), the instructor said both were acceptable, but he cautioned against a flat projection surface. He encouraged us to extend, envelop, or add spatial layers to the structure, rather than simply projecting onto a flat surface. He also inquired about our material considerations and suggested continuing to think about how materials could support the overall effect.
Overall, the instructor thought our current direction was excellent and without major issues; we just needed to continue refining the projection/screen structure, material selection, and transportability.
WEEK 11
This week's focus was mainly on the creation of physical installations, interactive testing, material preparation, and direction confirmation. Because the exhibition date (December 19th) is very close, the teacher emphasized that we must keep moving forward in the coming weeks, focusing our time on actual construction and integration.
We showed the teacher the materials we were preparing, including artificial flowers, snowballs, LED strips, wire, and nylon cable ties. The teacher suggested that we continue to use more natural and refined artificial flowers and readily available materials. At the same time, the teacher reminded us not to rely solely on the irregular, curved shape of the wire as the main structural support; the structure must be more stable, and both materials and design should be considered simultaneously.
We also showed the teacher the sketches of the installation. The teacher felt that while the overall direction was clear, the sketches, though somewhat rudimentary, required a clear and defined structure. The teacher encouraged us to begin building the sculptural structure as soon as possible, as only by actually starting could the teacher accurately assess the final effect. The teacher also emphasized the need to continue refining the materials list and ensure all tools and materials were readily available to avoid problems with rushing the process later.
The teacher reviewed our progress on TouchDesigner and found that our current tracking method was inaccurate, especially in the silhouette (figure outline) area, causing unstable results. He suggested we consider not necessarily using full-body tracking and try simpler, more stable interaction methods, such as using only hand gestures, or changing the design to make the visual response more natural.
When discussing the visual representation of seasonal changes, the teacher agreed that our direction was correct, but the current effects of leaves, branches, and the "snow → spring" transition were not concrete enough. He reminded us that we needed to think about more reasonable transition methods, as simply changing colors might not be enough for the audience to understand the concept of "winter to spring." He suggested we test more visual changes to make the seasonal feel of the installation clearer.
The teacher also mentioned that our current structural design was too "geometric" and not natural enough. He suggested we soften the combination of flowers and branches, avoiding making the installation look like a collection of harsh lines. Furthermore, he reminded us to pay attention to the feel and texture of the materials, choosing materials more suitable for representing natural elements.
The teacher also showed us examples related to TouchDesigner.
Overall, the teacher affirmed our efforts and felt that we had prepared a lot of materials; all that was needed was to "assemble" them. He reminded us not to be overly nervous or get bogged down in the details, emphasizing the importance of continuous testing and adjustments. Finally, the teacher asked us about our equipment and microphone and reminded us to send him the official materials list for follow-up.
During class, we had a group discussion. After receiving feedback from the teacher, we continued to optimize the shape and structure of our device. We had a new idea: while the initial concept remained the same, we wanted to refine the shape of the simple, irregularly curved wire structure by wrapping it with cotton to make it fuller. We added flowers and snow-like decorations to echo our theme of winter to spring.
We purchased the remaining materials: crepe paper, wire, and cotton. Later, we updated the complete materials list.
During class, I incorporated our new ideas into the sketch. I drew a new sketch and gave the teacher feedback, which he said was very good.
The teacher generally liked our hand-drawn design, praising the structure and material concepts. He suggested that we didn't necessarily need to strictly distinguish between winter and spring, but rather blend the two seasons, allowing flowers and snow to appear simultaneously to increase visual interest.
He reminded us that our equipment and materials were almost ready, and that we should start actual production as soon as possible. He explained that transforming a drawing into a real installation would present many new challenges that could only be solved through hands-on experience. He also emphasized that we needed to go to the site next Friday, so completing a portion of the finished product earlier would reduce stress and allow for immediate on-site testing. Finally, the teacher asked me to send him the sketch in PNG or JPG format.
WEEK 12
This week, our teacher took us to see the space we used for our finals at GMBB. Our group has three rooms, and we're in GM5-47.
We tried running the projector and the TouchDesigner document we created on the laptop in the room.
The teacher reviewed our TouchDesigner documentation and gave some feedback: the teacher said we need to enhance the snow effect and further enrich the animations.
We showed our device sketch to the teacher, who said there were no problems and everything was fine. The teacher suggested that when building, we could first create a structural framework for the cotton so that the cotton would look better. When placing the cotton, we should follow design principles and not just put it in randomly. We plan to do this after the aluminum-plastic composite pipes arrive, as they are the main structural element.
WEEK 13
This week is quite busy, as our exhibition will be held from Friday to Sunday.
The teacher sent some messages on WhatsApp:
Regarding the final exhibition, the location will be on the third floor, section A (3A) of GMBB. The main reason is that this area has high foot traffic, making it easier for the works to be seen by the public. Due to space limitations, prolonged construction on floor 3A is not allowed during the exhibition; therefore, all equipment adjustments and setup must be completed within the designated time slots. Setup time is scheduled from 8:00 AM to 12:00 PM on Thursday, and after 8:00 PM; Friday morning from 8:00 AM to 11:00 AM is for final testing and calibration.
The teacher emphasized the importance of clearly presenting the works themselves and the audience experience. The teacher explained that we no longer need to prepare complex exhibition description documents; a short description of each work (3-5 sentences) is sufficient. This description will be used in the final exhibition and will be printed out and placed next to the works to help viewers quickly understand the concepts and interactive methods.
The exhibition will be open to the public from Friday to Sunday, from 11:00 AM to 7:00 PM daily. Friday evening, from 6:00 PM to 9:00 PM, is the opening night, and all students must attend to introduce their work to the audience. The teacher stated that this is a crucial segment for the artworks to interact with the public.
During the exhibition, we will also be responsible for supervising the exhibition. On Saturday and Sunday, each student will be on duty for one hour to ensure the smooth operation of the artworks and maintain order. Compared to the original arrangement, the teacher has shortened the supervision time from 1.5 hours to 1 hour to reduce the burden on students. After class on Friday, the teacher will remain on-site to assist and observe; students can choose whether to stay.
After the exhibition, Sunday evening from 7:00 PM to 9:00 PM is the designated dismantling time. All students must be present to dismantle the artworks, tidy up the equipment, clean the venue, and restore the exhibition space to its original condition.
Finally, the teacher confirmed that the final class and final presentation of this course will be held on January 2nd. All final work files must be submitted by 11:59 PM that evening, including the Supporting Document (PDF), Final Presentation Slides (PDF), a 30–60 second installation demonstration video, and TouchDesigner working files.
On Tuesday of this week, we went to GMBB to work on our group's installation project.
Production process
We first made the aluminum-plastic pipe to the structure we wanted, and then arranged the cotton, the flowers we made, and the artificial flowers.
We first made the device on the long side of the left side：
After that, we started attaching cotton and flowers to the aluminum-plastic pipe.We must follow the design principles when shaping it.
Self-Reflection (Week 1–Week 15)
During these 15 weeks of the Performative Media course, I experienced a complete learning process, from theoretical understanding to practical operation, and from passive learning to active exploration. Looking back on this entire learning phase, I have gained a great deal and also generated many new thoughts.
🌱 1. Learning Outcomes and Experiences
In the initial weeks, I mainly followed the course content to understand the basic concepts and framework of interactive media, such as the **"input-process-output"** interaction logic, and learned how to install and practice the core tool, TouchDesigner. This phase helped me quickly establish an understanding of the overall structure of the course, laying the foundation for subsequent project development. Subsequently, in-depth learning of TouchDesigner, I mastered the relationships between different nodes (such as TOP, CHOP), and important skills such as how to combine simple visual materials into dynamic effects.
In team projects, by analyzing the works of media artists, creating PPTs, and presenting them in class, I experienced the process of interdisciplinary collaboration firsthand, deepening my understanding of the integration of art and technology. This not only improved my technical skills but also honed my communication and presentation abilities. As the course progressed, I began to explore more complex forms of interactive design, such as interactive effects based on MediaPipe. This greatly expanded my understanding of haptic interaction and spatial expression.
⚡ 2. Gains and Understanding
1. Deep Integration of Theory and Practice
Unlike traditional media learning, this course required me not only to understand concepts but also to personally operate, debug, and optimize interactive systems. This "hands-on and brain-based" approach gave me a deeper understanding of the implementation mechanisms of interactive installations.
2. Expansion of Creative Thinking
From creative coding and generative art to interactive system design, I gradually understood how to realize artistic intentions through technical means, which greatly enhanced my creative thinking abilities.
3. Improved Collaboration and Communication Skills
Team tasks required close communication and division of labor, which taught me to express ideas, accept feedback, and optimize results in design discussions.
🚧 3. Challenges and Reflections
Although I made some progress in technical mastery, I still felt insufficient in design planning and overall project structure control. For example, in building certain complex node logics in TouchDesigner, I sometimes encountered repetitive debugging due to a lack of overall framework design, indicating a need to improve my systems thinking skills for large projects.
Furthermore, although I tried various presentation methods in class, there is still room for improvement in guiding the reviewers' attention and presenting core concepts. In the future, I plan to focus more on the clear presentation of storytelling structures and visual logic.
🎯 4. Future Plans and Goals
Based on the learning experience of these 14 weeks, my next learning phase plans are:
• To deepen my TouchDesigner skills, especially my ability to handle complex interactive logic and data processing.
• To create flowcharts and framework diagrams in advance, based on actual project needs, to improve the efficiency and clarity of design planning.
• To further explore the thematic expression of interactive experiences and the guidance of audience emotions in future works, seeking a better integration of technology and aesthetics.
Comments
Post a Comment