Sijie He

I’m a stroyteller, multidisciplinary designer working across visual design, 3D animation design, always on the way to explore the still image and moving video, physical or digital.

We always believe that words are the most important condition for communication between people, but when we are left with only words, we find that communication seems to be missing a lot of more important things. Consciously identifying a person's emotions is an important step in improving communication. Emotions are exchanged back and forth as we talk, just like the word emotion, ‘e ’and ‘motion’, this is a state of movement, as if, emotions are travelling. So I will develop a model for using people’s facial expressions in conversation, in order to understand how our expression displays work in everyday life, that is, the way emotions travel, requiring an open descriptive approach.

 ︎︎︎ emotionistraveling.cargo.site
︎︎︎ https://vimeo.com/user93153234
︎︎︎ (>x<) (⋋▂⋌) (`Д´) 
︎︎︎ ㅇㅁㅇ /︿\ ◉‿◉
︎︎︎ ......

If you think about it, each of us encounters multiple displays of facial expressions, whether subtle or overt, familiar or unfamiliar. In fact, during our daily life interactions, communication between people can also be described as a process of understanding, a method of information exchange, where language is the carrier of information, and the human face also provides readable and valuable information. Tomkins (1964) has proposed that the human facial expressions gradually evolve into a readable system, where the movement of the skin is the grammar of this language program, and the facial features become the Specific letters that are printed on the human face through mental responses. 

From Text to Face︎︎︎

As a first step, I tried to record a person's emotional state when reacting to the structure and environment of a non-human object, which is a text. I wondered whether facial expressions could be integrated with written language in a new way because words are also a way of conveying our emotions. I developed a research method, 'Reading Text, Reading Yourself', to explore how the emotions conveyed by a text are transferred to the changes in a person's facial expressions.

I used facial recognition technology, which is the placement of localization points at key locations on the face, to more directly observe the dynamics of the participants' facial expressions

From Face to Face ( in reality)︎︎︎

As we all know, compared to words and sounds, which require more attention to organize to obtain an accurate understanding, emotions can be conveyed and understood almost instantly in the process of expressions communication.  I shifted the focus to a person-to-person, and I continued to develop the locus. Using a filming method where the latter person looks at the former person, to investigate whether people could capture some information about each other by focusing only on expressions without sound. I found that each person's expression was influenced by the previous person, but in this state the participants were still only at the level of viewing.

From Face to Face (under the simulation model) ︎︎︎

In order to translate expressions in a more direct way, At this stage I developed a facial game , I continued to use different dots to represent parts of facial expressions, I set up areas of movement for the dots based on the range of movement when people produce changes in expression, and I combind this with magnets to play, and I found that as people moved the dots by themselves, they focused more on the expression itself and thought about the process of how it was produced, for example where moving would convey a happy emotional state more, and thus gained a deeper understanding of some of the changes in expression.

End Point / Starting Point︎︎︎

I chose to use face game to retranslate a film sequence, because a film is an invitation and I wanted the audience to feel the emotions evoked by watching it, and I would also provide a backdrop for the facial play to take place. Breakfast at Tiffany’s as an sample. These dots form the actors and actress in the original film. Focus only on the change of expression without any other elements, and t he participant can work behind the panels, using magnets to move and rotate the dots...

It is more interesting to show the emotion dialogue, the aim is to show and let people experience the emotional way of travelling, because it is another way of understanding each other. Another way of communicating with each other. Even if we may have misunderstandings, we can use 'emotions' to interact. Emotion is traveling, communication is ongoing...