In live sessions with a character, the server will occasionally send GestureEvents or EmotionEvents based on the current dialog context. We implemented facial expressions by modifying Blend Shapes directly on this state, via EmotionEvents or GestureEvents sent by the server. The face layer is an interface that only has NeutralIdle. The gesture layer is triggered via EmotionEvents or GestureEvents sent by the server. These are triggered by EmotionEvents from the server. In an Idle or Talking state, we have provided various types of Idle or Talking behavior based on the emotion of the character.

Based on breaks in the audio, the character will switch between Talkingand Neutral states.

When the current character receives audio, it will switch to a Talking state.

The character that was previously communicating will switch to a Goodbye state.

Once the client and server established connection, when you face your character, it switches to a Hello state.

The Idle layer is triggered by the following game logic,

The Gesture Layer masks all the other parts of the character except the face.

The Gesture Layer and Face Layer are additive to the Idle Layer.

These are the Idle Layer, the Gesture Layer, and the Face Layer.

Demo īefore you go through this page, we highly recommend you check the Emotion Sample Demo Scene Architecture It is recommended that you import your own animation clips, and set them as states of our Animator. This package contains several animations, but they are not covering all the GestureEvents and EmotionEvents. Animations in our Unity SDK are triggered via GestureEvents and/or EmotionEvents that we receive from the server.

Ready player me unity sdk