Posts

Showing posts from November, 2024

Using Image Sequence for Video in Unreal

Image
       After the Oculus lip sync plug in did not work. Our other option was using After Effects but applying the 2D animation on top of the finale edit will just take too long. We ended up trying to animate materials in the sequencer in unreal. I was able to apply the mouth expression onto a plane but was left to figure out how to add the other mouth expression. I ended up figuring out how to apply png image sequence into unreal so it can play smoothly.       The first couple weeks of school I used Adobe animate lip sync for the mouth animation. I exported the animation as a png image sequence and placed them in a folder.       In unreal I created a folder in the content folder and named it movies. With the folder of the PNG image sequence I dragged and dropped the folder into the unreal project folder under the movie folder that I created.       In the Movie folder, I added an Img Media Source by right mous...

Using After Effect for character mouth animation

Image
  The Oculus lip sync plug in did not work for me. The graph from the blueprint did not sync with the audio. I decided to take on a different approach . Using Adobe After Effects for the 2D animation mouth expressions. For this I will have to take the final take and add in the mouth animation.   The first thing I did in after effects was import my video and audio by dragging and dropping on the left side of the screen. Then I clicked on new composition and pressed ok.     Then I just dragged my video that I imported and clicked and dragged and dropped and placed it on top of the composition setting to adjust the screen size.   To add the audio, I clicked and drag into the timeline.     I added a new composition for the mouth animation by left mouth clicking on the project panel.     I added the mouth animations in adobe illustrate and saved it as .ai. In a fter effect I dou ble clicked on the project panel and imported the  mou...

Part 2 using Oculus Lip-sync setting up the graph

Image
  In this week's post I added the graph. This is the most important part as it will make the mouth move based on the audio using OVRLipsync plug in. The OVR lip sync will be based on this. OVR lipSync Reference images First I Added the viseme which will put in a value for each the name and the value based on the audio. I added sets by clicking and dragging the return value and promoted to variable and renamed them. I also added variables by clicking on the plus sign on the left side of the screen.  This part from my understanding is that the value will start at zero then it will make it to the greatest value. It will then store it in the set Viseme Value and it will determine based on the 15 of the mouth sequence if its a higher number or not. It will then replace the sequences if another value is higher. I then added another Variable for my sprites. I renamed it VisemeSprite. On the variable type I clicked on paper sprite and on the right side I clicked on Array. On the Visem...