How to import 2d animation from Animate to Unreal Engine 5

    This week I focused on getting the mouth animation into unreal. I learned that it’s not possible to import 2D animation from maya to unreal. The solution is to do all the mouth lip sync animation in Unreal itself.  

    I still used adobe animate to draw out the mouth movements like Ah, oo, mm, etc. I then exported it out as a PNG image sequence.  

    Before Importing the PNG image sequence in unreal. Under the content folder I created a folder and named it image sequence. Then imported the PNG image sequence. Selecting all the textures in the image sequence folder I right mouse click and selected sprite action and create sprite. Turning it into a sprite will allow me to use the images in the animation. I also created a flipbook just in case and you can create that by selecting all the sprites then right mouse click and selecting create flipbooks.  


    I then created another folder called model blueprint. In the folder I right mouse click, click on blueprint class and it will open a window. In the window it will show different commons the one that I want is actor.  

    Once I got the blueprint tab, I double clicked on blueprint and a window should pop up.  On the left side, under components I clicked on the button that says add. The first thing I added was a skeletal mesh and renamed it character. 


    On the right side under the detail tab should be a mesh tab where I can add the skeletal mesh.  
 

    Going back to the content folder, I double clicked on the skeletal mesh. On the right side should be a skeletal tree tab. Under mouth I added a socket by clicking on the mouse and pressing on the green plus button and clicked on add socket. Then I readjusted the socket close to the mouth.  


    Back to the blueprint on the left side I dragged and dropped the character tab on top of the defaultsceneroot. With the character tab highlighted I added a paper sprite. On the detail tab of the paper sprite under socket I added the mouth socket that I created earlier. Then under sprite I added any of the mouth sprites that I created earlier and readjusted to where I want it to be.  


    The next part I need to do is the Lip sync by using a plug in called oculus lip sync unreal. I am still figuring out how to plug it into unreal. I will still need to do some research and ask for help.  

Comments

Post a Comment

Popular posts from this blog

Part 1 Using Oculus lip-sync in Unreal Engine 5.3

Image
     In this week’s blog, with the help of one of my group mates Joaquin figure d out how to install the plug-in into unreal . We couldn’t figure out exactly why the plug-in would not install but Joaquin saw another OVRlipsync folder. He dropped the folder into Unreal’s plug-in folder. In U nreal   the OVRlipsync plug-in should show up in the plug- i ns folder called oculus lipsync . Once I found the plug in, I checked on the box and a window popped up to ask to restart the software for the pl ug-in to show up into unreal to be able to use it . Once that's all done I was able to use the oculus lip sync.        Starting off in the model BP in the component I added a OVRLipsync Playback Actor and audio .        Back to the content drawer in unreal I added a new folder and renamed it audio . In the folder I dragged and dropped a wav audio file. Hovering over the audio and right mouse click , I cl...
Read more

Updating the mouth

Image
     Last week I was working with the lip sync for the character . I added a new mouth for the character that looked a little bit cleaner and more simplistic. I also added the new audio for the character that we recorded.        First, I used photoshop and drew out the different mouth expressions. I used photoshop because I am a bit more comfortable and experienced using that software instead of adobe animate. I transferred the mouth expressions to adobe animate where I used the lip sync. From there I exported it out as a Png image sequence and imported it into unreal. I d id the same process where I used the media track in the sequencer to play out the lip sync.          I did run into a problem where the plane had a black background instead of being transparent. Usually when exporting a png it should be transparent. What I think went wrong in photoshop I painted the background black.      This was luckil...
Read more

Cleaning up the mouth animation in Adobe Animate

Image
       This week I was working on the final lip sync. Instead of doing clips of the audio for each phrase the main character says. We thought it would be easier if we put together all the audio we are using in one audio clip. For the process of the lip sync, I used adobe animate because it has lip sync. Where it automatically lip syncs the audio for me. As easy as it sounds, the auto lip sync isn’t 100 percent accurate. I would have to go over it a couple times making sure that the mouth doesn’t look too chatty, using unnecessary mouth movements, and making sure it aligns with the audio.      These are some things that I did for the lip sync in adobe animate when cleaning it up.       To change the mouth expression. I clicked on the keyframe that I want the mouth expression to change , clicked on the mouth that's on the scene, and on the right I clicked on the frame picker. A panel pops up with all the mouth animation that I added i...
Read more