How to Set up a 3D Avatar for Streaming

If you created an avatar according to our article on how to make a 3D VTuber avatar with VRoid Studios (or purchased one from somewhere like Booth), you might be wondering how to set it up for streaming. To go live with your avatar, you’ll need a webcam, mic, and facial tracking software. Today, we’ll show you how to use VSeeFace, a free to use, popular software for VTuber facial tracking. After that, we’ll show you how to set up your model as a source in Streamlabs Desktop.

How to Download and Use Face Tracking Software

VSeeFace is a tried and trusted software by many VTubers and it’s easy to get started with. To download VSeeFace, go to their homepage and click “Download” on the left side of the screen, (or follow this link). 

Install VSeeFace on your computer and then import your avatar (VRM file) into the software. You should arrive at a screen that looks like this:

Choose your mic and webcam from the settings on the right and click “Start.” 

Extreme close up! Hold down ALT and use your mouse wheel to adjust your avatar to size.

Better! Now is the time to start playing around with facial expressions., You’ll need to record a bit of data for each of the six available expressions: Neutral, Fun, Angry, Joy, Sorrow, and Surprised. Make the applicable expression before you click to start, slowly move your head around to capture various angles of your face and continue to hold the expression until after you’ve clicked stop. Be sure to have a natural version of the expression so VSeeFace can properly pick it up. 

Once you’ve recorded some data for each expression, click “Calibrate.” Spend some time afterwards to make sure your model is calibrated to your liking. You can always clear data for one of your expressions and record it again if necessary. Also, you can save the calibrated data and load it the next time you use the software with the “Load Calibration” button on the right side of the screen.

See that button in the bottom right corner? Press that to toggle to an invisible background, which you’ll need for streaming. Hit “Reset Position” if you find that your avatar’s head gets stuck in a certain position or isn’t mimicking your movements.

Once you’re happy with how the software is tracking your face, you’re good to go. There are a lot of settings to play around with if you desire, as well as tutorials on the VSeeFace website if you want to become more savvy with the software. 

VSeeFace’s Virtual Cam Feature

VSeeFace supports Virtual Camera, which is perfect for doing collabs with other VTubers. You can enable the Virtual Camera in the general settings. Afterwards, you should be able to add a source as a regular webcam (rather than a game capture). To read more about how to use VSeeFace's Virtual Camera, check out this link. 

How to Add a 3D Avatar to Streamlabs Desktop

Open Streamlabs Desktop and select the scene you want to add your model to (or create a new scene). Press the plus sign to add a new source. You need to add your 3D avatar as a “Game Capture” source.

Select “Add New” and name it something easy to remember like “VRoid” or “3D Avatar.” Then you’ll need to select “Capture a Specific Window” and choose “VSeeFace.” Most importantly, make sure you check “Allow Transparency,” otherwise your model will appear on screen with the gray, dotted background seen in the VSeeFace app.

Now you just need to position your model where you want it to appear on screen and you’re ready to go. Don’t forget to add an “Audio Input Capture” for your mic and any other sources you’ll need like Alerts, chat, and your game.

With your 3D VRoid model, VSeeFace, and Streamlabs Desktop, you’re now ready to greet the world as a VTuber! What are you going to stream? We’re excited to see what you’ll create and accomplish on your VTuber journey!