Using Green Screen to Create Immersive Video Overlay

I wanted to stitch together two scenes in one video- what the user was seeing and how the user was moving/exploring the virtual environment and tools.
To achieve this I screen recorded video capture of the experience using built in feature in Oculus Quest 2 headset, and synced it with video of the same experience taken using a green screen backdrop.
Here is a video walkthrough how to screen record in an Oculus Quest 2 headset:

and additional ways to optimize quality of the capture footage include:
https://democreator.wondershare.com/screen-recorder/oculus-screen-recording.html#:~:text=Part%202%20How%20To%20Screen%20Record%20On%20Oculus%20Quest%202&text=Step%201%3A%20Go%20to%20the,take%20a%20screenshot%2C%20or%20chat.
I would also recommend that you resize screen capture formatting.
It is possible to change the default 1:1 aspect ratio

(I had some of both here but the early footage I captured worked best)

 

In order to record user movement simultaneously I requested green screen recording time via One Button Studio’s online scheduler:
https://onebutton.psu.edu/
(photo credit link: here)
Once you have the film you put it into AE or Premiere Pro ( I chose Premiere Pro)
How to use chromakey in Premiere

How to key green screen footage AE
https://www.premiumbeat.com/blog/after-effects-green-screen/
If some of the green background is showing up there are other ways to adapt the scene to make those pixels transparent https://helpx.adobe.com/premiere-pro/how-to/ultra-key-effect.html  

Leave a Reply

Your email address will not be published. Required fields are marked *