Adaptive 360 VR Video Streaming

We’re having a lot of fun at the Pixvana working on various VR storytelling technologies, what we have termed “XR Storytelling” as we are thinking broadly about both AR and VR but also xR, such as virtual reality caves, and other as yet to be conceived of immersive platforms which will require similar tools and platforms.  One of the key challenges we are working on is how to deliver absolutely gorgeous/high-quality adaptive streaming 360 VR video.

Last week we combined our love for food with our love for VR, and shot a rough blocking short film that we intend to turn into a higher quality production in a few more weeks, when we can bring a higher quality camera rig into the mix.  Aaron blocked out the shots while the team at Manolin, the f-ing awesome restaurant next to our office, was prepping for the day.  Here is the rough cut:

Then, we threw it into our cloud elastic compute system on AWS and produced several variations as a series of “viewports” which when viewed on a VR headset like the HTC Vive (the best on the market so far) produces some pretty darn immersive/awesome video at a comfortable streaming bandwidth that can delivered on demand to both desktop and mobile VR rigs.  Here’s a preview of what the cumulative render “viewports” look like in one configuration of the settings (we are working on dozens of variations using this technique, so we can optimize the quality:bandwidth bar on a per-video basis):

Looking forward to sharing more of what we are up to with the public in the near future–for now, if you are a seattle friend, stop by for a demo, and, delicious dinner at Manolin Restaurant!

 

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s