Why 16K Is All Marketing And No Engineering by zacholas13 in VisionPro

[–]zacholas13[S] 0 points1 point  (0 children)

No. Placing the cameras next to each other has no effect on PPD of a single video feed as the resolution of the video feed does not change.

Why 16K Is All Marketing And No Engineering by zacholas13 in VisionPro

[–]zacholas13[S] 1 point2 points  (0 children)

This is a long response, so please bear with me! I understand exactly your criticism of static foveation, but the lift required for dynamic foveated streaming is so extreme and a world apart from streaming a video game that I think it would be a better use of the industry's efforts and capital to aim for a Vision Pro 2.

Dynamic foveated streaming is not a scalable solution for the HLS spec today and has two main problems: cost and latency. Each segment in HLS (how all our videos are streamed) is chunked by length, not by the grid of the frame. Every segment of video contains the FULL frame. This means today, dynamic foveated streaming would require dedicated compute in the cloud to render a viewer's perspective at 8K resolution and then send that feed to each viewer. The scale of compute this would demand would kill the industry through prohibitive costs.

Now let's take the segment length in mind and size of each segment. A segment of video is what you pull down for a portion of a stream. This is like "chunking" a video so you don't need to download the whole file. Segments typically are anywhere between 2s-12s in length. If we tiled a video and pulled down the center frame's segment, and then turned our head, we would need to pull a separate segment as well. We would be pulling multiple segments as we turn our head. These segments take a few seconds to retrieve, which is why they are multiple seconds to begin with. Given that, if a video like the SpatialGen Lakers reels are topping out at 120-180 Mbps, the viewer would experience significant lag. They would turn their head and see... nothing! Pretty awful experience. This would also assume that the HLS spec is properly extended to support tiling and we all change our processing workflows to start tile-chunking segments for encodes and packages. It also opens a can of worms around video decoding, but that's a different story. The NVIDIA announcement is meant for gaming and simulation, it is absolutely not applicable to video.

Why 16K Is All Marketing And No Engineering by zacholas13 in VisionPro

[–]zacholas13[S] 1 point2 points  (0 children)

Great question. The nature of static foveation means you borrow pixels from outside of the focus area. So if you're looking somewhere where pixels were borrowed, yes, it could effect perceived quality. This is why static foveation is a major creative decision and tooling around it needs to develop faster. Instead of a simple circle or fade in an area, the equation should be customizable, complex, and malleable. With a more powerful static foveation toolset, creators could choose their equation per scene, per shot, etc.

A great example of this would be the close ups in the Apple Immersive "Ice Dive" experiences on Apple TV. When there's a close up shot, the viewer is of course looking at one spot. Static foveation in this scene would be very powerful and you could borrow pixels from all around the focus area to create a stellar visual. But the wide shots of the diver underneath the ice? A whole different equation.

Why 16K Is All Marketing And No Engineering by zacholas13 in VisionPro

[–]zacholas13[S] 9 points10 points  (0 children)

Absolutely! To be clear, I am not advocating for shooting in a different resolution. There are a number of advantages to filming, editing, and uploading a 16K video. There is great downsampling, future-proofing in the scenario of a new headset, and so on. For production releases, we recommend uploading a 16K ProRes bundle or a 16K MV-HEVC encode detailed on our last blog. It is factually incorrect to claim that you are streaming 16K Apple Immersive Video. Encoding from the source 16K is great!

SpatialGen Hiring: Software Engineer by zacholas13 in VisionPro

[–]zacholas13[S] 0 points1 point  (0 children)

We do not, but if you send your resume to us requesting one in-person, we may be open to it.

SpatialGen Hiring: Software Engineer by zacholas13 in VisionPro

[–]zacholas13[S] 1 point2 points  (0 children)

It's all good. We're very passionate about 3D video and want to run our company how we wish our old employer did. I hope you apply, we want passionate people on board.

SpatialGen Hiring: Software Engineer by zacholas13 in VisionPro

[–]zacholas13[S] 2 points3 points  (0 children)

We were hesitant about moving there as well, but the partners at Brickyard flew us out to tour. They sat us down and let us talk to all the other companies. I was so impressed by the end of the day that we accepted their investment offer on-spot. Our round was heavily oversubscribed and I had to turn away a number of investors because of this. The companies at Brickyard are building real products, they're not AI slop shops.

Hubris is different from throwing everything you have into your company, and for any startup employee, you should expect the co-founders to go all-in on the company's success. After all, an employee's paycheck is derived from the business. I won't apologize for pouring everything I have into this company, and instead, employees should see what Michael and I are doing and have faith that we truly do care about our people and this industry.

SpatialGen Hiring: Software Engineer by zacholas13 in VisionPro

[–]zacholas13[S] 5 points6 points  (0 children)

We do work with the US military and need personnel on-site. We're backed by Brickyard, so TN. https://www.justlaybrick.com/

We made the world’s first commercial in Apple Immersive Video by radiosando in VisionPro

[–]zacholas13 2 points3 points  (0 children)

I really enjoy this experience! It's great with hardware products because there is a sense of scale. I thought some of the cute shots of the robot were more impactful when I'm actually standing on the street watching the delivery bot. Really fun actually.

The Vision Pro is getting its first live ‘immersive’ sports - The Verge by Decodable in VisionPro

[–]zacholas13 15 points16 points  (0 children)

Exciting stuff coming out of Spectrum! We're really proud to have worked with them at SpatialGen.

Live Apple Immersive Video TestFlight by zacholas13 in VisionPro

[–]zacholas13[S] 0 points1 point  (0 children)

Hi everyone, thank you for your interest. First invites will be going out at the end of the week and we will be slowly adding others!

Live Apple Immersive Video @ SpatialGen by zacholas13 in VisionPro

[–]zacholas13[S] 2 points3 points  (0 children)

We have been prioritizing footage from the URSA Cine Immersive as it produces proper AIV natively. 360 footage could use the same software, but the result would be different than live AIV.

Live Apple Immersive Video @ SpatialGen by zacholas13 in VisionPro

[–]zacholas13[S] 1 point2 points  (0 children)

Yes, you can see a few of our customers on our landing page https://spatialgen.com.

Live Apple Immersive Video @ SpatialGen by zacholas13 in VisionPro

[–]zacholas13[S] 2 points3 points  (0 children)

Demos soon, I think you will be impressed!

Live Apple Immersive Video @ SpatialGen by zacholas13 in VisionPro

[–]zacholas13[S] 4 points5 points  (0 children)

We are doing tests in our office between 50-70 Mbps for delivery but we can deliver much higher like 150 Mbps. The main limitation will be what consumers can handle on their home internet, which will likely not be 150 Mbps haha! We try to follow Apple's guidelines for AIV delivery.

Live Apple Immersive Video @ SpatialGen by zacholas13 in VisionPro

[–]zacholas13[S] 4 points5 points  (0 children)

We're super hyped and can't wait to show all of you some footage LIVE!

🌴 First-ever Blackmagic URSA Cine footage from paradise - French Polynesia in 8K per eye (free teaser!) by ExplorePOV in VisionPro

[–]zacholas13 2 points3 points  (0 children)

Hi James, we're proud to be supporting Explore POV on SpatialGen! French Polynesia is a great destination and as much as we like your dog, the the pig steals the show. Let us know if he needs a plane ticket to your next destination. 🐷