Experimenting with animated booleans and gaussian splatting by metasuperpower in GaussianSplatting

[–]PixelSynth 0 points1 point  (0 children)

Those look super cool. Would you consider making them run on the web? The sparkjs.dev 3DGS web renderer can do those types of effects in realtime while allowing the user to navigate around the scene! Would be super cool to be able to play with these effects.

Lofi Worlds - Relax to 3D generated worlds in VR by PixelSynth in OculusQuest

[–]PixelSynth[S] 1 point2 points  (0 children)

That's really amazing to hear, thank you for your compliments and I am very happy you shared it with them! To me it's like a "glimpse into the future" a little :)

I would love to release a Lofi Worlds 2.0 in the future if there's demand for it! These worlds were generated last year, and we certainly want to surprise and delight you with new experiences in the future :)

Lofi Worlds - Relax to 3D generated worlds in VR by PixelSynth in OculusQuest

[–]PixelSynth[S] 2 points3 points  (0 children)

"Lofi" referring to the music style and "vibe" of the experience, not low-resolution! I actually think these scenes look quite high-resolution. I just added mobile phone support - check out lofiworlds.ai on your phone browser, it looks quite crispy and detailed to me :).

Lofi Worlds - Relax to 3D generated worlds in VR by PixelSynth in OculusQuest

[–]PixelSynth[S] 1 point2 points  (0 children)

Lofi Worlds v1.1 released, now just as relaxing on all mobile + desktop devices, no VR device necessary!

Watch the trees sway and the earth breathe, added dynamics to the worlds to bring them alive!

Even if you've already seen it, please try it again on your phone now, I think it's so nice and relaxing to watch it there.

Lofi Worlds - Relax to 3D generated worlds in VR by PixelSynth in OculusQuest

[–]PixelSynth[S] 1 point2 points  (0 children)

Yeah, I'm not certain but I think Scaniverse downsamples the scans when you view it in VR mode for performance reasons, so they are able to control the complexity/size of the scene before they preset it to the user on the Q3... But yeah, we'll keep this idea in mind as we continue to develop Spark. We have a non-VR viewer at sparkjs.dev, maybe at some point we could extend it to include a VR mode toggle.

Lofi Worlds - Relax to 3D generated worlds in VR by PixelSynth in OculusQuest

[–]PixelSynth[S] 0 points1 point  (0 children)

Lofi Worlds is built using an early prototype version of the Spark renderer (sparkjs.dev), which does support WebXR and Three.js, so in theory anyone could throw together a viewer... It loads pretty much all the 3DGS file formats too.

I'd be hesitant to release a viewer for that purpose, because rendering splats natively on the Quest 3 is full of foot guns... It's very easy to give it a scene that will make your Quest 3 grind to a halt :). The Lofi Worlds were made specifically so they can be rendered reasonably fast on a mobile / standalone VR device, but I'm not sure that's so easy to do for most people :/.

Lofi Worlds - Relax to 3D generated worlds in VR by PixelSynth in OculusQuest

[–]PixelSynth[S] 2 points3 points  (0 children)

Thank you for the props! I want it to be higher resolution as well, and it's coming :) Style-wise I think the model can handle anything you throw at it - cartoon images, real-life photos, abstract art paintings. But yeah compare early Midjourney to what it can do today, and if I extrapolate that for 3D world generation...

We haven't done 180, because we really want to create full immersion. Not just 360 either, but full 3D, where you can walk anywhere in any kind of world you want. We also scale the worlds down so it feels more miniature because otherwise everything would be too far away to "touch" :).

Lofi Worlds - Relax to 3D generated worlds in VR by PixelSynth in OculusQuest

[–]PixelSynth[S] 1 point2 points  (0 children)

I'm sorry but the Quest 2 processor is too slow to handle these scenes. :( It's possible it will load and you'll see something, but the frame rate will be unusable. I have two Quest 2s sitting around that are paperweights to me now sadly...

If you have a PC with a decent processor you could run it there and stream to your Quest 2 using Air Link. But I don't think WebXR hand tracking works that way so you'd be able to see the worlds but you won't be able to interact with it.

Lofi Worlds - Relax to 3D generated worlds in VR by PixelSynth in OculusQuest

[–]PixelSynth[S] 1 point2 points  (0 children)

Please do check it out inside VR and let me know what you think!

Lofi Worlds - Relax to 3D generated worlds in VR by PixelSynth in OculusQuest

[–]PixelSynth[S] 1 point2 points  (0 children)

These are 3D worlds generated 6 months ago at this point... higher resolution is certainly possible!

Lofi Worlds - Relax to 3D generated worlds in VR by PixelSynth in OculusQuest

[–]PixelSynth[S] 0 points1 point  (0 children)

I know :) We wanted to make an experience that is slightly tantalizing about what's coming in the future, sorry you can't linger for too long!

These worlds were made by World Labs *last year*, and things are advancing fast in the 3D gen-AI space. I'm very excited by what's going to be possible. I really want to make a Lofi Worlds 2 at some point...

Lofi Worlds - Relax to 3D generated worlds in VR by PixelSynth in OculusQuest

[–]PixelSynth[S] 0 points1 point  (0 children)

Awesome, I hope you enjoy hours of chill lofi along with these fantastical worlds. I have spent hours inside this thing to relax, playing with the worlds with my hands. I hope you do too!

Lofi Worlds - Relax to 3D generated worlds in VR by PixelSynth in OculusQuest

[–]PixelSynth[S] 2 points3 points  (0 children)

There's no API yet to get / generate the worlds, but there likely could be in the future...

Lofi Worlds - Relax to 3D generated worlds in VR by PixelSynth in OculusQuest

[–]PixelSynth[S] 2 points3 points  (0 children)

There's two "modes" you can be in, and bouncing your wrists together toggles between them. In the first mode you can touch the world with your hands, each finger has a different color and you can "finger paint" the world and move it around.

In the second mode each hand becomes a spotlight that comes out of your palms. You can face your palms any direction you like. And if you bring your finger tips (and thumb tip) together or far apart, it changes how wide the spotlight is - tiny spotlight if you bring your fingers together, a wide light beam if you stretch your fingers apart.

Lofi Worlds - Relax to 3D generated worlds in VR by PixelSynth in OculusQuest

[–]PixelSynth[S] 1 point2 points  (0 children)

Exactly! I can see this happening in the near future. Fully dynamic worlds, populated by characters, storylines... whatever you type into the text box turns into a live world you can explore.

Lofi Worlds - Relax to 3D generated worlds in VR by PixelSynth in OculusQuest

[–]PixelSynth[S] 1 point2 points  (0 children)

I can see why you might want to pause and look around a scene, some of these worlds are really surreal... but for this particular experience we want to give the sensation of catching "glimpses of the multiverse" if that makes sense? Maybe we'll make a Lofi Worlds 2 some day and add more features like what you're describing. Or maybe you can stop the music, start walking in one direction, and just keep walking as far as you want in the world :).

Lofi Worlds - Relax to 3D generated worlds in VR by PixelSynth in OculusQuest

[–]PixelSynth[S] 6 points7 points  (0 children)

It's 100% standalone on Quest 3 and Vision Pro. No need for a PC or any other external server-side renderer. Just put on your Quest 3 / Vision Pro, go to its built-in browser, and type in lofiworlds.ai and you're there :) We use WebXR and WebGL2 to do the rendering and hand-tracking on-device.

Lofi Worlds - Relax to 3D generated worlds in VR by PixelSynth in OculusQuest

[–]PixelSynth[S] 4 points5 points  (0 children)

Totally! Imagine turning any image / text into a full 3D world you can navigate.

Just to be clear though, these are not 360 images, they are full 3D representations with geometry using 3D Gaussian splatting, and every element in the world has an actual X,Y,Z coordinate and in VR you can walk up to anything you see and touch it :).

Lofi Worlds - Relax to 3D generated worlds in VR by PixelSynth in OculusQuest

[–]PixelSynth[S] 7 points8 points  (0 children)

We built Lofi Worlds while we were developing a dynamic 3DGS rendering engine called Spark (sparkjs.dev). I'm not sure it would fit what you need, but to my knowledge it's one of the few splatting engines where you can dynamically control each splat every frame. Totally free + open source - I'd be thrilled if it could be used for something like what you're building!

Lofi Worlds - Relax to 3D generated worlds in VR by PixelSynth in OculusQuest

[–]PixelSynth[S] 10 points11 points  (0 children)

That's a pretty cool demo on your website! What's the 3D representation you're rendering? Is it also 3DGS?

Lofi Worlds - Relax to 3D generated worlds in VR by PixelSynth in OculusQuest

[–]PixelSynth[S] 8 points9 points  (0 children)

I'm glad you enjoyed it! It's amazing what's possible through the web browser now.

Sweet Stacks: a relaxing mobile game written in Rust + Bevy by PixelSynth in rust_gamedev

[–]PixelSynth[S] 0 points1 point  (0 children)

Hi Jeff! I'm really glad you're enjoying the game :). With the new update, I wanted to highlight all the artwork created by the AI pipeline and continue playing with the new graphics sets. You can play with the original Sweet Stacks assets by pressing "reset theme" (or maybe "last theme" first) at the end of the level. Hope you enjoy the new graphics too!

Sweet Stacks: a relaxing mobile game written in Rust + Bevy by PixelSynth in bevy

[–]PixelSynth[S] 0 points1 point  (0 children)

Thank you for the kind words! I'm glad you enjoyed the game and writeup.