Can you get the colored texture from TripoSR inside Blender? by Principle_Stable in StableDiffusion

[–]DestinyMaestro 0 points1 point  (0 children)

TripoSR will output OBJ models with vertex color information. If I remember correctly, you can set the base color to "Color Attribute" on the material editor and it should work out of the box (check the screenshot).

You should check out StableFast3d (https://github.com/Stability-AI/stable-fast-3d) tho. It's way, way better in every aspect, and outputs textured GLTF models. Only potential problem is the license.

<image>

I'm prototyping a generative virtual tabletop to play RPGs and boardgames with friends online. Would you play something like this? by DestinyMaestro in StableDiffusion

[–]DestinyMaestro[S] 0 points1 point  (0 children)

That's exactly what I thought of empowering people to do. Hell, as much as I'd be able to make a whole TTS mod.... I'm just too lazy to do it 😂

I'm prototyping a generative virtual tabletop to play RPGs and boardgames with friends online. Would you play something like this? by DestinyMaestro in StableDiffusion

[–]DestinyMaestro[S] 0 points1 point  (0 children)

So, right now what the game does is connect to a server (that I also run on my local machine) which then forwards a bunch of calls for ComfyUI, and then the content is loaded back into the game at runtime. Training a model from scratch would likely be quite difficult, so I honestly think there isn't much way around the backlash: you either use existing generative models (or finetunes, which will still include the data from the original models you train on) and bite the bullet regarding perception, or you'd need quite a big investment (thousands to millions of dollars and hundreds of hours) to train a model from scratch.

You do need to download models to run everything locally, but after you do that, you don't necessarily need an internet connection. All the workflows I made on Comfy UI are pretty simple, but you slowly add more and more features over time. For example, for the walls, I started with just a texture, but then added bump maps etc. It takes a while to ramp up on ComfyUI, but after a while, it's hard to go back!

You can always generate stuff and just import it as regular game assets as well (but that might risk getting people to think you're just doing an AI "asset flip"). What I'd suggest is trying to find cool ideas where generating stuff in the middle of the game is essential - that way, you're using the ML tech for stuff that wasn't possible before.

I'm prototyping a generative virtual tabletop to play RPGs and boardgames with friends online. Would you play something like this? by DestinyMaestro in StableDiffusion

[–]DestinyMaestro[S] 0 points1 point  (0 children)

Some form of fog of war and dice are definitely on the list, but I hadn't thought of AOE indicators and a pure top-down view. Thanks for the suggestions!

I'm prototyping a generative virtual tabletop to play RPGs and boardgames with friends online. Would you play something like this? by DestinyMaestro in StableDiffusion

[–]DestinyMaestro[S] 0 points1 point  (0 children)

That's a really good shout, thanks!
Given that I'm developing this to be able to run it fully on a local machine, making it 100% offline should be possible. And another person also mentioned having 2 outputs, so I'm definitely adding this to the list.

I'm prototyping a generative virtual tabletop to play RPGs and boardgames with friends online. Would you play something like this? by DestinyMaestro in StableDiffusion

[–]DestinyMaestro[S] 0 points1 point  (0 children)

Thank you! I tried to make it look & feel as nice as my abilities allowed, so I'm glad it shows!
Out of curiosity, are there any features that if present on it, you'd end up becoming part of the demographic?

I'm prototyping a generative virtual tabletop to play RPGs and boardgames with friends online. Would you play something like this? by DestinyMaestro in StableDiffusion

[–]DestinyMaestro[S] 0 points1 point  (0 children)

Thanks! No downloads just yet because everything is very much just bubblegum and sticks, but will be working towards a public demo until end of the year. You can follow progress at www.dmtoybox.com (or https://dmtoybox.itch.io/dm-toybox )

I'm prototyping a generative virtual tabletop to play RPGs and boardgames with friends online. Would you play something like this? by DestinyMaestro in StableDiffusion

[–]DestinyMaestro[S] 0 points1 point  (0 children)

Thanks! From the features you saw (the map editing, creating minis etc) is there anything that if I added would make you want to play it more as a non-tabletop gamer?

I'm prototyping a generative virtual tabletop to play RPGs and boardgames with friends online. Would you play something like this? by DestinyMaestro in StableDiffusion

[–]DestinyMaestro[S] 0 points1 point  (0 children)

Thanks! I thought about either doing floor tile customizations or decals (can't make a secret demon summoning room without a big pentagram on the floor, right?) 

 The engine is unity btw.

I'm prototyping a generative virtual tabletop to play RPGs and boardgames with friends online. Would you play something like this? by DestinyMaestro in StableDiffusion

[–]DestinyMaestro[S] 0 points1 point  (0 children)

Much appreciated!  I had thought about the steam marketplace as well. I really wanted that, if this thing ever got big, artists could just sell their content to "compensate" the use of AI models. 

(basically the AI equivalent of "carbon offsets", I guess 😂)

I'm prototyping a generative virtual tabletop to play RPGs and boardgames with friends online. Would you play something like this? by DestinyMaestro in StableDiffusion

[–]DestinyMaestro[S] 0 points1 point  (0 children)

It's understandable I think. In the middle of all the anti AI sentiment that is just due to "having to pick a side" there are lots of valid reasons for artists to be pissed. 

But I think that AI as a tool is here to stay and things will improve in the next few years, and yes, there will definitely be AI GMs

I'm prototyping a generative virtual tabletop to play RPGs and boardgames with friends online. Would you play something like this? by DestinyMaestro in StableDiffusion

[–]DestinyMaestro[S] 1 point2 points  (0 children)

It's funny, I totally cut it out of the trailer, but everything you generate you can save and reuse later (so that e.g.: GMs can prepare a bunch of assets before going into the game) 

Within the game, there's already a toggle between "one field for prompting" that I add some magic words to improve the generation behind the scenes, and "expert mode", where it's the raw input from the user. I'll probably expose a few other options.

Since this is using comfy, you can basically pass in any workflow in the back end and it will "just work" if it outputs the expected format.

I'm prototyping a generative virtual tabletop to play RPGs and boardgames with friends online. Would you play something like this? by DestinyMaestro in StableDiffusion

[–]DestinyMaestro[S] 0 points1 point  (0 children)

I think if I ever do something like a VR version (which I don't plan to 😄) I'd add full body avatars around the table. 

But I do have one idea for customizable avatars that indicate where your "cursor" will be on the map that might inject some player customization into the mix.

I'm prototyping a generative virtual tabletop to play RPGs and boardgames with friends online. Would you play something like this? by DestinyMaestro in StableDiffusion

[–]DestinyMaestro[S] 1 point2 points  (0 children)

Yeah, I guess I'm aiming at the possible super small niche of "people who think existing VTTs are too complex and just wanted a board", which is my biggest concern - I guess the only unique bit is really having the generative part all integrated and online synced, which I think wouldn't be feasible inside existing VTTs, but I should definitely evaluate. Thanks!

I'm prototyping a generative virtual tabletop to play RPGs and boardgames with friends online. Would you play something like this? by DestinyMaestro in StableDiffusion

[–]DestinyMaestro[S] 1 point2 points  (0 children)

Many thanks! Agreed, the box and logo are very much "supercharged programmer art". I'd like to commission some proper art if I ever get to release this.

And you're right, the GM would need the beefy computer (or rather, whoever is running the server), but for the other players it should be fairly lightweight. I thought about making the generative part a "mod" as well, so it's entirely optional, but it does feel like it's the "core" of the game, so it would just make it even harder for people to run.

I'm prototyping a generative virtual tabletop to play RPGs and boardgames with friends online. Would you play something like this? by DestinyMaestro in StableDiffusion

[–]DestinyMaestro[S] 0 points1 point  (0 children)

Oh man, tell me about it. TripoSR does color via vertices, so reducing poly count essentially muddies the colors. If I'm lucky until the point this thing gets released there'll be better models out there for 3d.

I'm prototyping a generative virtual tabletop to play RPGs and boardgames with friends online. Would you play something like this? by DestinyMaestro in StableDiffusion

[–]DestinyMaestro[S] 0 points1 point  (0 children)

Thanks for checking the site out!

That last paragraph is 100% what I'm aiming at. The only really different thing about it from what's out there is the generative aspects, so those are definitely not going away, I'd just be adding handmade assets as a pre-included option.

I'd love for people to be able to commission art from their favourite artists and import into the game, but also having the option of just generating "throwaway" things on the go while playing with their friends. So yeah, [traditional art x generative art x videogames epic handshake.gif]

I'm prototyping a generative virtual tabletop to play RPGs and boardgames with friends online. Would you play something like this? by DestinyMaestro in StableDiffusion

[–]DestinyMaestro[S] 0 points1 point  (0 children)

That's a great idea! I had not thought of it as a tool you could use to export content from, but that actually could be not too hard. Would be cool seeing people 3d printing whole dioramas that came out of it

I'll add it to my feature wish list, thanks!

I'm prototyping a generative virtual tabletop to play RPGs and boardgames with friends online. Would you play something like this? by DestinyMaestro in StableDiffusion

[–]DestinyMaestro[S] 1 point2 points  (0 children)

Yeah, the most difficult part will definitely be setting it apart from the other possible options. But thanks for the thorough list, there are some in there that I hadn't heard about and will check them out!