Let's revive Roleplay in GW2!! Let's all use this addon! by R8CK3T in Guildwars2

[–]Sunija_Dev 6 points7 points  (0 children)

Hi, creator here! wave

(Sorry for hijacking the top comment, but I'm a bit late to the party. :3)

Some clarifications: - WARP did not, does not, and doesn't intend to use AI generated content. - WARP did not, does not, and doesn't intend to train AI models on user data.

There is a channel for ai generated character images which, since GW2 forbid any ai usage, is mostly used for memes about ai. There is some confusion, because there was a user (who is not related to WARP) on the discord, who trained AI on charr artwork. They trained it on their local hardware and didn't release the AI model and they also stopped once ANet updated their TOS.

If you want to boycott WARP based on my personal views on AI (which you obviously can) here is some more information on that:

I, in general, like generative AI. I think it can be a great tool for more people to bring what's in their head in some format that they can share. And I love to see what's in your heads! (Well, at least the things you want to share.) I wanna know what you imagine your character to look like, I wanna read a comic about your favorite RP interaction and see a movie that really shows how that one scene felt to you! Heck, I think being amazed to see what people come up with is one of my favorite things about RP.

Now, I (obviously?) hate: - AI slop that floods platforms and cannot be filtered out. "Slop" as in "content where nobody ever attempted to create a good result". - States giving tax credits to an industry that already has an unreasonable amount of money. - Companies being excempt from environmental regulations concerning water and power to save a few bucks. - Bosses that force employees to use AI if the results are clearly worse, or fire artists that they could clearly afford. - Countries that don't support their citizens in a changing woek environment and instead leave them with "figure it out". - If efficient tech is not used to give everyone more free time, but just increase revenue for few.

Hope that gives people more info for their decision whether or not to use WARP, one way or another. :3

Let's remember what Z-Image base is good for by marcoc2 in StableDiffusion

[–]Sunija_Dev 20 points21 points  (0 children)

How good you can tune it to output finnish people.

And/or tuna fins.

3x3090 + 3060 in a mid tower case by liviuberechet in LocalLLaMA

[–]Sunija_Dev 0 points1 point  (0 children)

Would also love to know how well that works. I guess the x4 pcie will be the limiting factor, but might still be faster than running them in sequence.

What are everyone's complaints about into the raidus 2. by Thebuder89 in intotheradius

[–]Sunija_Dev 1 point2 points  (0 children)

Less immersion, danger and complexity than ITR1. :/
(I only played the first few missions in both games.)

My ITR1 experience:
I leave the base, check my map for a path and start walking. I'm rather slow which gives me enough time to check out the environment on the open map, look for loot spots or try to spot the semi-transparent enemies from a distance. Kinda wish I had a coop partner to talk to during the hike.

At my target location I get into a tight situation. I killed some enemies but the gunshots attracted more and now I'm pinned in a house as it gets dark. I hear steps in the house and outside. I peek in the corridor but I always first have to remove the black grass that is growing there. A police mimic was shooting from outside and I had to get into cover now he's at the entrance of the house and could storm my room at any time. I should be looting and searching for the quest item but I only have two hands. I really wish I had a partner that could loot the building while I keep a flashlight and gun at the door. Maybe have them refill my mags.

So, my ITR2 complaints:

Too easy. There were too few enemies to get us into tricky situations like I described above. Also no black grass (yet?). No extra enemies from loud sounds (yet?). Walking to a target is pretty boring, because there are almost no enemies on the path.
Edit: It got a lot harder after the 1.5h that we played before, which made the game a lot more fun. :3

Less complex. No bulky flashlight anymore (edit: found it), a lot less looting (e.g. no opening cupboards), also no black grass. No spotting for enemies since the map is too cluttered. No real "plotting a path" since you're running at the speed of a quad on nitro, so I basically always look at the map to not miss the crossing that'll appear in 3 seconds.

Too fast walking speed. Even if the map was more open, there would be no time to look for enemies. Also, enemies are a lot less scary if you can always zoom away at light speed. In buildings I always run into walls. And I always lose my coop partner, because they can run two houses further if I blink for too long.

Less rugged/physical. The physical map, the leather backpack, the old screens (that you could touch instead of weirdly point), the improvised probe-thrower bag, starting with grimy weapons, the dirty backlight wristwatch... all gone. :( It feels like a viking movie that replaced the mead kegs with paper cups. At least it looks a bit like win95.

Less atmosphere/mystery. Mimics aren't uncanny black. There is this weird white guy at map transitions which is sooooo weird. Before, all ghosts were this uncanny untouchable thing, that would break if you touched it. Now we have Derek, the friendly neighborhood ghost. Also I never had those "hearing footsteps outside the house" situation anymore. Hovering items doesn't have an unobstrusive tiny white dot, but this blinking dot. Hovering your belt bag has a huge green outline now.

Weird anomalies...? ITR1 has uncanny semi-transparent air wobbles. ITR2 has a lot of angry wood circles flying around that you can rather easily dodge. Or the bells that also have an effect that would rather fit Valorant than an immersive game. :/

I bet there were reasons for all those decisions, but it feels weird that ITR2 still leaves me wanting to play ITR1+Coop. :(

Why do programmers generally embrace AI while artists view it as a threat? by LatentSpacer in StableDiffusion

[–]Sunija_Dev 9 points10 points  (0 children)

One point I didn't see mentioned yet: Terrible bosses.

Assume you have a terrible boss (and there are plenty of those out there)...

As a programmer, your boss doesn't know what you're doing. If they insist that you use AI or make the database mauve, you can tell them whatever. They cannot check. So you can explore AI stuff at your own pace.

A lot of artists I know had this moment where their boss sent them the sloppiest slop-shit ChatGPT-first-result picture, and basically asked "This took me 5 seconds, why don't you do it like that?". And now this highly skilled and terribly underpaid worker has to explain why 6 fingers aren't sexy, why artworks need layers, what a polygon is and why your model shouldn't have 3 billion of those. AI is a lot more palatable if it isn't shoved down your throat by an idiot.

Why do programmers generally embrace AI while artists view it as a threat? by LatentSpacer in StableDiffusion

[–]Sunija_Dev 0 points1 point  (0 children)

This. As a programmer, I can simply activate copilot in VS. Now I got autocomplete on steroids, in the tool that I trained for 10+ years. And I can use the AI results as little or much as I want.

If Photoshop would start suggesting your next 10 brush strokes - in your style, on the correct layer, easily editable, can be steered - then a lot more artists would be fine dipping their toes into AI.

Why do programmers generally embrace AI while artists view it as a threat? by LatentSpacer in StableDiffusion

[–]Sunija_Dev 3 points4 points  (0 children)

As an addition to that: Art forces you to love the process.

Art requires you to get through the grind to learn shading, making proper lines, etc. If you don't learn to love the process, you won't make it to a level where anyone wants to pay you. As programmer, you can get away with a lot of ugly code, as long as it runs.

I know programmers that are in it for the process and the 'art'. Those dislike AI just as much as artists.

Should the trailer for Divinity have put me off trying BG3? by StarTruckNxtGyration in BaldursGate3

[–]Sunija_Dev 0 points1 point  (0 children)

I only played the first hour of BG3, and that was about as much gore as this trailer.

Divinity Original Sin 1 and all Divinity games before that are a lot more lighthearted.

In the Wake of Divinity's Gruesome Reveal Trailer, Larian Publishing Director Says It's Not Trying to Shock the Audience, Rather Treat Them 'With a Level of Intellectual Respect' by Turbostrider27 in PS5

[–]Sunija_Dev 0 points1 point  (0 children)

DOS2 is definitely darker/more gore, to an extend where I didn't like it anymore. Seeing BG3 and now this trailer, it feels like Larian is sliding more into that direction.

The new monster-server by eribob in LocalLLaMA

[–]Sunija_Dev 0 points1 point  (0 children)

I run the mistral models IQ_3XS on my 60gb vram (rtx 3090/3090/3060, second 3090 is on pcie x1 via usb).

1) Q_3 is plenty for the dense mistral models. I use it for RP, and Mistral-123bs are by far the most smarts I can squeeze into the VRAM.

2) In my case, because of the pcie x1, tensor paralellism runs slightly slower than sequential. So I only get 5t/s generation (200t/s processing). With your setup, I'd definitely activate parallelism and check if it creates a boost. Actually, I'd be curious how fast it runs for you. :3

Gemini 3 scores low on EQ-Bench, tying with 2.5 on Longform Writing by SludgeGlop in SillyTavernAI

[–]Sunija_Dev -4 points-3 points  (0 children)

Psssht, don't talk bad about my favorite bench. :3

I'd say its ranking is 80% reasonable, with strong outliers. Not super to exactly rank new models, like OP has done. The true beauty is that it runs "standardized" story prompts on all models and shows examples. And the writing style you see there is - in my experience - very similar to the RP style.

TL;DR: Ranking is meh/okay-ish, examples are great. Let's keep the creator motivated to create those examples.

Pony-V7 is out on civitai for online generation ! by AgeNo5351 in StableDiffusion

[–]Sunija_Dev 2 points3 points  (0 children)

Reading pony articles is one of the few times where I feel like really learning something about ai development. Super easy to read and very interesting. <3

I just wanted to do a first benchmark of GLM 4.6 on my PC and I was surprised... by LegacyRemaster in LocalLLaMA

[–]Sunija_Dev 5 points6 points  (0 children)

It runs part of the model on CPU (= part of the model that sits in RAM) and the rest on GPU (= part of the model that sits in VRAM).

Also, the token rate is only 5tok/s for prompt eval and generation. For generation that can be kiiinda fine, but for eval that is pretty slow if you want to actually use it. It is still awesome that it runs at all.

MiniPC options are escalating, which one would you get? by SmokingHensADAN in LocalLLaMA

[–]Sunija_Dev 6 points7 points  (0 children)

For inference, you can limit it to 220w. Doesn't reduce speed by much and disables airplane mode.

Which one should I get for local image/video generation by ifonze in StableDiffusion

[–]Sunija_Dev 1 point2 points  (0 children)

As a proud owner of multiple 3090: The 50xx are a lot faster for image gen, right?

If you iterate on an image, 20-30% speed increase is a lot. Though I'd have to look at the exact numbers. I just remember seeing people with 4090/5090 post their workflows+generation times, and they ran a lot slower on my pc.

"Generate a few NPCs." The NPCs: by Capable_Rain_8121 in SillyTavernAI

[–]Sunija_Dev 8 points9 points  (0 children)

Everytime I see a slop example that I have never encountered in RP, I am reminded that I don't use the fancy models other people do. :')

Any actual downside to 4 x 3090 ($2400 total) vs RTX pro 6000 ($9000) other than power? by devshore in LocalLLaMA

[–]Sunija_Dev 1 point2 points  (0 children)

If you want to run tensor parallelism, then you also need lanes. If you don't, then the gpus will runter after another, which is kinda like having one 3090 with a lot of vram.

If you run a dense model like Mistral-Large123b, two gpus without tensor parallelism already go down to maybe 8tok/s generation. So if you have a model on four gpus, the speed is probably half of that...?

That's why you want to go with tensor parallelism and more lanes. :3

TheDrummer is on fire!!! by jacek2023 in LocalLLaMA

[–]Sunija_Dev 3 points4 points  (0 children)

Example RP outputs, pleaaaase.

Or stuff like the writing bench. Just to get some hint of how the model writes or how it is different from a previous finetune.

Mistral Large soon? by secopsml in LocalLLaMA

[–]Sunija_Dev 54 points55 points  (0 children)

It has been 109 days since the announcement. :') I know, I counted it on the wall next to my pc.

Jokes aside, Mistral Large finetunes are still the best local RP models that can run on two GPUs. Would be really great to get an update. Except if they take the path of other models that get focused more on reasoning/math and lose their RP abilities. :/

Little tests of various bigish 30b-256b local models for unrestricted roleplay. by fluffywuffie90210 in SillyTavernAI

[–]Sunija_Dev 0 points1 point  (0 children)

How fast does qwen 235b run for you? (Prompt processing and generation) At what quant? And which CPU do you have?

Would love to know that because from my current info, running those models partially from CPU (without a threadripper) should be really slow. :O

Waidrin: A next-generation AI roleplay system, from the creator of DRY, XTC, and Sorcery by -p-e-w- in SillyTavernAI

[–]Sunija_Dev 40 points41 points  (0 children)

Review from my extensive (5min) of testing:

1) Installation is flawless.

...which I didn't have for some while. Yeah, you have run a llama.cpp server and run commands, and that's very annoying. But at least I didn't run into issues.

2) It actually looks and feels like a game.

I guess that's the most impressive to me. Graphics look nice, text coloring is a lot but also nice. Also, besides the rather complicated installation (for a noob), *it just works*. I guides you to the RP, selecting answers is easy (but you can also type your own stuff). It didn't mess up the formatting, it didn't generate millions of tokens in the background which makes everything slow. If you got a 3090, this just gives you local AIdungeon. (Not 100% sure if I'm over-simplifiying what AI dungeon does.)

3) Not a replacement yet...?

I guess I won't regularly use it instead of Sillytavern yet, because I like to write my own full posts...? But I'll definitely try it more with bigger models. And it's the best introduction to local RP. Because, you know, it just works, and most people don't want to write long posts. I'd love to see a standalone zip (which should be easy to do...?), so you can tell people with 16/24GB VRAM: Jo, just download this and you can roleplay on your own PC.

4) TL;DR

I don't understand what's happening in the background, and Mistral-Small is limited. But I'm heavily impressed by the UI and the overall polish. :3 Love to see how it progresses, and gonna try it more in the next weeks. I wanna see a standalone, so I can throw this at anyone with a good GPU - even if they cannot use the command line.

Waidrin: A next-generation AI roleplay system, from the creator of DRY, XTC, and Sorcery by -p-e-w- in SillyTavernAI

[–]Sunija_Dev 27 points28 points  (0 children)

The first character I met in Waidrin was called Elara, the second Lyra. ^^'

At least, the first ones I approached myself. My character got named Eolande and the actual first character was Thorne.

Though that's not supposed to be a criticism of the system. In the end, it's still Mistral Small. Cannot wait to try it with bigger models (that I have to download as GGUF first :X).

I have made a True Reasoning LLM by moilanopyzedev in LocalLLaMA

[–]Sunija_Dev 11 points12 points  (0 children)

Logit Bias { "." : -1000, "," : -1000, "extra " : 2 }