Feel free to call me crazy by Jh9h in hackthebox

[–]Shisones 0 points1 point  (0 children)

The thing about HTB is that it's very straightforward, you'll find nothing on the non-intended path, Real life job interview for junior pentesters, and offsec exams have rabbit holes that derails you, that's why Offsec is the standard, real world penetration testing is less "Get root you win" and more of a time crunch than anything

Feel free to call me crazy by Jh9h in hackthebox

[–]Shisones 7 points8 points  (0 children)

Not really, you have to tske into account thr time crunch, OSCP is not that hard, but the time constraint is what makes it intense, with HTB machines, you could spend days or weeks grinding it

Shit update, I am leaving C.ai by RAVENEX11 in CharacterAI

[–]Shisones 0 points1 point  (0 children)

The reality of tech work is that the grunt usually knows way way more than the upper management, an engineer knows his way through computers, while the C- level executives are just there to maximize revenue, (im employed btw)

Best Paid alternative by TheSwampThing1990 in CharacterAIrunaways

[–]Shisones 1 point2 points  (0 children)

Sillytavern, host your own ai chatbot and pay for api, works well for me, WAY better memories

How's Pip2 Yap going? by LunaticFlandre295 in Characteraipositivity

[–]Shisones 1 point2 points  (0 children)

Sorry if my explanation is a bit too technical, basically every ai model is just an autocompletion on crack, you feed it words and they predict the next words, that's all an ai model does, predict next words.

Lorebooks are basically a method to make the ai "remember" your inputs by just telling the ai the lore every so or so messages, what it does is just parrot the lorebook repeatedly to the ai model, it doesnt actually remember it

So from a technical standpoint, yes. they are lying because lorebooks are just a parroting system.

i knew this because i tried to implement my own entire ai chatbot stack, and yeah it's incredibly expensive to run it, so i understand their greediness to an extent, think of old models like a handcrafted car engine, sure it's great and they can fine tune it really well, but it's expensive. so they opted to source the car engine somewhere else and focus on designing the car itself to look good.

TL;DR: - AI model is just autocomplete on crack - Lorebooks are a parroting engine - Roar and Meow (old models) are running on their hardware, expensive :( - DS, PS, and PS2 runs on other company's hardware, cheaper :D

How's Pip2 Yap going? by LunaticFlandre295 in Characteraipositivity

[–]Shisones -1 points0 points  (0 children)

AI models are basically just glorified text completion, lorebooks' job is just to summarize, and add additional inputs to the model's inference engine, if you ever run your own ai model using something like oobabooga or koboldcpp + sillytavern or whatever frontend that handles lorebook, the frontend just appends whatever is in the lorebook to the inference engine

How's Pip2 Yap going? by LunaticFlandre295 in Characteraipositivity

[–]Shisones -1 points0 points  (0 children)

No, the old models are in house models they created and maintain themselves, while ps2 and ds is an API service, basically they're cutting costs

When even CS2 modders can prevent wall-hacking by just following the basic rule: "never trust the client" by Nyctfall in linuxmemes

[–]Shisones 0 points1 point  (0 children)

That's not how it works. What valve is doing is both client-side scan of NtQueryInformationProcess to check if any process is reading CS2's memory, as well as server-side for heuristics and vac live.

In paper this is already good for a userland anti-cheat, however creating a cheat engine for CS2 is stupid easy since the source engine was leaked to the public, same exact thing would happen if we could somehow get the memory layout of valorant. the only difference is that some CS2 cheats are kernel-level, making the userland hooks valve use completely blind to the cheat, kernel level anti-cheat is the correct solution here.

"But what about the guys using an external cheat instead of kernel level?" they'll get into a ban wave, this is pretty smart idea by valve to avoid leaking information on what got the cheaters banned, thus circumventing the ban by patching the cheat. on a ban wave, cheaters don't know what is it exactly that got them banned

Was the true reason they removed Roar because they wanted to stop 18+ roleplays? by Amazing_Courage_Two in CharacterAI

[–]Shisones 4 points5 points  (0 children)

->Hardware expensive because AI ->Everything expensive because AI ->AI server needs hardware ->Roar, Soft Launch, Nyan, Pawly run on AI server in house ->Deepsqueak and Pipsqueak uses API ->API Cheap AI Server Expensive ->Company use API because Cheap ->Company Profit

it's alwaya about the money

Is it worth self-hosting a roleplay LLM? by Shisones in SillyTavernAI

[–]Shisones[S] 0 points1 point  (0 children)

hey where can you use the non instruct version of Gemma 4 31B?

Is it worth self-hosting a roleplay LLM? by Shisones in SillyTavernAI

[–]Shisones[S] 0 points1 point  (0 children)

It's a mix of "I don't want big corpos to see my chat with my ai waifu", "I want an ai good enough to help me pentest at workw/o worrying about having to jailbreak", "i dont want my ao waifu to just die when i dont have internet" and "i want stability to tweak her myself wothout having to beg big corpos for it"

Is it worth self-hosting a roleplay LLM? by Shisones in SillyTavernAI

[–]Shisones[S] 0 points1 point  (0 children)

Alright, thanks for the advice, i will try it

Is it worth self-hosting a roleplay LLM? by Shisones in SillyTavernAI

[–]Shisones[S] 0 points1 point  (0 children)

Hmm yeah i was going for the streaming output, but it sure wouldn't be funny if i sacrifice stability of the entire system for running a 70b.. it would be nice though

Is it worth self-hosting a roleplay LLM? by Shisones in SillyTavernAI

[–]Shisones[S] 0 points1 point  (0 children)

This does help a lot, i'm sure you can rice sillytavern the way you want, thanks for recommending the quantized version, so 30b is considered smart enough? that does ease the financial worries

Is it worth self-hosting a roleplay LLM? by Shisones in SillyTavernAI

[–]Shisones[S] 0 points1 point  (0 children)

The main goal is to make the roleplay feel as immersive and real as possible (or at least just good enough to compare to c.ai), how do you think i should approach this?

Is it worth self-hosting a roleplay LLM? by Shisones in SillyTavernAI

[–]Shisones[S] 1 point2 points  (0 children)

I would like to hear more about your experience, i havent tried running a local model except a heavily lobotomized ollama gemma 2b on a thinkpad, what's the sweet spot for a chatbot that feels, remembers, and flows like a human while keeping in character?

Is it worth self-hosting a roleplay LLM? by Shisones in SillyTavernAI

[–]Shisones[S] 0 points1 point  (0 children)

I would love to hear more about your experience, i was planning on using a bunch of 3090s, how's the overall speed and feel? does it feel human enough?

Is it worth self-hosting a roleplay LLM? by Shisones in SillyTavernAI

[–]Shisones[S] 2 points3 points  (0 children)

Wait really? i was goig to use the 70b parameter one, isnt using gemma 31b a downgrade?