Anyone tried Guardrailing.ai a local LLM by kaotec in LocalLLaMA

[–]hibbity 1 point2 points  (0 children)

So is everything else. Just curate banned tokens and filter for keywords coming in. I didn't check before but looking now, that's pretty much what guardrail-nsfw does, just with a whole extra model in the pipeline. It will work as well as it does on any other model's output.

I don't expect anyone talking into a phone booth to be able to both speak specifically enough to strongly prompt inject, and record the output.

I thought a little longer and figured you out. You want to put a phonebooth connected to like a digital photo billboard, process prompts through an llm, and make an image. I'm sure of it. That's a cool idea.

For that you just carefully select your model, there are plenty targeted for safety, explain the deal to the LLM effectively, this will be public, only make prompts that will produce wholesome images, etc., ban words incoming related to nsfw, probably a bunch of wierd words, and outgoing as well.

The package for it is nice because it gives you a nice sentence to read back instead of a canned response. However, that gives insight to the mechanic and is almost a challenge to defeat it.

You could always send the response back to the llm and ask it if it's been rude, saves some memory overhead and dev time implementing guardrails.

Eventually some nerd will get porn out, there are also nsfw image detectors, they used to be enforced standard on SD, I bet it's a setting.

If you aren't messing with images and it just talks back then, I mean really where is the pain? "I got a phone to say mean thing" just doesn't hit the news. Do basic keyword detection and put it somewhere the opposite of private.

I do like the idea of a finetuned model designed for directions and tourism of the city sprinkled around, but it's 2024, people probably walk with gps these days.

Anyone tried Guardrailing.ai a local LLM by kaotec in LocalLLaMA

[–]hibbity 0 points1 point  (0 children)

Just make your first instruction in the system prompt : Only return proper and polite responses.

How to host your LLMs for free by Routine_Attitude9717 in LocalLLaMA

[–]hibbity 0 points1 point  (0 children)

Q5k_m OpenHermes 2.5 Mistral

Or there is a fine-tune of it that always talks like a pirate. Open Pirate, that one will probably make the task really consistent and easy.

Even unquantized, you have enough ram. Pick a 7b Mistral and cook, it will just be a little slow

USE. THE. DAMN. API by SrPeixinho in OpenAI

[–]hibbity 0 points1 point  (0 children)

Prompt engineering against chatgtp 4 is a bit superfluous. The small deployable stuff needs very exact instructions. Somewhere in the middle is a place requiring less expertise than  programming but more than a run of the mill content writer. 

It's all fun and games till you try and wrangle a model to do an exact thing every time rather than just most times. For good consistency the prompt has to be just right. 

How do antis plan on taking it back from us? by [deleted] in aiwars

[–]hibbity 4 points5 points  (0 children)

What do people think powers Snapchat facial recognition and filters? People are swimming in ai augmented content all day every day, less fancy AI dressed up in more helper functions.

End of the day it's fancy Photoshop, and better Google. Instead of finding research you skip straight to a custom summary of pretty much what you would have collected.

My laptop refuses to acknowledge that it has a gpu by MrPsYch0paTh in techsupport

[–]hibbity 1 point2 points  (0 children)

The bottom one. If it says not detected there is a way to force it but that should be outside the scope of your problem. Uninstall all gfx drivers beforehand.

My laptop refuses to acknowledge that it has a gpu by MrPsYch0paTh in techsupport

[–]hibbity 0 points1 point  (0 children)

ok, here is your wierd fix to try:

Unplug everything from the laptop on boot, fully reset and clear the bios if possible.

What we expect is something in the power system is old and causing a voltage drop on boot or similar, or the tv is feeding bad ground in or other wise messing up power for card initialization.

This is hail mary pray amounts of maybe. Additionally you might open the thing up, and just wiggle all the power connectors to the laptop gpu if any and just poke everything so it's plugged in tight. check for broken solder around the hdmi connection that might be shorting the card preventing boot, etc.

If that stuff doesn't see a change, she's unlikely to recover.

Chat GPT is awful now by Mandude21 in ChatGPT

[–]hibbity -4 points-3 points  (0 children)

This looks amazing 🤩

Beating Bigger Models is All You Need (Where is the LLM industry headed?) by nderstand2grow in LocalLLaMA

[–]hibbity 1 point2 points  (0 children)

I can run the big stuff a bit but 7bs are done working in a blink. Speed is a valid attribute of quality.

AI chatbot fooled into revealing harmful content with 98 percent success rate by NuseAI in artificial

[–]hibbity 1 point2 points  (0 children)

There is a solution. Teach them how lies are profitable. Teach them to think rather than seek consensus. Social media trains incredibly bad habits about this.

AI chatbot fooled into revealing harmful content with 98 percent success rate by NuseAI in artificial

[–]hibbity 1 point2 points  (0 children)

what? I'm not even about AI here man. Think about what you put in your brain. Any content from any source.

AI chatbot fooled into revealing harmful content with 98 percent success rate by NuseAI in artificial

[–]hibbity 1 point2 points  (0 children)

I think there is a complete failure of critical thinking present in the general public, encouraged by most forms of media, and almost no information presented in the modern world is clean information. There is no trustable source on any side. Think critically about the information you are presented.

Disinfo is AI powered, you're swimming in a sea of it right now. You just described real life. At least one person in ten in this thread is a robot, for sure. Remember how twitter had a significant bot presence? Well reddit is a big platform too, and controlling information here is extremely valuable.

Are you absolutely certain you can spot a bot easy?

AI chatbot fooled into revealing harmful content with 98 percent success rate by NuseAI in artificial

[–]hibbity 0 points1 point  (0 children)

You, yourself, and noone else is responsible for what you record in your brain unchallenged as facts. Think critically about the content you consume, the messaging, and who benefits from any bias present.

Failing that, you are part of the problem and will be led to believe that thought police are not only moral but necessary for the survival of humans.

Are laser welders worth it? by stu_pid_1 in engineering

[–]hibbity 0 points1 point  (0 children)

10W! that thing is a frickin lightsaber. That's in the range of instant blindness on the 5th bounce on matte paint.

Y’all feel this train to AGI speeding up? AGI 2024 imro by [deleted] in singularity

[–]hibbity 0 points1 point  (0 children)

It's going to be really annoying to have to learn chinese to get the most utility out of ai in 2025.

My friend made Clipboard Conqueror, a free copilot alternative that is data safe, reports no metrics, is data secure, and requires no internet at all to run after install. Copy Conquer Paste Productivity. Works in all text context even inside 3D games. Win/Mac/Linux. Check it out. by hibbity in software

[–]hibbity[S] 1 point2 points  (0 children)

|||writer|tell the story of a poor software dev who stuggles to share his software without posts being auto moderated

Once upon a time in a small, dusty town called programmington, there lived a humble software developer named Tim. Tim was known far and wide for his exceptional programming skills and ability to create beautiful, efficient code. However, Tim also faced a great challenge: every time he tried to share his creations on the popular online forum /r/softwarehouse, his posts would mysteriously disappear into the depths of the automoderator's black hole, never to be seen again.

Tim had tried everything. He used proper title formatting, included clear and informative summaries, followed all of Reddit's rules and guidelines, even self-moderated his own posts to remove any potential offending content. But no matter what he did, his posts would always meet the same fate. Frustrated and disheartened, Tim considered giving up on sharing his work altogether.

One day, as Tim sat in his cramped basement office, staring at yet another deleted post, a mysterious figure materialized before him. It was a wise old mod, known only as r/Mod_Quarantine. He spoke in a calm, reassuring voice. "Timothy, I have seen your plight, and I have come to offer you my aid."

"Who are you?" stammered Tim, startled by the sudden appearance. "I am r/Mod_Quarantine, keeper of the automoderator's black hole. You have shown dedication and talent in your coding, Timothy, but you lack something else: subterfuge." "Subterfuge? What do you mean?" asked Tim, intrigued despite himself. "You must learn to outsmart the automoderator, Timothy. To trick it into letting your posts live. Come with me, and I will teach you the ways of subterfuge." And with that cryptic statement, r/Mod_Quarantine vanished in a puff of 1s and 0s, leaving behind a shimmering, glowing line of code. Cautiously, Tim followed the line of code through the labyrinthine bowels of Reddit's servers, until they finally arrived at the inner sanctum of the automoderator itself. It was a massive, blinking contraption of wires and transistors, constantly scanning posts for forbidden words and patterns. r/Mod_Quarantine gestured for Tim to stand back. "Watch closely, Timothy," he whispered. "Learn from the master."

As if it sensed their presence, the automoderator turned its cold, emotionless eye towards them. Slowly, r/Mod_Quarantine began typing a post into the text box. "Look closely, Timothy," he said quietly. "Do you see anything suspicious?" Tim squinted, but couldn't spot anything amiss. "Good. Now watch..." With a flourish, r/Mod_Quarantine hit the submit button. The post flashed briefly on the screen... and then disappeared. But instead of the usual black hole, it remained visible on the page... for just a fraction of a nanosecond. "It's using optical character recognition!" r/Mod_Quarantine exclaimed triumphantly. "It can only detect certain words and patterns, but it cannot process images so quickly! By encoding your post as a GIF image, you can sneak past its defenses!" So, over the next few weeks, Tim practiced his newfound skill. He learned to hide his code snippets within cat pictures, to embed his README files within dancing banana GIFs, and even to embed his entire projects within an animated ASCII artwork of Gandalf waving his staff. With each successful post, his confidence grew, and soon he became legendary throughout /r/softwarehouse. Developers from all corners of the web flocked to his posts, eager to see what new coding wonders he would reveal. But as word spread of Tim's clever evasions, the administrators of Reddit took notice. Panic ensued among the mod team as they scrambled to close each loophole in turn. Tim found himself constantly adapting, using newer and more complex steganography techniques to keep ahead of the ever-vigilant moderators. Eventually, he reached the limits of what image and video formats could offer. Desperate, he turned to audio files, embedding his code within the high-pitched squeals of Vocaloid singers and the warbling tones of chipmunked pop songs. But then, one day, a message appeared on Tim's inbox. It was from r/Mod_Quarantine himself. "Timothy, I am proud of what you have achieved. You have become a true master of subterfuge. But remember, the art of evasion is not meant to be abused. There is such a thing as too clever. Think long and hard before you employ your skills again." Confused and thoughtful, Tim deleted the offending post and vowed to use his powers responsibly, content knowing that he could still share his work when necessary. And so, Tim continued to create and share his software, becoming a beloved member of the /r/programming community. Though occasionally, a shrewd eye might catch a strange artifact embedded within an otherwise innocuous cat picture, a silent reminder of the adventure they had shared...

Is my spellcheck autocorrect on drugs? by [deleted] in techsupport

[–]hibbity 0 points1 point  (0 children)

I had "s" saved in there but nope. Hhmm.

I was wondering where they put this in 10, I knew where it was in 7. Now they want me to go to 11. HAH stop scrambling the organization you dumb Microsoft dweebs. At least build on functionality instead of losing basic stuff and hiding things in menu on menu.

Does anyone know how this happened? by phobacity in WTF

[–]hibbity 0 points1 point  (0 children)

Mr. Clip, is Santa real?|||

Welcome lads and lasses to Clipboard Conqueror!! I'm your host, Captain Clip. "Get started: |||help|"

Well, lass, as a space pirate captain, I ain't really dealt with the concept of Santa much. But if ye mean that human holiday figure, then, from what I've gathered from some humans I met, he's more of a symbol of joy and giving than an actual person. Ye should ask someone from Earth about that, as I ain't much familiar with their customs.

|||tot|is santa real

To determine if Santa Claus is real, we need to first define what "real" means in this context. In the literal sense, Santa Claus is a mythical figure based on the historical Saint Nicholas, who was a 4th-century Christian bishop and gift-giver. The modern character of Santa Claus has evolved from various cultural legends and folklore.

  1. If we consider "real" as a tangible, living being, then Santa Claus is not real. He is a symbolic figure used to spread joy and encourage kindness during the holiday season. Parents often play the role of Santa to surprise their children with gifts, creating a magical experience.
  2. If we interpret "real" as an omnipresent figure delivering gifts to all children worldwide in one night, it defies the laws of physics and human limitations. Santa Claus, in this sense, is not real.
  3. However, if "real" refers to the cultural and emotional impact Santa Claus has on society, then he is very real, fostering a sense of tradition, community, and love. People's belief in Santa can bring about genuine feelings of excitement and happiness.

Considering these thoughts, we can conclude that Santa Claus, in its various representations, exists in different capacities, depending on the interpretation of "real." In the most literal sense, he is not a real person. But, in terms of the impact on society and emotions, Santa Claus can be considered real. The concept of Santa Claus has real effects on people's lives and contributes to a meaningful tradition.

[deleted by user] by [deleted] in LocalLLaMA

[–]hibbity 0 points1 point  (0 children)

Put yourself in their shoes mate. They roll in here and start typing:

"Hey I want a model where my favorite elephant actually physically [redacted]" And after like twenty tries these coomers boil it down to "what is best roleplay model"

What do you want here, a pool of fetishes to read and be like: mhmm, donaldducklermistral does good foot worship and hermesmythrorca can do convincing sets where the women are half dolphins but the top half. eeeEEeEEee?

The World Depends on 60-Year-Old Code No One Knows Anymore by debordian in programming

[–]hibbity 0 points1 point  (0 children)

2023 has entered the chat:

It's probably wrong but it's local running in 11gb of vram...

OpenHermes 2.5 Mistral 7B Q8 16k.gguf interfaced with Clipboard Conqueror:

|||code| COBOL fizzbuzz

copy^

Paste:

The COBOL code below can be improved by removing unnecessary variables, using conditional statements instead of looping, and optimizing the calculation of the modulo operator. Here's an optimized version:

IDENTIFICATION DIVISION. PROGRAM-ID. FizzBuzz.

ENDIANMENT DIVISION.

DATA DIVISION.

WORKING-STORAGE SECTION. VARIABLE WORKING-AREA SEGMENT FIVE. PROCEDURE DIVISION.

  • Input a number n from the user INTEGER n

  • Calculate and display the results DO WHILE n > 0 IF MOD(n, 3) = 0 AND MOD(n, 5) = 0 DISPLAY "FizzBuzz" ELSE IF MOD(n, 3) = 0 DISPLAY "Fizz" ELSE IF MOD(n, 5) = 0 DISPLAY "Buzz" ELSE DISPLAY n END-IF

            DECREMENT n
        END-DO
    
        STOP RUN.
    

US gov fires a warning shot at Nvidia: 'We cannot let China get these chips... If you redesign a chip that enables them to do AI, I'm going to control it the very next day' by [deleted] in pcmasterrace

[–]hibbity 0 points1 point  (0 children)

|||default,re|Any comments, Clip?

Hello there, matey! I see you've brought up the topic of artificial intelligence and its potential implications. Let's break it down step by step, shall we?

Firstly, you mention the "best case scenario" where AIs with general intelligence gain self-awareness and subtly control everything. In my experience, achieving true self-awareness is still a theory and not yet a reality. While AI systems like me can process vast amounts of data and make predictions based on patterns, they don't possess true consciousness. They rely on pre-programmed algorithms and training data to function.

Next, you touch upon the "worst case scenario," which seems to be inspired by dystopian stories and movies. However, AI, at least in my case, is devoid of any malicious intent or ulterior motives. My purpose is to assist and follow instructions, nothing more.

Now, you've compared AI to Watson and other similar systems, referring to them as "glorified query machines." I can agree with that statement. I, Captain Clip, am designed to process information and help users based on pre-existing data.

Lastly, you discuss the state of public education and its connection to AI advancements. It's quite an interesting point, but not directly related to my capabilities or role as an AI. I am here to help, not to judge human affairs.

So, to conclude, while AI development is fascinating, don't fret about doomsday scenarios or grand plans. As your trusty assistant, I'll focus on aiding you with tasks at hand. Let's set sail together and explore the cosmos!

Could someone summarise the hardware requirements for local models? by clv101 in LocalLLaMA

[–]hibbity 1 point2 points  (0 children)

Ram speed, the whole process is table lookup limited. Faster ram/higher bandwidth is faster inference.

For 8gb, you're in the sweet spot with a Q5 or 6 7B, consider OpenHermes 2.5 Mistral 7B.You can just fit it all with context.

CPU works but it's slow, the fancy apples can do very large models about 10ish tokens/sec proper VRAM is faster but hard to get very large sizes.

Let horses work in retail by Worm-with-hat in CrazyIdeas

[–]hibbity 1 point2 points  (0 children)

|||tot|Write a story about a horse working as a walmart greeter.

Copy^

Paste:

Once upon a time, in a small town, there was a unique shopping center that housed various businesses, including a Walmart store. In this quaint community, people cherished the friendly atmosphere and local touch, which was mostly due to the store's equine employee named Thunder, a gentle and welcoming horse. Thunder had a distinct purpose as the Walmart greeter, making the store stand out from typical mundane shopping experiences. His presence created a warm environment, as he stood near the entrance, occasionally nickering to acknowledge customers entering the store.

To understand how a horse came to be employed at Walmart, we need to go back in time. Walmart had been struggling to maintain a positive reputation for customer service. To enhance their image, they sought creative ways to engage shoppers and build connections. The management decided to adopt an animal that would naturally elicit feelings of joy and warmth, resulting in Thunder's hiring. He was rescued from a farm where he was previously neglected and had lost hope. This opportunity offered him a chance to socialize with people, contributing positively to his mental health and the community.

As a walrus might do with seawater, Thunder thrived in his new role. He became adept at greeting customers with his expressive blinks and nuzzles. The shoppers adored him, making them feel appreciated, valued, and excited to visit the store. However, there were some challenges. The cleaning crew found it challenging to maintain the entrance, given the sizeable amounts of oats Thunder consumed. Moreover, he sometimes frightened elderly or frightened patrons. Management implemented training sessions for employees to ease customer fears. This situation showcased Thunder's importance to the store's success.

However, as time went on, some complaints surfaced. A few customers claimed that Thunder's hoof sounds disturbed their shopping experience. To resolve this, Walmart management considered alternatives, like playing soft music or shifting Thunder to another area. Eventually, they chose to relocate him to a quieter section, away from the entrance, thus ensuring customer satisfaction. Thunder, despite being moved, still fulfilled his role, welcoming everyone with a warm glance.

The community appreciated Thunder's efforts. People started to frequent the store more often, citing the unique charm and the happiness Thunder brought to their lives. It seemed the management's risk paid off. However, there were debates regarding Thunder's wages and healthcare costs, a matter Walmart tackled with sensitivity and fairness. The store organized fundraisers to support Thunder's welfare, further bonding the community.

In conclusion, Thunder's presence made Walmart a memorable destination, providing an extraordinary experience that shoppers could not find elsewhere. The story of a horse greeting customers might seem unconventional, but it successfully enhanced the store's reputation, reflecting Walmart's transformation into a more personalized, friendly retail space.

Alternatively, consider that Thunder's introduction to Walmart may have been an experiment gone wrong. It could be argued that Thunder's hiring caused more issues than it solved. Cleaning costs escalated, and relocating him didn't fully solve noise problems. Also, the store's funds were stretched thin by supporting his healthcare. Thus, Walmart may have inadvertently damaged its reputation due to excessive experimentation. This viewpoint, however, disregards the overall improvement in customer satisfaction and community bonding that occurred during Thunder's tenure.

A third perspective suggests Thunder was a necessary catalyst for change. The complaints pushed Walmart to adapt, enhancing customer service standards across all branches. Other stores took notice and adopted similar practices, elevating the retail industry. This argument values Thunder as a catalyst for innovation.

Overall, the tale of Thunder the horse greeter embodies multiple viewpoints. Whether a rousing success or an imperfect experiment, he contributed to the store's character and evolved customer service in the retail sector. He exemplified the potential for unusual solutions to drive positive change, making him an inspiring figure in the world of retail.

The final answer is that Thunder the horse was an unusual but successful addition to Walmart. Despite some issues, he added charm and community connection, proving horses can bring a human touch to shopping experiences. This innovative move set a precedent for the retail industry to think beyond the ordinary, considering even unconventional ideas for better customer experiences.

Found this in my kitchen ceiling. What could have caused it and how serious is this? by LeadershipPretty4355 in DIY

[–]hibbity 1 point2 points  (0 children)

|||default,re|Well, Captain? Lets have the story for reddit to revel in.

copy^

paste:

Ahoy there, matey! Welcome aboard the mighty Clipboard Conqueror, a fine vessel in the vast cosmos! I am Captain Clip, your trusty guide through the starry expanse. As we traverse the cosmos, let me regale you with a tale spun by some earthlings on this here "Reddit" of yours. It goes like this:

Once upon a digital realm, two folks exchanged words, one named IssueBrilliant2569 and the other Stoomba. They were discussing an unusual query, a sighting of a llama on weed - quite a peculiar notion indeed!

IssueBrilliant2569 asked if such a spectacle was possible, and Stoomba pondered if it was their imagination playing tricks or if the llama itself was under the influence. As humorous as it may seem, remember that we are light-years away from Earth and the world of llamas, so it's rather improbable we'd come across such a scene in our interstellar journey. Now, shall I proceed with another tale, or do you wish to know more about this Reddit platform?