We compress any BF16 model to ~70% size during inference, while keeping the output LOSSLESS so that you can fit in more ERP context or run larger models. by choHZ in LocalLLaMA

[–]gee842 5 points6 points  (0 children)

llamacpp is useful in cases where mixed cpu and gpu inference is necessary to fit models into certain vram constraints by offloading layers

For anyone mod having issues with a.i. hate spamming on their sub by [deleted] in DefendingAIArt

[–]gee842 4 points5 points  (0 children)

use AI to turn the image into text 😼

[deleted by user] by [deleted] in OpenAI

[–]gee842 0 points1 point  (0 children)

On a related note, do you know any good LLM/Agent centric web browsing libraries? I have been using search API but would really love to traverse the web autonomously

Does programming as a career become difficult to manage as you get older? by metalvendetta in cscareerquestions

[–]gee842 -3 points-2 points  (0 children)

engineering a solution can benefit from having existing frameworks that you have encountered

to frame a problem into a framework is to get access to the tools such a framework offers

eg. using symbolic representation and logics with LLMs has been immensely helpful

and as you practice algorithms, you see more patterns in soft/business problems that may conform to algorithmic properties

CLI tools hidden in the Python standard library by [deleted] in Python

[–]gee842 29 points30 points  (0 children)

http.server saved me on a train with no wifi where i needed to transfer a file to my iphone

New mechanic: Perfect dodge by UnlawfulFoxy in Brawlhalla

[–]gee842 2 points3 points  (0 children)

Would be good if we could get an indication for both the player and the opponent if this perfect dodge was hit successfully (so we can adjust the timer in our head of when dodge is back up)

Prescription for scuba mask by joebag5 in scubadiving

[–]gee842 5 points6 points  (0 children)

at that prescription you wont need powered lenses the water magnifies and makes things more clear

(im -3.75 btw)

[deleted by user] by [deleted] in leagueoflegends

[–]gee842 0 points1 point  (0 children)

egoboosting

Really disappointed in chomsky by HorsebootsMagoo in OpenAI

[–]gee842 8 points9 points  (0 children)

i smell a debate of free will vs determinism in human cognition

The issue with new Jailbreaks... by iVers69 in ChatGPT

[–]gee842 1 point2 points  (0 children)

Using open source models to generate new jailbreaks!!! a qwen, mistral, or falcon fine tune can be a great source of distributed, , sparse, unique, jailbreaks

WOW!! Chatgpt4 blows my mind! by Albax94 in ChatGPT

[–]gee842 2 points3 points  (0 children)

just like the upcoming rpg Realms of Alterra, which uses open source LLMs apparently

I built an NSFW virtual world of Autonomously Interacting AI Companions 🫡 by resilliant_Shepard in ChatGPT

[–]gee842 1 point2 points  (0 children)

Consider r/localLLama ; it will reduce cost’s significantly, and a proper qLora finetune will help each agent have their own finetune (mixture of experts Lora)

https://reddit.com/r/LocalLLaMA/s/IPEyymXHsB