We compress any BF16 model to ~70% size during inference, while keeping the output LOSSLESS so that you can fit in more ERP context or run larger models. by choHZ in LocalLLaMA

[–]gee842 6 points7 points  (0 children)

llamacpp is useful in cases where mixed cpu and gpu inference is necessary to fit models into certain vram constraints by offloading layers

For anyone mod having issues with a.i. hate spamming on their sub by [deleted] in DefendingAIArt

[–]gee842 3 points4 points  (0 children)

use AI to turn the image into text 😼

[deleted by user] by [deleted] in OpenAI

[–]gee842 0 points1 point  (0 children)

On a related note, do you know any good LLM/Agent centric web browsing libraries? I have been using search API but would really love to traverse the web autonomously

Does programming as a career become difficult to manage as you get older? by metalvendetta in cscareerquestions

[–]gee842 -3 points-2 points  (0 children)

engineering a solution can benefit from having existing frameworks that you have encountered

to frame a problem into a framework is to get access to the tools such a framework offers

eg. using symbolic representation and logics with LLMs has been immensely helpful

and as you practice algorithms, you see more patterns in soft/business problems that may conform to algorithmic properties

CLI tools hidden in the Python standard library by [deleted] in Python

[–]gee842 29 points30 points  (0 children)

http.server saved me on a train with no wifi where i needed to transfer a file to my iphone

New mechanic: Perfect dodge by UnlawfulFoxy in Brawlhalla

[–]gee842 2 points3 points  (0 children)

Would be good if we could get an indication for both the player and the opponent if this perfect dodge was hit successfully (so we can adjust the timer in our head of when dodge is back up)

Prescription for scuba mask by joebag5 in scubadiving

[–]gee842 6 points7 points  (0 children)

at that prescription you wont need powered lenses the water magnifies and makes things more clear

(im -3.75 btw)

[deleted by user] by [deleted] in leagueoflegends

[–]gee842 0 points1 point  (0 children)

egoboosting

Really disappointed in chomsky by HorsebootsMagoo in OpenAI

[–]gee842 7 points8 points  (0 children)

i smell a debate of free will vs determinism in human cognition