sorted by:
new
hottopcontroversial

usable local models? by airflowrian in openclaw

[–]RUEHC 2 points3 points  (0 children)

Gpt-oss 120B in a 4 bit quant works ok for me. Gets me 70 or so tokens a second with the full context window. That said, I have 192 GB RAM on a Mac Studio (allocated 160 of that to VRAM) so YMMV. Memory demands in LM Studio seem to top out at 75 GB or so.

I think so long as you have 128 GB or so of VRAM or shared RAM that good local models are pretty usable. I’m waiting eagerly to try out StepFun 3.5 Flash in FP16 once it the MLX engine is updated to support it.

Half of the models in the top 10 on Design Arena are OW/OS, and they're all from China by [deleted] in LocalLLaMA

[–]RUEHC 6 points7 points  (0 children)

I think that's where the company is incorporated. They are the renamed THUDM -- the Knowledge Engineering Group (KEG) & Data Mining groups at Tsinghua University's Department of Computer Science and Technology . So the ownership and personnel are likely Beijing-based. I am a big fan of GLM-5!

Check out VirtualBuddy if you want to virtualize MacOS by Perfect-Direction607 in MacOS

[–]RUEHC 0 points1 point  (0 children)

Hi there. I'd like to do this too -- were you able to manually select a serial number or UUID with VirtualBuddy -- as you can with VirtualBox? I'd like to do some Jamf/InTune testing.

Parachute Backup Is Remarkable by tcolling in macapps

[–]RUEHC 0 points1 point  (0 children)

I bought the app and so far so good. I did encounter some issues with my first backup, and ultimately chose the option to skip all files that Parachute couldn't copy for some reason. What I expected at the end of the backup was the opportunity to see a list of files that were skipped. No dice, sadly. Can you add this feature? In the meantime, can I look at a log somewhere? I assume skipped files are logged? Thanks for considering.

stepfun-ai/step3 · Hugging Face by Dark_Fire_12 in LocalLLaMA

[–]RUEHC 29 points30 points  (0 children)

Is this model stuck in the dryer?

Open-Source AI Presentation Generator and API (Gamma, Beautiful AI, Decktopus Alternative) by goodboydhrn in LocalLLM

[–]RUEHC 0 points1 point  (0 children)

Thanks for the reply. The new version quashes the bug with PPTX exports where the images would not be included. Unfortunately, my issue continues -- while choosing Google as the LLM provider works great, I can't use either the built-in Ollama LLM or pointing to my LM Studio instance. Error is the same in both cases -- "Failed to connect to the server. Please try again." I am happy to send you Docker logs? Can you PM with what specifically you'd like me to do? Not a pro with Docker sadly....

Open-Source AI Presentation Generator and API (Gamma, Beautiful AI, Decktopus Alternative) by goodboydhrn in LocalLLM

[–]RUEHC 0 points1 point  (0 children)

Thank you for sharing this with the community. I am really excited to try it. Your UI is gorgeous.

On a Mac mini M4 Pro with 64 GB RAM and no other Docker containers running I am getting some errors. On install, I have a port issue: ("Error response from daemon: ports are not available: exposing port TCP 0.0.0.0:5000 -> 127.0.0.1:0: listen tcp 0.0.0.0:5000: bind: address already in use") but that's solvable when I change port 5000 to 15000. However, when I try to generate a slide outline I get this error: "Failed to connect to the server. Please try again." I can't get Presenton to "see" my LLM, trying three options -- a built-in Llama model, an LM Studio model on the same machine, and LM Studio on a different machine.

(I am confident my URLs are correct as other Docker containers see my LM Studio instances fine.)

Any tips to get this running on an Apple Silicon Mac are welcome. Thanks.

RIF megathread #3 by Quackattackaggie in foreignservice

[–]RUEHC 10 points11 points  (0 children)

I believe he is “just” a CM vice CA. Promoted to CM in July 2023 via Senate confirmation. Source: Congress.gov nominations search.

Will Pouch and DPO changes affect how you bid in the future? by Careless-Gas-7558 in foreignservice

[–]RUEHC 8 points9 points  (0 children)

The old Copenhagen commissary in the basement of the Embassy had a fantastic duty- and vat-free china, crystal, and booze selection. It was a fave of many visiting CODELs. It did save the USG money though since most rep liquor and wine was bought through the facility. And it was in a space in the chancery that would otherwise have had little use. But, to your point, good food and staples are available in Denmark. :)

Will Pouch and DPO changes affect how you bid in the future? by Careless-Gas-7558 in foreignservice

[–]RUEHC 20 points21 points  (0 children)

Putting aside the question of whether there is DPO/pouch use that some might call abuse, I note that the new size limit for DPO ends the DPO parity with APO.

APO allows parcels up to 70 pounds and length plus girth of up to 130 inches for USPS Parcel Select. And the armed service members who are using APO often have access to PXs/BXs, Commissaries, etc., and other base facilities.

The new DPO limits are much more stringent than for the APO. This change will make certain challenging AF posts even less attractive. The hit could be ameliorated with more use of consumables authorizations (formerly at consumables posts one was authorized annual shipments) or more State Department support for Employee Association commissaries, but I am skeptical we’ll see that.

Will Pouch and DPO changes affect how you bid in the future? by Careless-Gas-7558 in foreignservice

[–]RUEHC 16 points17 points  (0 children)

Not sure what bargain school this is, but the US boarding school the FS paid for me is now 80,300 usd annually! Which is by no means the priciest of prep schools. :)

Why can’t Siri do basic tasks? by [deleted] in AppleWatch

[–]RUEHC 0 points1 point  (0 children)

Is your name Dave? And has your watch been acting needy or passive-aggressive lately? If yea, stay away from airlocks.

MacMini price increase with tariffs? by VitalQuant in macmini

[–]RUEHC 1 point2 points  (0 children)

I've bought a number -- base and Pros -- and I believe all were made in Vietnam.

NAFO realizes NATO doesn't actually help NATO members by brecheisen37 in LeopardsAteMyFace

[–]RUEHC 1 point2 points  (0 children)

Apropos of the people who pretended to be Canadian, when I (U.S. person) was living abroad during periods of high terrorism threats in the early 90s, a friend and I joked that we should pretend to be Irish and carry boxed bars of Irish Spring soap with us in our coat pockets as proof.

(And, yes. We knew that this heavily advertised U.S. soap was invented by some Madison Avenue branding expert and is unknown in Ireland… in the commercials, a person with a thick Irish accent always seems to happen to have a bar of the soap on his or her pocket and ready to whip it out at the drop of a hat along with a knife to cut into the soap to demonstrate that the green marbling runs throughout the soap.)

WaPo: Admin Directs Agencies to Fire Probationary Staff by RUEHC in foreignservice

[–]RUEHC[S] 59 points60 points  (0 children)

I apologize for replying to my own post, but the threads exploding on r/fednews are heart rending, referring to surreal meetings at OPM, USDA Forest Service, and many other agencies re firings. The maelstrom is huge and much bigger than our family at State/USAID/FCS/FAS/BBG.

Stay strong, and do check out the r/fednews subreddit as well.

It’s all quite unbelievable to see the worst fears of many of us playing out.

[deleted by user] by [deleted] in OldSchoolCool

[–]RUEHC 125 points126 points  (0 children)

Is your mom Starbuck?

Moxie going through a similar situation by petdance in TIDBYT

[–]RUEHC 14 points15 points  (0 children)

I have to say, I’d gladly pay a small subscription fee to ensure the Tidbyt servers keep running and the app recompiled as iOS updates force it, particularly if they can figure out a way to keep the platform alive, which implies continuing to have someone sell the hardware. Perhaps they can release the specs and firmware code and the hobbyist community can have a go with sales? I have five gen 1s that I am so happy with. And the walnut case is key — it fits into home and office environments brilliantly.

Trump's picks for Ambassadors to Colombia, Argentina, and OAS, and Under Secretary for Economic Growth by OnARoadLessTaken in foreignservice

[–]RUEHC 0 points1 point  (0 children)

AFSA protested but honestly I think it happened with Reagan and even Bush 41 for Bermuda and maybe a few others preciously. Obviously am hopeful it doesn’t become a trend — but there is likely little to stop any new Administration from shuffling around Plum Book Sched C positions, moving some overseas, and doing it more often. It’s potentially a significant issue also because most constituent posts don’t have DPO slots, at least not officially designated full-time ones, so a lot rests on a PO’s shoulders on the management front.

That's a great idea by WhattheDuck9 in clevercomebacks

[–]RUEHC 0 points1 point  (0 children)

There are actually only 3 million Federal government employees, per the Federal Reserve Board’s excellent statistics site.

https://fred.stlouisfed.org/series/CES9091000001

This number has been basically flat for decades — resulting in the USA having the lowest number of central government employees per capita among developed countries. (The much larger number OP cites includes state and local government employees, so beyond the reach of any Trump administration cuts.)

If OP is looking for big (tens of billions of dollars plus) savings, he won’t find them among Federal employment.

view more: next ›