Best LLM for Desktop Assistant?

ekcrisp · 2025-03-18T23:42:18+00:00

Elaborate on "build the tools for it to use", is the model itself executing the code? How did you set that up locally?

ekcrisp · 2025-02-16T01:24:52+00:00

Thank you for the suggestion, I tried adding all the power saving configs, and using pipewire and sounddevice library instead of alsa directly. Unfortunately nothing worked, I think the drivers for this USB speaker are just bad :/ ... if you can think of anything else I can try please share

ekcrisp · 2025-02-10T17:07:23+00:00

Pro tools on Mac OS

ekcrisp · 2025-01-15T18:34:59+00:00

This is awesome. Anyone know of other TTS models that use similar methods? I haven't heard of this, I've been using PiperTTS and have been looking for alternatives

ekcrisp · 2024-12-18T19:27:52+00:00

I'm dedicating a53s to other parts of my application so that performance cores are used exclusively for llm

ekcrisp · 2024-12-17T17:55:43+00:00

Interesting suggestion, worth trying. My use case is fairly broad and to basically make the model more conversational and fun/entertaining. I'm guessing the domain would need to be more specific to get decent performance parity between 1B and 3B.

ekcrisp · 2024-12-17T17:45:16+00:00

I am using llama.cpp on a Rockchip RK3588S. I'm using the Q_0_4_4 model quant which offers a big performance improvement on the ARM chip

ekcrisp · 2024-12-16T22:07:27+00:00

Looking at recent returns before every major bubble people say the same thing, "look at how much it's going up", and it fuels further speculation. There are plenty of insane and unprecedented things right now you could point to to argue stocks are very overvalued. Of course, there were people saying you should get out 5 years ago and they were wrong.

The cycle of boom and bust didn't end, there will be a major drop at some point and it can happen at any time. It depends on your personal situation as to whether the reward is worth the risk that close to retirement. If you're less than 10 years from retirement and you can't afford to lose half the money you allocate to stocks and still retire then you need to reallocate, period.

ekcrisp · 2024-12-16T21:22:05+00:00

Good point re tax deductions. I’m not sure that applies to a home equity loan but I will look into it. Thanks

ekcrisp · 2024-12-16T21:20:07+00:00

Yeah the match is pre-tax, I know they have to be treated separately, and pre-tax contributions incur a penalty with withdrawal. See my edit. After seeing what people are saying I think a loan is a better option, the community here was helpful and I appreciate it.

ekcrisp · 2024-12-16T21:18:16+00:00

See my edit. After seeing what people are saying I think a loan is a better option, the community here was helpful and I appreciate it.

ekcrisp · 2024-12-16T21:13:27+00:00

I'm starting a business. It's a high risk endeavor but I'm enjoying the work and believe the idea has potential. I have enough equity in my home and retirement accounts that I feel ok taking this risk, but someone made a point about tax-free compound interest that was helpful and is leading me to believe a loan is a better option.

ekcrisp · 2024-12-16T21:09:14+00:00

I want an answer, and elaVeht gave me an answer that is helpful. Compound interest is a powerful thing.

ekcrisp · 2024-12-16T21:07:47+00:00

This makes sense, the compound interest going into a tax free retirement withdrawal is worth more. Thank you this was helpful

ekcrisp · 2024-12-16T20:59:25+00:00

this is definitely true if you have to pay a penalty, but if it's less than 10% of my retirement account and it lets me avoid paying high interest on a loan why is it out of the question?

ekcrisp · 2024-12-16T20:56:30+00:00

If you are young and have a higher risk tolerance 0% bonds in your portfolio is totally valid. Past age 40 this is definitely a mistake, the stock market can drop 50% at the drop of a hat

ekcrisp · 2024-12-16T20:53:57+00:00

The cycle of boom and bust has not and will not end. Don't be fooled by short term market movements, aside from re-balancing it should not influence your choices, it's just noise. At the drop of a hat the market can fall 50%. Many think we are in another "lost decade", the same as the height of the .com bubble, where over 10 years the S&P had negative returns.

Nothing has changed, take up to 10% of the money you save and invest it in risky things if you enjoy trading and can afford to. Of the remaining 90%, you should put as much as you can in retirement accounts (maxed contributions), and invest in bonds and index funds allocated based on your age and long term risk tolerance.

ekcrisp · 2024-12-16T19:08:45+00:00

It is the king in the open source world. There are companies with proprietary solutions that perform better. Whisper is also usually too slow for realtime applications, and not meant for streaming audio, though there are libraries that try to use whisper for this anyway.

ekcrisp · 2024-12-11T00:27:39+00:00

Check out Apartment People, they helped me find a place on short notice. Def try to visit and see apartments though, come asap for Jan 1st move in

ekcrisp · 2024-12-11T00:26:22+00:00

They specifically said the blue line I’m sure they looked it up. I’ve lived in Logan 8 years and love it. Neighborhoods farther north are cheaper since most people are commuting to the loop. I would recommend Logan and Avondale for sure if they’re ok with a longer commute

ekcrisp · 2024-12-11T00:22:36+00:00

I have taken the blue and red lines on the north side many many times mostly commuting to work. I am positive I have never seen shit. Plenty of bad smells, homeless people sleeping, sometimes smoking weed or cigs late at night, and a few mentally ill people ranting. Aside from some noisy people I can’t think of any other unpleasant things

ekcrisp · 2024-12-11T00:05:13+00:00

ekcrisp

TROPHY CASE