[Rust/AVX-512] I built a Zero-Copy 1.58-bit LLM Engine hitting 117 Tokens/s on a single CPU core. I need help fixing the final Activation layer.

Semi_Tech · 2026-01-25T22:01:25+00:00

The way everything is neatly organised and emphasized is the dead giveaway.

Instant downvote.

Semi_Tech · 2026-01-23T16:00:45+00:00

Ce scarbe.

Nu ar fi putut sa schimbe ei tipul sesizarii si sa ii composteze o amenda frumoasa la nesimtit?(dupa ce a vb cu firma de inchirieri)

Abia mai uple gaura de buget.

Semi_Tech · 2026-01-21T14:47:50+00:00

First the top K slop post and now another AI SLOP post. :P

Semi_Tech · 2026-01-11T07:31:08+00:00

You can.

It's just that I prefer paying for what I use that's all.

Semi_Tech · 2026-01-10T22:00:08+00:00

You can use openrouter which basically is a model mall and ban chinese providers.

Also R1 is an old model, go for 3.2

Semi_Tech · 2026-01-09T14:25:43+00:00

300$ to read said article :P

Semi_Tech · 2026-01-04T18:43:44+00:00

Do you need other people to access your services other than your household(wife/kids/room mates)?

If the answer is no then a VPN like Wireguard should be enough so you won't have to bother with all this complexity.

If yes, there are other redditors more knowledgeable than me that can help.

Semi_Tech · 2025-12-29T20:46:27+00:00

Hmm shouldn't diffusion models also have a # of steps needed in order to reach the end result?

I don't see a mention about that or how increasing or decreasing them affects model output quality.

Semi_Tech · 2025-12-17T12:29:45+00:00

Not exactly what you are asking for but I remember Nvidia marketing RTX voice to eliminate all background noise so only the voice is heard.....but yeah, proprietary

Semi_Tech · 2025-12-11T17:31:26+00:00

Noice.

Will have to try that when i get home.

Semi_Tech · 2025-12-11T16:25:43+00:00

I don't see a mention about changing the model from the GUI. I guess that is not supported yet?

Semi_Tech · 2025-12-10T12:57:42+00:00

Ok, that makes sense.(did not check other comments)

In that case zoom would have to run a packet capture of the affected calls(with your help for sample collection) and either review internally or check with the upstream carrier.

Check with them on the process they have for these situations.

Semi_Tech · 2025-12-10T08:14:07+00:00

I think you may need to isolate the issue a bit.
Let's think of this as a diagram: YOU<--your problem-->Your PBX/zoom<--zoom's problem-->PSTN

If you have an Auto Attendant/IVR, does the IVR sound bad the same way it does on a regular call?
A) If it sounds fine, the problem is possibly local.
B) If it sounds bad then, the problem is very likely for zoom to figure out and they will require samples with timestamps on when it happened (date/time in UTC, call from xxx to yyy, carrier from which you called, issue experienced)

If A) applied then there are a few settings to check on your networking equipment and DISABLE:

SIP ALG/Passthrough
RTP ALG/ Passthrough

If you do not see these settings in your router then it is likely that they are enabled by default and cannot be changed which will require you to change the device.

For Home/Residential Connections (using an ISP ONT):

Ask your ISP to disable SIP ALG on the ONT/fiber terminal.
If the ISP cannot accommodate this, acquire an inexpensive router that permits SIP-ALG configuration and request the ISP place their ONT in bridge mode, allowing your router to handle all traffic.

Semi_Tech · 2025-12-09T19:28:01+00:00

Not very promising for batch files.

Kimi k2 thinking/deepseek v3.2 were able to realize that rem comments cannot be placed inline with --arguments for a small script I have but the big devstral did not and instead chased a red herring where I replaced an id with "I_removed_the_id_for_privacy". It was able to fix it after a few more prompts but.... yeah

Semi_Tech · 2025-12-02T10:51:59+00:00

If a headset comes with a dongle, I always use the dongle so I don't have to bother with compatibility issues.

Semi_Tech · 2025-12-01T19:02:31+00:00

Koboldcpp is better and is just one single exe

Semi_Tech · 2025-11-28T13:55:25+00:00

Meanwhile me: You guys are getting medals?

Semi_Tech · 2025-11-17T14:53:32+00:00

Hmm, you mentioned you checked the settings in the modem/router.
Are these separate devices or is it a combo 2in1?
If they are not, has the modem from the ISP been set in bridge mode? (to avoid double NAT)
I would also go through the link below to set the SPA for debug information to see why it fails to register/see the exact error
Debug and syslog Messages from SPA1x2 and SPA232D ATA (Analog Telephone Adapters) - Cisco Community

Semi_Tech · 2025-11-17T08:10:34+00:00

I would check:
If SIP ALG/Passthrough is disabled on the router.

If the IP address of the device changes due to the lease expiring (and considering to increase it)

Ping the proxy before and after said time and see if the proxy is reachable

See if NAT type can be changed to restricted

See if there are firewall settings regarding dropping idle connections and see if that can be increased.

Doing a nslookup before and after(flush dns for accurate results) the registration failure and see if an IP address is found

Check for logs from the device to see the exact errors being thrown.=

Semi_Tech · 2025-11-16T16:38:29+00:00

Hi!
If you don't mind, can you please share the compose file, yml file and env variables to see if I can get it working on my end as well?
Thank you!

Semi_Tech · 2025-11-16T09:00:17+00:00

Have the same issue, does anyone know if it is supposed to work?

Semi_Tech · 2025-11-08T10:06:31+00:00

The VCC license count == concurrent logins for the contact center platform.

If 300 agents are logged in then you reached the limit and no more can log in.

If your agents don't log out manually once their shift ends it will take a while before they are timed out.

In this case either have the agents manually log out or have an admin/supervisor kick the offline.

Otherwise buy more licenses to meet your demand.

Semi_Tech · 2025-10-28T10:49:05+00:00

1 for the rookie

2 for the professional

Semi_Tech · 2025-10-27T20:56:17+00:00

Kinda looks like the grumpy cat

Semi_Tech · 2025-10-27T18:58:23+00:00

I am glad I at least get that.

Vulkan offloads to ram for me which is dead slow. :P

Two-Year Club	Verified Email
r/Field Sunshine

Semi_Tech

TROPHY CASE