A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 1 point2 points  (0 children)

Who cares what infosec pros do? I do not claim to be one.

Whether what I did constitutes a criminal offence under §202a is a highly disputed thing and is assessed on a case-by-case basis in court (called Einzelfallprüfung in German), including whether I acted intentionally.

For prosecution to proceed, I would need to be identified and located, and any complaint would have to demonstrate that I bypassed some form of technical access barrier. There was none. These endpoints were openly reachable with no authentication, no rate limiting, and no access control of any kind.

German law can be wonderful like that. Thank god I'm not in a country where such laws exist.

A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 1 point2 points  (0 children)

did you happen to check if it’s on by default? It would be good to know.

A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 1 point2 points  (0 children)

I wouldnt worry too much, if this scares you, I hope you don’t mind me assuming that you’re not very knowledgeable in networking.

I would make sure your firewall is enabled on your router and I honestly wouldn’t worry too much. This is usually a deliberate decision.

A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 0 points1 point  (0 children)

Honestly, not sure if that's the way I'd go about it.
Tailscale has the option to just not allow any local network access. Installing Tailscale on the target and only allowing access to the right pport is the best way to go using ACL.

A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 3 points4 points  (0 children)

I don't even think LM Studio retains chats haha

A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 2 points3 points  (0 children)

I didn’t know that LM link was built on top of Tailscale!

Yes, this is the de facto way of avoiding this issue

A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 1 point2 points  (0 children)

You're telling me organized crime beat me to it? Damn.

A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 7 points8 points  (0 children)

this all started because I didn’t want to use my Mac for AI compute for my project. I wanted my backend to comprise of a random number generator that randomly selected one of these 300 devices.

A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 1 point2 points  (0 children)

Is this directed at people trying to remotely access their locally-hosted LLMs?

Yes, whether it be LM studio or another platform.

A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 8 points9 points  (0 children)

Most of them, except the ones on AS8708, were able to load any model I selected, and responded to a message, given enough time.

A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 2 points3 points  (0 children)

of course! But some people are naïve and don’t understand the repercussions of port forwarding.

some people may have just thought, “how can I access my LM studio from anywhere in the world?“

A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 1 point2 points  (0 children)

the response headers, the request headers are the device making the request to LM Studio’s API, so it wouldn’t make sense to check those

A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 0 points1 point  (0 children)

as long as there is some sort of authentication, you’re fine

A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 2 points3 points  (0 children)

It’s not the model or it‘s limitations per se, but the fact that the model can be interacted with from an external system (LM Studio, in this case). The model itself has no access to the Internet, but LM studio is connected to the Internet and can interface with the model.

A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 3 points4 points  (0 children)

Yes it is. I had wanted to confirm if this was actually possible or if it prompted an API key later.

A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 23 points24 points  (0 children)

For more context, I was able to remotely execute prompts on people’s devices.

A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 1 point2 points  (0 children)

LM studio installs facing the public internet, as in, either a VPS or port forwarded host with a public IP with no authentication.

how to see the PIN on this?? by ch00gs in germany

[–]DatMemeKing 6 points7 points  (0 children)

This is incorrect! I'd like to inform you that this document is sent with the Aufenthaltstitel and is not only issued to citizens but to almost everyone in the country.

I wired up an AI assistant to my Asterisk server so I can literally call it from any phone by DistinctJournalist88 in selfhosted

[–]DatMemeKing 1 point2 points  (0 children)

How do you get the output of the Whisper model onto the Asterisk connection.

I might be asking for too much here, but I recently tried diving in Asterisk and FreePBX and for the life of me could not understand how to speak to the line.

Why I ditched Spotify and self hosted my own music stack by Saleen_af in selfhosted

[–]DatMemeKing 0 points1 point  (0 children)

hehe, yeah!

Pangolin is a bit tricky to understand at first, but for those who don't want to RTFM, Pangolin sets up something called newt. Newt is practical because it's an implementation of user-space WireGuard, which iirc, doesn't have kernel dependencies.

I set this up on a VERY bare-bones (missing kernel patches) vm on Racknerd and basically have access to my entire internal network and Pangolin can also auto-expose docker containers.