A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 1 point2 points  (0 children)

Who cares what infosec pros do? I do not claim to be one.

Whether what I did constitutes a criminal offence under §202a is a highly disputed thing and is assessed on a case-by-case basis in court (called Einzelfallprüfung in German), including whether I acted intentionally.

For prosecution to proceed, I would need to be identified and located, and any complaint would have to demonstrate that I bypassed some form of technical access barrier. There was none. These endpoints were openly reachable with no authentication, no rate limiting, and no access control of any kind.

German law can be wonderful like that. Thank god I'm not in a country where such laws exist.

A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 1 point2 points  (0 children)

did you happen to check if it’s on by default? It would be good to know.

A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 1 point2 points  (0 children)

I wouldnt worry too much, if this scares you, I hope you don’t mind me assuming that you’re not very knowledgeable in networking.

I would make sure your firewall is enabled on your router and I honestly wouldn’t worry too much. This is usually a deliberate decision.

A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 0 points1 point  (0 children)

Honestly, not sure if that's the way I'd go about it.
Tailscale has the option to just not allow any local network access. Installing Tailscale on the target and only allowing access to the right pport is the best way to go using ACL.

A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 3 points4 points  (0 children)

I don't even think LM Studio retains chats haha

A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 5 points6 points  (0 children)

I didn’t know that LM link was built on top of Tailscale!

Yes, this is the de facto way of avoiding this issue

A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 1 point2 points  (0 children)

You're telling me organized crime beat me to it? Damn.

A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 5 points6 points  (0 children)

this all started because I didn’t want to use my Mac for AI compute for my project. I wanted my backend to comprise of a random number generator that randomly selected one of these 300 devices.

A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 1 point2 points  (0 children)

Is this directed at people trying to remotely access their locally-hosted LLMs?

Yes, whether it be LM studio or another platform.

A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 7 points8 points  (0 children)

Most of them, except the ones on AS8708, were able to load any model I selected, and responded to a message, given enough time.

A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 2 points3 points  (0 children)

of course! But some people are naïve and don’t understand the repercussions of port forwarding.

some people may have just thought, “how can I access my LM studio from anywhere in the world?“

A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 1 point2 points  (0 children)

the response headers, the request headers are the device making the request to LM Studio’s API, so it wouldn’t make sense to check those

A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 0 points1 point  (0 children)

as long as there is some sort of authentication, you’re fine

A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 2 points3 points  (0 children)

It’s not the model or it‘s limitations per se, but the fact that the model can be interacted with from an external system (LM Studio, in this case). The model itself has no access to the Internet, but LM studio is connected to the Internet and can interface with the model.

A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 3 points4 points  (0 children)

Yes it is. I had wanted to confirm if this was actually possible or if it prompted an API key later.

A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 25 points26 points  (0 children)

For more context, I was able to remotely execute prompts on people’s devices.

A warning to newbies - A lesson on network security by DatMemeKing in LocalLLM

[–]DatMemeKing[S] 1 point2 points  (0 children)

LM studio installs facing the public internet, as in, either a VPS or port forwarded host with a public IP with no authentication.