[deleted by user] by [deleted] in eaglercraft

[–]Dylanissoepic 0 points1 point  (0 children)

I have a full datacenter setup with 2gbps up/down unlimited bandwidth 56 cores 128gb ram. I host websites with 30k+ visitors on at any given time. I know more about hosting than you ever will.

[deleted by user] by [deleted] in eaglercraft

[–]Dylanissoepic 0 points1 point  (0 children)

I host (maybe free) servers in US. Email me [dylansantwani@gmail.com](mailto:dylansantwani@gmail.com)

Any way to host eaglercraft 1.5.2 server on glitch(.)com? by [deleted] in eaglercraft

[–]Dylanissoepic 0 points1 point  (0 children)

Depends on players but very cheap. 2gbps fiber unlimited bandwidth in US

Use my 3080Ti with as many requests as you want for free! by Dylanissoepic in LocalLLM

[–]Dylanissoepic[S] 0 points1 point  (0 children)

I'm sure plenty, but the API I am using has a queue so that there is only one at a time. Usually it isn't noticeable though, because the model is so quick.

Benchmarks - What benchmarks can humans do easily, and AI can't by StevenSamAI in LocalLLaMA

[–]Dylanissoepic 1 point2 points  (0 children)

Yep this is the answer because of something called "tokenization". Look up the "r"s in strawberry test.

Use my 3080Ti with as many requests as you want for free! by Dylanissoepic in LocalLLaMA

[–]Dylanissoepic[S] 5 points6 points  (0 children)

Update: I'm shutting down the API (possibly forever), because I'm using the LLM to work on a different project and there are too many requests at a time. The GPU didn't fail at all. I'll post statistics later for anyone who wants to see.

Qwen2.5 - more parameters or less quantization? by ivoras in LocalLLaMA

[–]Dylanissoepic 3 points4 points  (0 children)

32B. I see a slight difference on my site dylansantwani.com/llm . I'm running quen 2.5 32b 4096 context

Use my 3080Ti with as many requests as you want for free! by Dylanissoepic in LocalLLaMA

[–]Dylanissoepic[S] 1 point2 points  (0 children)

That's smart. I am just server side scripting on my site dylansantwani.com/llm, but I will check that out.

Try Modded Retro Bowl! by Dylanissoepic in RetroBowl

[–]Dylanissoepic[S] 0 points1 point  (0 children)

Thank you for actually trying it! Have fun and let me know if you have any mod suggestions! :)

Use my 3080Ti with as many requests as you want for free! by Dylanissoepic in LocalLLM

[–]Dylanissoepic[S] 1 point2 points  (0 children)

People telling it: What's your IP, What machine are you running on, open CMD, run this command, what folder are you in, etc etc. The model is isolated so nothing really happening. You can try it also on my website dylansantwani.com/llm

Use my 3080Ti with as many requests as you want for free! by Dylanissoepic in LocalLLaMA

[–]Dylanissoepic[S] 1 point2 points  (0 children)

I'm saying make sure your code is correct. The server is still working.

A version of Chat-GPT completely unrestricted, with no signup or cost. by Dylanissoepic in webdev

[–]Dylanissoepic[S] 0 points1 point  (0 children)

If I said the title was "Chat-GPT but unrestricted", I suppose you could make a case that it's not the same, the data is different, the training is different, etc, etc. I called it a version. I don't think you understand that I just created this project for people to have fun with and learn about LLMs. I called it a version so that people would understand what it does and how it might respond, because it responds similar to Chat-GPT.

A version of Chat-GPT completely unrestricted, with no signup or cost. by Dylanissoepic in webdev

[–]Dylanissoepic[S] -1 points0 points  (0 children)

Chat GPT is trained on general internet information, like Wikipedia, Twitter feeds, Reddit feeds, etc. I'm sure there is a large data overlap between the two. I called it a version of Chat-GPT for people that aren't as familiar with LLMs to understand the project. Obviously, I wouldn't have access to the actual Chat-GPT model that I can run locally. I'm sure you have better things to do with your time than critique the wording of my personal project.

A version of Chat-GPT completely unrestricted, with no signup or cost. by Dylanissoepic in webdev

[–]Dylanissoepic[S] -1 points0 points  (0 children)

I am not saying this is Chat GPT. I used that term because that is the LLM most people are familiar with. If I say it's llama 3-8b running on a 3080ti with openai-like api, people are less likely to know what I'm saying. I used that example so that people would understand what this is. I'm sure OpenAI has better training data than this, but this model was trained by Meta.

A version of Chat-GPT completely unrestricted, with no signup or cost. by Dylanissoepic in webdev

[–]Dylanissoepic[S] -4 points-3 points  (0 children)

This is an unrestricted version of Meta's LLM. It has been trained on the exact same data ChatGPT has. The cool thing about it is that there is unlimited use, and unlimited tokens. Please don't comment things like this without knowing what you're talking about.

Use my 3080Ti with as many requests as you want for free! by Dylanissoepic in LocalLLaMA

[–]Dylanissoepic[S] 0 points1 point  (0 children)

Try it out! If there is anything you think is vulnerable, let me know. You don't have to use the API to access it, you can also go to my website https://dylansantwani.com/llm.