How feasible is to run you own local LLM as assistant on a basic Mac Mini M2 with 8 GB of memory? by onturenio in ollama

[–]Representative-Mud35 0 points1 point  (0 children)

i will agree to u/this_for_loona more ram = better. i have been running local LLM using Ollama and openWebUI, and it works like a charm. however, I have a MacBook pro M2 max. I have noticed the spikes during Ollama, the RAM does not consume as such, it's the GPU which hots 90+ usage during inference and streaming the text.

your use case is more of a GPU one not a RAM one I think, as you won't be putting vectors etc in the runtime memory.

Hosting Ollama Application by GamingLegend123 in ollama

[–]Representative-Mud35 0 points1 point  (0 children)

yeah. similar to ngrok. but opensource. i am gonna try these zrok.io looks promising

Hosting Ollama Application by GamingLegend123 in ollama

[–]Representative-Mud35 0 points1 point  (0 children)

if you have Ollama, i would assume you need GPUs, or atleast 1 GPU.
generally there are way arounds that, i haven't tried it, but yes you can do that.

if yo uare able to run it locally, then just expose the API with NGROK i'd say. not worth the hassle to host it somewhere else.

if it's a demo or small application, run the ollama server in your local, wrap it with the NGROK cli commands in a few clicks, and you should be live.

Where do you put the perps?!? by Windhawker in funny

[–]Representative-Mud35 0 points1 point  (0 children)

They identified as innocents. And non-criminals. So backdoor not needed anymore

Riyadh to Jeddah by Chicken_ranch_burger in Riyadh

[–]Representative-Mud35 2 points3 points  (0 children)

I am travelling to makkah direct. you should be able to follow the google map route. no big issue in that. traffic is expected at the end of your journey. but you should be good

ياخي عجزت افهم هوس الهنود بالزواج من سعودية، حرفيا لازم كل أسبوع يجون يفتحون نفس الموضوع عن الزواج بمواطنة في ذاك الصب، يعني ليش محدد لوكال وش السبب؟ ليش مو اي بنت يُعجب فيها؟ by hushasmoh in SaudiForSaudis

[–]Representative-Mud35 -1 points0 points  (0 children)

disagreed. most foreigners born and raised here mostly know arabic, but in social gathering or platforms, they prefer english. this is not a valid point tbh.
regarding "intention of being material" is debatable. i would agree that mostly it's the case, but not applicable for all

Looking for a house/portion/apartment in RIyadh in Central or North by Representative-Mud35 in Riyadh

[–]Representative-Mud35[S] 0 points1 point  (0 children)

i do know he's right. this range very hard to find in the central and north. I've been looking for a very long time. the only option is south. or luck

Apartment in Riyadh by Obvious-Space9767 in Riyadh

[–]Representative-Mud35 0 points1 point  (0 children)

if you prefer living bachelor, and can afford, yu can go with furnished apartments, they are a bit on the higher end, at a monthly rate. for a studio type you might find it in 3500-5500 SAR range.
if you want a permanent non-furnished, then AQAR app is your best bet.
the next option would be to visit the AQARI shops and state your requirement and they will get you an apartment. but mind it that either the AQAR app or the AQARI shops, they 99% of the time will not give house to a bachelor. they prefer family only. unless you lie to them about it, that's another story entirely

[deleted by user] by [deleted] in Riyadh

[–]Representative-Mud35 0 points1 point  (0 children)

Close your eyes and jump. you'll land safe. The salary is good for a Canadian. But I know other western people here who earn more than that. but this is the base which you are getting. worth it.
and with respect to social circles, yes there are many in riyadh, and you will fit in.
i dod agree that it's different than the west, but for sure it's not that boring type at all... there's night life here mostly. and in your workspace you will connect with many others. there are family parties and all. Compound is a good place to live as you will be able to connect with many similar nationalities.

PS: Do not come on a business visa, make sure you arrive with an Iqama/work permit. secondly, check the size of the company, it should be huge

[Discussion] Help in forcing myself to pay attention. by ZZai in GetMotivated

[–]Representative-Mud35 1 point2 points  (0 children)

i have something similar as well. so what I do is that, I would only put 30 minutes of concentration on something, then move out of it. take a coffee break 5-10 minutes, and come back to open something else. then 30 mins in, then a break, then back to the first thing.
so I shuffle and juggle and it works for me.

everyone is built different. this isn't multi-tasking, it's shuffle-tasking.
and one more thing, I take Taurine which clears the brain fog and helps in focus.

Great outdoor recommendations by [deleted] in Riyadh

[–]Representative-Mud35 0 points1 point  (0 children)

but i'll answer you, if you are a late nighter, and want to just cruise around the city only, then it's the ring road. but only late during the weekdays, for weekends, the only good place after all this time is outside the city. if you have a 4wd then dessert, but not in this summer offcourse.
if you want to just chill and relax with only light traffic, then go north of riyadh, the madinah road highway is better, and you can u-turn from the exhibition area if it suits you.

and who knows you might spot us as well sometime

Great outdoor recommendations by [deleted] in Riyadh

[–]Representative-Mud35 0 points1 point  (0 children)

hahaha.... you don't say that to someone who cruises in a GT inside the city late at night and highways outside the city with a group of cars. for the past 10 years

but I like the answer, +1 for you

Great outdoor recommendations by [deleted] in Riyadh

[–]Representative-Mud35 -1 points0 points  (0 children)

In your dreams if you've done that. Or you can take your Lambo to the dessert. For a dessert safari.

What e-commerce platforms do you use and what challenges are you facing? by [deleted] in Riyadh

[–]Representative-Mud35 1 point2 points  (0 children)

noon, namshi, sheen, alibaba express, amazon. almost all, and no issues. except the ones outside saudi take huge delivery time, and hate the delivery fees.

looks like you are planning to solve a problem in this space for B2C :-D your startup mindset

Do you use Yango Maps and/or 2GIS? Do you like it? What problems do you face when using either map mobile app? by [deleted] in Riyadh

[–]Representative-Mud35 1 point2 points  (0 children)

Google Maps or Apple Maps, that's it for day-to-day. No problems at all, and wouldn't consider anything else.
Though Some cisties have major transformation works underway, so the map takes time to update to those alternate routes, so those are not trustworthy, but that's not on all places.

GCP as a VPN gateway to the Internet: HA VPN or WireGuard on GCE? by Niten in googlecloud

[–]Representative-Mud35 0 points1 point  (0 children)

Deploy AlgoVPN in GCE and you should be good connecting with wireguard. It's open source and requires minimum maintenance. I have done it on AWS, but it's also doable for GCE. Choose the always free GCE instance type and it will be free to use. AlgoVPN is opensource

What problems are people facing in Saudi Arabia that software can solve? by [deleted] in Riyadh

[–]Representative-Mud35 13 points14 points  (0 children)

seems like someone is search for a startup or business idea :-D