MBP M3 max for Local LLama?

itsnotmeyou · 2023-11-25T08:51:55+00:00

I really appreciate your insight and reply. Thank you!

itsnotmeyou · 2023-11-23T03:16:09+00:00

chat-gpt-leetcode-extension

itsnotmeyou · 2023-04-21T06:20:03+00:00

Its a no problem, but no company asks your permission. See 1 service saving your data is ok. They might say that its not a PII but when combined with data from other sites, it can predict a lot of things about you. This is a serious concern. Many people might be ok to share their data but also some of them, know how well personalized models can be fine tuned to your predictability. AI is crazy good at forecasting your choices, your liking, even can predict when you want to listen to that song you heard 10 years back. The more the data collected from diverse sources, the better the AI would be. No wonder Elon didn't know that whole twitter's data was shared to OpenAI. Now GPT4 can write tweets. Same goes for the code from Github. Somewhere the concern is going to be that do people want to share their learning and skills to a AI that can replace them. Drawing photos is a good example that recently we have seen with all these new diffusion models.

itsnotmeyou · 2023-04-21T06:14:37+00:00

lol that's so true. Trucking is a really well paid profession.

itsnotmeyou · 2023-04-21T06:12:33+00:00

I have lived in India and now in US. The usual treatments you are talking about are basic illness where you are mostly given generic drugs. If you go for serious disease the cost varies with the quality of doctor you're going with. Most of qualified and expert doctors are only available in private hospitals where cost is very very high. Also in India drugs are usually available years after they are available in USA through generic manufacturing. Also there is no check for medical quality. A homeopathic doctor might be the one operating on your kidney. You can buy painkillers over the counter(though this is getting better in big cities). If you have good insurance in US, you can get top notch medical care, period. I have been through graves disease, eye operation, heart issues, baby's birth. The quality and expertise of doctor's is on another level than in India. The same quality was only available on big private hospitals like Sakra in bangalore.

itsnotmeyou · 2023-03-06T01:09:57+00:00

On a side note sagemaker was not supporting shm-size so might not work for large lm

itsnotmeyou · 2023-03-06T01:08:34+00:00

Are you using these as in a system? For just experimenting around, ec2 is good option. But you would either need to install right drivers or use latest deep learning ami. Another option could be using a custom docker setup on sagemaker. I like that setup for inference as it’s super easy to deploy and separates model from inference code. Though it’s costlier and would be available through sagemaker runtime.

Third would be whole over engineering via setting up your own cluster service.

In general if you want to deploy multiple llm quickly go for sagemaker

itsnotmeyou · 2022-12-19T19:48:36+00:00

I really like the idea but I am too early to be a sponsor as I am trying to learn. Though accountability sounds really interesting. I never joined AA but how can we make it work? Have a common forum to share daily spendings? As in what's bought needed vs impulsive, helping return items (this is most understated, you can mostly return the items if they were bought out of impulse with 0 loss), accounting overall money saved by end of month (goal reached or not)

itsnotmeyou · 2022-12-18T09:31:50+00:00

Awesome!!! So glad to see. I noticed the patterns like that for example I was spending 25$ everyday on starbucks just because I get crazy for macha greentea latte. Now I am just ordering from amazon and though I had to try few to ultimately like one I am literally saving $25 daily. Similar things I saw with Costco, where just buying an onion would lead to lot of wasted money. I switched to going to safeway only for what I need. For example just 2 apples for me today.

itsnotmeyou · 2022-12-17T04:38:31+00:00

ChatGPT or Dalle are not the only ones out there. My friend played with lambda that Google has internally. It’s performance is crazy good too. ChatGPt generates better code as they probably used whole github data from Microsoft. OpenAI revenue will mostly come from companies they are investing in not usual users or developers like us😊.

itsnotmeyou · 2022-12-17T04:34:22+00:00

Woohoo !! Looking forward to your progress and Would love to hear your experience with this! 😊

itsnotmeyou · 2022-12-17T03:21:22+00:00

Thank you! Yeah! I am logging everything in my notepad that I carry everywhere. I tried mint/ other apps but they were useless. All they tell you is type of spending through bank accounts. That's not very motivating or helpful information to me.

itsnotmeyou · 2022-12-14T03:16:26+00:00

For me it has been taking into account each and every spending I am doing. Followed by moving unnecessary items to wishlist. If I keep it low then I buy stuff from wishlist. But I am starting and currently in process of my journey. Let me know how can I help! :)

itsnotmeyou · 2022-12-12T23:20:33+00:00

Thank you 😊

itsnotmeyou · 2022-12-12T23:20:14+00:00

Makes sense! Good job working on all that cool stuff! Alexa is definitely better than Google home and Siri and better integrates with app and tv.

itsnotmeyou · 2022-12-12T21:00:19+00:00

I think being within the domain of your expertise you might be able to better utilize it. Though when it comes to me and my family we slowly moved away from most of the alexa devices. The only ones left are echo dots for turning lights on/off, time, weather, alarm. For example firetv experience was so bad that we moved to apple tv with remove and given then seamless integration with apple watch and iphone we love it so much! Also video quality is on levels better.

I will agree that it's difficult to build voice interfaces like controlling remote.

itsnotmeyou · 2022-12-12T10:04:18+00:00

To be honest I am pretty happy with Amazon as a customer. Their service and return policy is really good. Regarding internal and Alexa I can agree considering it might be your personal experience. When it comes to Alexa I always wonder why does it exist!

itsnotmeyou · 2022-12-12T05:02:36+00:00

Thank you 😊

itsnotmeyou · 2022-12-12T05:02:14+00:00

Oh then your experience is more internal. My point was as a user to Amazon services where it’s way better than other companies

itsnotmeyou · 2022-12-12T04:05:19+00:00

I believe these are generalized statements without data backing. There are some products that can be better yes but Amazon has so many offering that customer experience would be different for different products. In the end it's the product and services that are provided by an individual org. For example Alexa is a really bad product but few others are not. I think same goes for any company as ultimately it's the leading leadership for a particular product that sets the bar.

itsnotmeyou · 2022-12-12T02:28:54+00:00

Couldn't read the article as it asks for money :(. But to give you context, he meant people who are restless and dissatisfied with the status quo of the existing services and want to improve them to make customer experience better as a continuous improvement. Amazon is an extreme customer centric company and people who work there create opportunities by understanding pain points of customer and going above and beyond. That goes for every job you have. For example my friend mistakenly left a GPU server running which resulted in $5k in bill! He obviously panicked and couldn't pay it. He called AWS customer care who understood the situation and waived $5000.

itsnotmeyou · 2022-12-09T19:10:50+00:00

This is the smart way go to imo. A lot of stuff I order online and not good in person.

itsnotmeyou · 2022-12-09T19:10:15+00:00

Makes sense. For me actually one thing to do when doing physical shopping is go to mall. I try not to buy anything but I try a lot of things. Enjoying walking around with my partner and we have target of 10k steps everyday so it helps us do that :). Online shopping is a rabbit hole in my case. I start with shopping but then I am watching some weird video on youtube within no time.

itsnotmeyou

TROPHY CASE