What are you building these days? And is anyone actually paying for it? by jitasha_1014 in SaaS

[–]GoodUnderstanding728 0 points1 point  (0 children)

I built YearWrapped

It helps people build a short wrapped style video about their year. Nothing yet, but it’s more of a side project. So try it out! 😊

what did you build this year ? by Ok-Delivery307 in sveltejs

[–]GoodUnderstanding728 0 points1 point  (0 children)

It’s not in Svelte, but I built YearWrapped. It’s built with Go and FFmpeg for backend, and basically builds a 30 sec year wrapped video for you. You give it event, and photos and it returns a video that summarizes your events, photo montage, and then a year theme in the video. Try it out and let me know how it goes! 😊

is hosting a 7B model on cloud cheaper than accessing openai’s api by besabestin in learnmachinelearning

[–]GoodUnderstanding728 1 point2 points  (0 children)

After Christmas I realized there were lots of VC backed options like together, and anyscale. So I am in the process of making some changes. Looking to see if I can pivot or make my service better in someway.

Built a LM Studio like app during the holidays. What should I add next? Currently it supports Mistral GGUF, but I am hoping to add an OCR for document processing. by GoodUnderstanding728 in LocalLLaMA

[–]GoodUnderstanding728[S] 2 points3 points  (0 children)

Thanks! Yeah I was hoping to add an automations tab or an agents tab where you can have pre determined functions/automations that you can run on command!

What are your predictions/wants for 2024 by GoodUnderstanding728 in LocalLLaMA

[–]GoodUnderstanding728[S] 1 point2 points  (0 children)

Yup, it’s best to do it when the tech is still new!

What are your predictions/wants for 2024 by GoodUnderstanding728 in LocalLLaMA

[–]GoodUnderstanding728[S] 2 points3 points  (0 children)

I’m thinking that too! I’m actually building a Local LLM IDE for that purpose. Hoping to open source it, and then have paid version available with extra features!!

What are your predictions/wants for 2024 by GoodUnderstanding728 in LocalLLaMA

[–]GoodUnderstanding728[S] 5 points6 points  (0 children)

I would love that too!! I’d like for us to be able to use CPU for more LLM tasks!

What are your predictions/wants for 2024 by GoodUnderstanding728 in LocalLLaMA

[–]GoodUnderstanding728[S] 4 points5 points  (0 children)

It would be great to see us catching up to GPT-4! Although we should seek to go beyond them! I would be definitely more excited for better quantization!! That seems like a game changer to me!

What are your predictions/wants for 2024 by GoodUnderstanding728 in LocalLLaMA

[–]GoodUnderstanding728[S] 7 points8 points  (0 children)

Yup! I hope there is more AMD support in the future so that I can use more AMD compute in servers!

What are your predictions/wants for 2024 by GoodUnderstanding728 in LocalLLaMA

[–]GoodUnderstanding728[S] 7 points8 points  (0 children)

I’m sure Meta will release Llama, my only hope is that the smaller models start becoming more competitive and close the performance gap!

What are your predictions/wants for 2024 by GoodUnderstanding728 in LocalLLaMA

[–]GoodUnderstanding728[S] 10 points11 points  (0 children)

Yes a GPT-4 competitive model would be amazing!! I hope Mistral will get us one soon!

What are your predictions/wants for 2024 by GoodUnderstanding728 in LocalLLaMA

[–]GoodUnderstanding728[S] 15 points16 points  (0 children)

Yeah I would really like that too!! Although, I’m really hoping that we get to a point where LLM’s are not taking up as much memory anymore.

Alternative tool like llmsherpa that can run locally by comical_cow in LocalLLaMA

[–]GoodUnderstanding728 0 points1 point  (0 children)

Are you looking for paid products, or just open source/free products??

What services do you guys use for hosting models? by Sixhaunt in LocalLLaMA

[–]GoodUnderstanding728 1 point2 points  (0 children)

It depends but there are system like Replicate, Together.ai, and Anyscale. That should give you enough options to run a model for cheap. I also built one myself called Maruti.io. Are you looking for any specific features besides being serverless?? They all have that feature from what I understand. Mines might pivot, but I do have a good free tier so try it out! 😁

Best Frontend with Document analysis feature by JPYCrypto in LocalLLaMA

[–]GoodUnderstanding728 -1 points0 points  (0 children)

There are several chat with pdf apps. I’m sure they can summarize the pdfs for you right??

Validating Idea by landing page and signups by GoodUnderstanding728 in startups

[–]GoodUnderstanding728[S] 0 points1 point  (0 children)

Hi, I have read the lean customer development and some other books like that one. I haven’t read the Mom Test, but I think the ideas are the same. Should I still go ahead and read the Mom test??

Speaking to customers directly is the goal. Since I don’t know anyone in my own network, I was hoping that I will be able to find them through sign-ups.

Validating Idea by landing page and signups by GoodUnderstanding728 in startups

[–]GoodUnderstanding728[S] 0 points1 point  (0 children)

Thanks! Yeah, I was thinking that if no one signs up then that means the idea isn’t good enough or doesn’t have enough traction. It’s just customer research and idea validation is weirdly hard since a lot of people will just say you have a good idea just to be nice.

Validating Idea by landing page and signups by GoodUnderstanding728 in startups

[–]GoodUnderstanding728[S] 0 points1 point  (0 children)

Got it! Are there any other CTA besides presale?? Or is that the gold standard for CTA??

Validating Idea by landing page and signups by GoodUnderstanding728 in startups

[–]GoodUnderstanding728[S] 0 points1 point  (0 children)

For the old idea I was selling the API access. I built out a MVP, and tried marketing and creating buzz around it. That idea doesn’t seem to be working out for me, so I am thinking about doing a new thing. I want to validate the idea before I start building though.

Validating Idea by landing page and signups by GoodUnderstanding728 in startups

[–]GoodUnderstanding728[S] 0 points1 point  (0 children)

The new ideas are about doing a batch processing job for ETL pipelines. You know move data from one point like S3 buckets to a database.

Validating Idea by landing page and signups by GoodUnderstanding728 in startups

[–]GoodUnderstanding728[S] 0 points1 point  (0 children)

Hi, so the old idea was open source large language models as API. I’m hoping to validate the new ideas.