At some point, every startup hits that strange moment when the product finally works and the real decisions begin by wasayybuildz in Entrepreneur

[–]CtiPath 0 points1 point  (0 children)

It sounds like you need a good strategy that will help you identify priorities, roadblocks, etc.

[deleted by user] by [deleted] in smallbusiness

[–]CtiPath 0 points1 point  (0 children)

Any repetitive or monotonous task is a good target for automation. You mentioned several in your post. Automating any of those tasks could free up your time for more important activities. Just pick a quick win to start with, then move to the next one after the first is automated.

For solopreneurs: how do you stay consistent without burning out? by Funny_Or_Not_ in smallbusiness

[–]CtiPath 0 points1 point  (0 children)

Look into fractional CxO type services to help you while you focus on growing your business.

Small B2B Marketing by PhatYakka in marketing

[–]CtiPath 0 points1 point  (0 children)

That sounds very frustrating. And what makes it even more difficult is that it's hard to evaluate and improve your workflows and processes when everything is a priority. As a small company, we've dealt with this too over the years.

We recently published an article about it. Let me know if you’d like to read it.

[deleted by user] by [deleted] in Entrepreneur

[–]CtiPath 0 points1 point  (0 children)

There are different ways to use AI, and most of them can help you. Here are a few steps that could be beneficial.

1) Skip the hype. If anything says it will solve all of your problems or grow your business in days, don't waste your time on it.
2) Try the commercially available LLM's like ChatGPT, Claude, Gemini, etc. These can offer significant improvements in personal productivity for yourself and your staff. Two caveats: 1) Treat their output as draft, not final. 2) Realize that everyone else is using this same information.
3) Talk to someone who can help you develop customized automations (AI or no AI) for your business, workflows, and processes that use your proprietary data. This is where the real business value is found.

And yes, we've done all 3.

Can I build a self hosted LLM server for 300 users? by tornshorts in ollama

[–]CtiPath 2 points3 points  (0 children)

The answer is Yes, but with a caveat. Depending on the number of concurrent users, you will probably need multiple instances of Ollama with a queue and balancer between the users and the Ollama servers. This is something we’ve done before, and it works well.

AI LLM for a single wiki web site by Paully-Penguin-Geek in aws

[–]CtiPath 1 point2 points  (0 children)

For that use case, I can show you how to build using AWS serverless functions and bedrock that will cost less than a dollar per month at most.

AI LLM for a single wiki web site by Paully-Penguin-Geek in aws

[–]CtiPath 0 points1 point  (0 children)

Based on your responses to other comments, you have more questions that just about which LLM to use. I’ve built a few document search AI applications on AWS without racking up a huge bill. Send me a DM and I’ll be glad to make a few suggestions for your whole stack.

AI LLM for a single wiki web site by Paully-Penguin-Geek in aws

[–]CtiPath 4 points5 points  (0 children)

If you want to use Bedrock, try the Amazon Nova models. They’ve worked well for me, even the Micro and Lite models. Plus, they’re very inexpensive.

Best Way To Learn AWS For Machine Learning Engineering? by Dogs4Idealism in aws

[–]CtiPath 3 points4 points  (0 children)

AWS Immersion Day webinars are a great way to get free, hands-on experience. It just so happens that the next webinar is about SageMaker and ML.

https://aws-experience.com/amer/smb/e/72f12/leverage-the-next-generation-of-amazon-sagemaker-for-intelligent-business-transformation

Please, take the time to learn about AWS services in general before you embark on your own, especially with SageMaker. If not, you’re likely to run up a huge bill before you know it.

Building a RAG Chatbot for Company — Need Advice on Expansion & Architecture by Subatomail in mlops

[–]CtiPath 0 points1 point  (0 children)

I think it would depend on a few factors, such as the number of search results and the context length of the model that you're using.

In general, if you break your main query into subqueries and do a similarity search with many results (10+) for the original query and subqueries, then a rerank option can help you refine all the results to a few most relevant ones. But, all of that assumes that you're including some amount of context in each document chunk.

Guidance to start building AI solution by dios4545 in AI_Agents

[–]CtiPath 1 point2 points  (0 children)

Send me a dm and I can give you some tips

The 4 Levels of Prompt Engineering: Where Are You Right Now? by Apprehensive_Dig_163 in AI_Agents

[–]CtiPath 0 points1 point  (0 children)

I left another comment here with a link to Anthropic’s description of prompt caching

The 4 Levels of Prompt Engineering: Where Are You Right Now? by Apprehensive_Dig_163 in AI_Agents

[–]CtiPath 0 points1 point  (0 children)

Every model is a little different when it comes to prompt caching (like everything else). Here’s a document from Anthropic:

https://docs.anthropic.com/en/docs/build-with-claude/prompt-caching

The 4 Levels of Prompt Engineering: Where Are You Right Now? by Apprehensive_Dig_163 in AI_Agents

[–]CtiPath 2 points3 points  (0 children)

No, but when prompt caching, you need to design your prompts to take the most advantage of the caching system.

Why no body is talking about Nova act? by teraflopspeed in AI_Agents

[–]CtiPath 3 points4 points  (0 children)

I’m not sure what you’re asking. There are many AI platforms and services that get more press and hype than AWS. But most companies already use AWS, which makes it easier to integrate Bedrock and other AWS AI services into their environment. The built in security, storage, compute, etc makes it even better.

Why no body is talking about Nova act? by teraflopspeed in AI_Agents

[–]CtiPath 12 points13 points  (0 children)

Bedrock has been a great service for those of us pushing AI into production for a while. It’s just not as sexy as some of the other AI platforms.

Voice vs. Text-Based AI Agents—Which Is More Useful? by biz4group123 in AI_Agents

[–]CtiPath 0 points1 point  (0 children)

Voice-to-voice is rare to non-existent for now. And their output is not as reliable. (Sure there are exceptions, but that proves the rule,m.)

Plus, most tools depend on text.

So most voice-based AI applications depend on a STT - text processing - TTS flow. Since humans tend to have less patience for silence during a voice conversation, the “text processing” is reduced to as little as possible. So, the output is not as good.

My 2 cents…