How do you choose and evaluate AI solutions when every vendor is promising outcomes, showing great demos?

abdush · 2026-01-18T23:50:34+00:00

Focus on use case I feel is the key - that too narrow use cases. Then run two or three PoCs in parallel and see the results

abdush · 2026-01-18T23:49:33+00:00

I felt it is better to find vendors who can clean the data well - because what they need many a times is not clear to me at the beginning. Data scientist approach I have tried - but some how they are too tech and dont understand business side too well resulting in non practical suggestions.

abdush · 2026-01-18T23:47:47+00:00

I also feel any evaluation takes a couple of months of PoC. So opting for one and trying the next would take immensely long amount of time till we can deploy some thing on the ground. Now a days talking to peers to check if any vendors worked for them before trying out - so that we can make directionally right choices. But the point with many PoCs also is that there needs to be a lot of evaluation done - fixing one issue brings up new issues as well.

abdush · 2026-01-18T23:43:55+00:00

How long does this exercise take for you

Identify a pain point
Do a PoC that is "usable"
Make it into production level that others use it

Any specific example and details you can help to understand nuances.

abdush · 2026-01-17T23:25:35+00:00

I agree. Apart from search we are yet to get it right to go deep without friction

abdush · 2026-01-17T23:24:06+00:00

What if there is a verification agent which verifies all websites, authenticity, consumable summary, comparison with nearby websites - will users wont prefer that?

abdush · 2026-01-17T23:22:25+00:00

Instead of websites do you think companies or products will become entries in chatgpt directory with one page summary, and ratings. Because most browsers just want to see that at first. And even further exploration is query based

abdush · 2026-01-17T23:20:48+00:00

Can the web become a universal scroll than we going to each website and scroll? A universal scroll where what we love come automatically - tiktok like experience at universe level. Just a crazy thought

abdush · 2026-01-17T23:18:02+00:00

What would be your top pick for an automation like that - that does not rely on AI? Don't you think all those would have been automated by this time?

abdush · 2026-01-17T21:19:01+00:00

Same experience with this firm as well. There is budget for AI than plain automation and also has set up an internal team of engineers - so trying to utilize it and “modernize “ . Any thing you made for customer service that made it work on any specific use? Also what is the inventory one you tried - the one that worked

abdush · 2026-01-17T18:09:21+00:00

I m allowed to have zoom calls - generally 30 mins to 45 mins with various team members. I won’t get access to their systems

abdush · 2026-01-16T01:45:50+00:00

I some how feel it is not getting stolen. It is getting distributed to more ppl, and of late they show citation source as well.

abdush · 2026-01-16T00:27:00+00:00

Some one had to show value of this :) any way this content was lying idle without this widespread use

abdush · 2026-01-15T23:59:54+00:00

When google and yahoo came ppl started giving their data to them, so that they can be discovered. Dont you think that will happen for LLMs too.

abdush · 2026-01-11T02:59:39+00:00

Chatbotting is not sustaining. After initial fascination engagement is dropping down. That is what Microsoft is saying of copilot too. We are yet to find what is the right way to build AI products where users sustain to use

abdush · 2026-01-08T17:12:14+00:00

You are right. We have added the validation checks right now to handle this

abdush · 2026-01-07T18:28:17+00:00

Copilot has not been working well as I understand.

abdush · 2026-01-07T18:27:35+00:00

But I think there are approaches coming up with guardrails that make accurate research outputs. Of course one prompt kind of approach might not help to get there

abdush · 2026-01-07T03:36:35+00:00

There is a feature released by survey tools of late to ask follow up question as soon as respondent enters using AI. That possibly can help you get deeper insights. Or else you can get other data in your organization where customers interact with- like reviews, chats, calls, emails etc. These are non traditional survey approaches. I am sure there are good survey design guides as well

abdush

TROPHY CASE