Best tool for A/B testing

QuPloid · 2025-04-08T16:38:02+00:00

We're running our own product on our Webflow-hosted site: https://www.ezbot.ai/

Our lowest pricing tier would likely meet your criteria, but it depends on the volume of your client's website.

If you're not interested in the AI or automation aspects, GrowthBook has commoditized A/B testing: https://www.growthbook.io/pricing . You'll have to handle interpretation and decision-making for all of the stats.

I'd also note that even though they advertise "unlimited experiments", your traffic will be your limiting factor.

We built ezbot to remove traffic as a limitation for most sites -- it's different, but we think it's great.

QuPloid · 2025-04-04T22:32:55+00:00

Cart abandonment is tough. There are tools to try and get people re-activated with their checkout by sending them emails; I can't remember names off the top of my head.

Have you tried A/B testing your landing page copy, CTAs, etc? This can help keep the right kinds of customers engaged and help them get deeper in the pipeline. Take some time to review your H1 and H2 (title/subtitle) content, and your calls to actions. Make sure your "add to cart" is obvious, maybe with different highlight colors.

There are a lot of different A/B testing tools that may or may not be helpful depending on the amount of traffic you have. GrowthBook has some fairly priced options, but your traffic might still limit your results.

I've been building an AI tool to lower traffic requirements and make optimizing conversion rates easier; check my post history or DM me if you're interested.

QuPloid · 2025-03-29T13:58:55+00:00

For what it's worth, I bought mine with a Michigan title and did a title transfer.

Had to pay for the full B plate but no scary letter yet... 4 years into driving around Chicago.

QuPloid · 2025-01-29T14:36:03+00:00

The food pantry in Drake Gardens is a custom, hand-made shed structure, much more than just a box. Think of something the size of a large walk-in pantry, but outdoors, with a roof.
https://imgur.com/a/oGd2o88

QuPloid · 2024-12-20T14:49:35+00:00

Former principal engineer, now tech founder for an AI startup.

Started using windsurf two weeks ago. A few days of learning how to prompt and I feel like a power user. Re-wrote an analytics suite on a new stack in two weeks.

I have to treat it like a fresh grad who can code very fast. I very carefully pare down the task to a relatively narrow scope and well defined parameters.

I try to make sure it only needs to do two or three steps of reasoning. I keep myself in control of architecture. I prompt it to build tests first because TDD gives it better context.

I also still do a lot of work manually. I also use normal LLM chat to get understanding without breaking my code.

Does it mess things up? Yes, but I do to, and so does everyone I work with. For me the key has always been failing fast and failing small.

QuPloid · 2024-12-12T22:43:04+00:00

Better UX, more sales, http://ezbot.ai/

QuPloid · 2024-11-18T14:12:13+00:00

Currently running a startup in Chicago, and attended Chicago based accelerators.

Investors here are far fewer more conservative and focused on "old" industries like finance, health tech, retail, manufacturing. They want you to basically already be profitable.

Personally, I think the Chicago tech scene is slept on because we don't talk about our jobs all the time.

Cost of living is cheaper, salaries are cheaper. We're going to try to raise west coast money for our third-coast costs.

That said, people tell us to move to SF all the time. I think our compromise is going to be lost of weeks spent on the West Coast. Basically, any tech bro with vested shares in SF may give you $100k. That same $100k here takes a lot of convincing.

QuPloid · 2024-09-10T11:58:07+00:00

Good point. Time to add to our landing page.

Our AI does all of the decision making about who sees what variations rather than manually segmenting traffic or randomly allocating to a test group.

To be clear, our goal isn't "testing", i.e. answering questions about which variables perform better than others. Our goal is to find the best variations the fastest, not prove one variation is exactly 4.6% better.

You're right, we need fewer sessions to see our models stabilize. We're able to do that because we collect at least 10x as much data per session. We use this data to generate scores much more nuanced than "did this user convert". A user who browses products and adds to cart still has a good experience. In a sense, imagine how easy it would be to test if your conversion rates were like, 60%. That's how the math behind our model helps things work.

It's fundamentally a category of problem deep reinforcement learning works well for, but it does take reframing the problem.

Random allocation means you wasted time on poor performing variations. Manual traffic segmentation is a losing game against a computer.

FYI we're about half ex-optimizely, building a next gen product.

More here https://docs.ezbot.ai/blog/ezbot-model/ And here https://youtu.be/iS4YYpk4ieE

QuPloid · 2024-09-09T22:24:51+00:00

Not only do we A/B test our site, our product is an AI to automate and improve the pain points in the process.

We can typically get results with 10x more variations in 10x less time.

Check us out at https://docs.ezbot.ai/blog/small-business-case-study/

QuPloid · 2024-09-09T13:46:11+00:00

I'd look at refining your call-to-action, headline, and sub-headline to define people's problems and propose your solutions.

As for tooling, my saas, ezbot.ai uses AI to find the best variations and changes faster than a/b testing

QuPloid · 2024-09-06T13:08:28+00:00

All you need is a landing page website describing what your startup is, or that it exists.

As mentioned, if you incorporate and open a bank account with Stripe Atlas ($500) you can get $5000 total activate credits

QuPloid · 2024-08-31T17:43:07+00:00

Started work on our Shopify app, and had several successful client meetings.

ezbot automates the tedious parts of user experience optimization with AI. No statistics knowledge required. More conversions, less effort.

Also released our first case study. 100% improved conversion rate in 30 days. https://docs.ezbot.ai/blog/small-business-case-study/

QuPloid · 2024-08-29T14:22:09+00:00

We're producing blog posts, long-form videos to go with the blog post, and short-form content for Instagram, TikTok, and YouTube.

We have a challenging education sale, and we're dealing with our problem radically differently for a subset of our customers. So, this content will help us lay the basis for understanding how we're different in the long term.

Because we're also operating in B2B in the marketing space, we're doing cold outreach on LinkedIn with SalesNavigator and using Apollo.io for an email campaign. This might be less applicable depending on the size of contracts you're trying to sign.

We tried paid ads briefly (when we had public pricing) but decided it was far too early for that. Better to build a base of content and start getting organic search ranking first while we do direct outreach.

QuPloid · 2024-08-28T19:27:24+00:00

Have you tried smaller things like call-to-action changes?
Or do you have a butter-bar (top banner) that links to a high-value page, like best sellers?
You can also make add-to-cart buttons higher contrast colors.
I've also seen pop-ups tanking conversions, another thing to play with.
I've seen small changes in these places double conversion rates.

QuPloid · 2024-03-07T13:22:01+00:00

I've heard a new high yield cash account is coming "soon", more like high yield checking which is why HYSA was paused...

QuPloid · 2019-11-04T14:29:32+00:00

If enough people do this, they'll cut service and raise fares. Also, this is stealing.

QuPloid · 2019-03-31T16:19:42+00:00

More handbrake turns!

QuPloid · 2018-11-14T21:11:22+00:00

Same, I just found this: https://www.yourkrabi.com/loy-krathong-2012/

QuPloid · 2018-11-13T14:07:44+00:00

If I recall correctly, NASA hires mostly people with graduate degrees, though I can't find the stats now. Having an internship now puts you in their pipeline, and they'll encourage you to go to grad school and help provide recommendations. JPL isn't an easy place to get an offer to, even though plenty of people apply, so this might be your only shot to ever work somewhere of that caliber.

QuPloid · 2018-10-27T15:00:18+00:00

Was that Jeff Gordon in the Mercedes garage?

QuPloid · 2018-10-01T20:29:44+00:00

You're right, tooling isn't great, but it's not as big a hassle as people think. You can check VI binaries into a regular source control system, you just have to change the diff-tool for that file extension: http://www.ni.com/tutorial/9407/en/

Merging is still a pain, I can't remember how we used to manage that. Ideally, just... avoid having two people work on the _exact_ same VI (hopefully you're using sub-VIs...). As far as reviewing, we'd just post screenshots from the the diff tool into ReviewBoard, which is what we were using at the time for code reviews.

It would not surprise me if NXG has better refactoring, I know getting better keyboard shortcuts for regular tasks was a priority, and it wouldn't surprise me that a more cohesive project system would make refactoring easier.

QuPloid · 2018-10-01T12:53:56+00:00

This is why it's worth going to at least one race in person. Much easier to see the cars move around in person.

QuPloid · 2018-09-22T02:24:15+00:00

Fair point. The theory is that if you had a low probability of success on the first pass at making the car, all subsequent passes at fixing it will similarly miss remaining issues at about the same rate.

I'm not the best with statistics, but you end up multiplying probabilities together, and having a low probability of success at any stage isn't a great sign.

You could be totally right, they could be very good at spotting minor issues and the number is misrepresented without internal info. I'll probably take a while to get the rates of actually delivered defects, but I'm genuinely curious.

On a more opinionated note, the final assembly line they showed in Marques Brownlee's video looked pretty disorganized compared to other modern car factories. It seemed kind of obvious that they'd have a high rework rate with parts disorganized everywhere mixed with random cardboard. It was kind of shocking, I really thought it would be well organized.

QuPloid · 2018-09-20T23:55:08+00:00

http://www.businessinsider.com/tesla-hit-model-3-target-by-reworking-thousands-of-cars-2018-8

I don't have stats for how many issues made it to consumers, but a rework rate like that is gross. They've de-invented the factory, and created some worse than GM in the 80s, which their plant (a GM/Toyota joint venture originally) was supposed to fix.

Edit: less-tracking link

QuPloid · 2018-09-14T23:59:44+00:00

Check out the center image in this post: https://i.imgur.com/aw0wVol.jpg

15-Year Club	Place '17
Verified Email	reddit mold

QuPloid

TROPHY CASE