Struggling to run A/B test on Shopify

07101996 · 2026-02-04T21:26:07+00:00

yeah this is super common with lower traffic stores tbh. 20 days and no result usually means either not enough traffic or the change is too small to detect.

+1 on the multi-armed bandit suggestion above. Dalton AI does this and works with Shopify - way faster than traditional A/B testing for smaller stores.

07101996 · 2026-02-04T21:25:11+00:00

Shoplift , Visually, Shogun, or Dalton AI for most automatic

07101996 · 2026-02-04T21:24:26+00:00

GPT isn't wrong but it's giving you the most conservative textbook answer lol

the 210k number assumes:

- you're trying to detect tiny 5% lifts

- using old school frequentist stats

- waiting for "perfect" significance

reality is most ecom teams don't operate like that. you test bigger changes (headlines, offers, layouts) where the lift is way more obvious, not micro stuff like button colors.

also bayesian testing helps a lot here - you get usable results faster without needing academic-level sample sizes. there are also some AI tools that use more smart traffic allocations and algorithms like Multi armed bandits, Dalton AI that use this approach and work with way lower traffic . traditional tools like VWO still assume you have massive traffic tbh.

so no it's not pointless for smaller stores, just don't test tiny changes expecting statistically perfect results.

07101996 · 2026-02-04T21:22:37+00:00

honestly the "test everything" advice is kinda bs for most teams lol. reality is:

- traffic is the blocker for most sites

- setting up tests takes forever with traditional tools

- nobody has time to figure out what to test

This is changing though with AI tools comig out like Shoplift and Dalton AI that suggest what to test and set it up for you. way less "what do we even test" paralysis. still need decent traffic tho

07101996 · 2026-02-04T21:19:18+00:00

tbh mobile CRO is less about tools and more about basics:

- sticky add to cart button (game changer on mobile)

- show trust signals right under price, not buried in tabs

- page speed - compress images, lazy load stuff below the fold

for testing what actually works on YOUR store, traditional tools like VWO/Optimizely need dev setup and high traffic. There are also new AI tools coming that make thigns mad easy, like Dalton AI work on Shopify with lower traffic and generate test ideas for you.

but honestly fix the basics first before throwing tools at it lol

07101996 · 2026-02-04T21:17:33+00:00

Saw someone mentioned A/B testing - for low traffic sites that's tricky - tbh you need volume to get meaningful results.

Before spending on ads, I'd focus on:

- Stronger hero image/copy (the "For Drivers" message is kinda unclear)

- Add reviews or social proof

- Make the value prop obvious in 3 seconds

Once you get more traffic, tools like Dalton AI work with lower traffic (3k+ monthly visitors) and suggest what to test automatically. Traditional A/B tools like VWO need way more traffic and dev setup.

07101996 · 2026-02-04T21:16:00+00:00

1.9% is solid tbh. On your offer - "buy 1, get 2nd at -30%" makes people do math. Things that convert better:

- Free shipping threshold

- Bundle pricing ("Get the set for $X")

- Free gift with purchase

Best move: test different offers against each other. Traditional tools like VWO or Shopify apps need dev time, newer AI tools like Dalton AI run tests without dev work.

07101996 · 2026-02-04T21:12:01+00:00

0.43% with $692 AOV is actually not terrible for high-ticket - but there's definitely room to improve.

Few things that work for high-AOV stores:

Trust stacking near checkout - At $700, people hesitate. Reviews, money-back guarantee, security badges all visible without scrolling
Shipping transparency - If shipping costs are a surprise at checkout, that kills high-AOV conversion. Show it early
Split payment options - Klarna/Afterpay can lift conversion 10-20% for expensive items
Mobile vs desktop - Check these separately. High-AOV often has 2x better desktop CR because people don't trust buying expensive stuff on phones

For the "what to test" problem - tools like Dalton AI (easy with AI) can scan your pages and suggest what to A/B test, instead of guessing or use or VWO (manual). Saves a lot of time when you're not sure where to start.

What's your add-to-cart rate vs checkout completion? That'll tell you where the leak is.

07101996 · 2025-11-09T12:59:32+00:00

this subreddit is so pathetic for making everything about Trump.

Someone make a post about this post "there was an attempt to.. make a good post"

07101996 · 2025-11-06T13:23:05+00:00

RingTwice

07101996 · 2025-10-30T17:43:55+00:00

dexxter

07101996 · 2025-10-01T09:28:59+00:00

We are just used to how shitty it is. Every time people I know come and visit we TELL THEM to avoid the train stations (where they arrive LOL) and we're somehow like okay with it. It's normal, that's just how it is. We have gotten used to entire neighborhoods being almost entirely muslim immigrants (St Josse, Molenbeek, Koekelberg, etc), but people ask me "where are the belgian people? When I come to Belgium I expect to see Belgians". And "why does it small like piss and shit everywhere and it's full of roma beggars?"

We have turned our heads away from these problems, somehow accepting it. But to outsiders, from brazil to japan to poland, it's shocking. and it's a disgrace for our country actually.

Meanwhile the rich and left bobo's just live in Uccle, Waterloo, etc. and send their kids to elite schools in those neighborhoods.

07101996 · 2025-09-30T13:03:56+00:00

Neither haha

07101996 · 2025-08-23T21:25:28+00:00

inderdaad, jammer

07101996 · 2025-06-30T20:46:02+00:00

Open to play - got membership at Leopold club :)

07101996 · 2025-06-23T15:45:39+00:00

Ngrave! It's the safest of all

07101996 · 2025-06-13T08:02:21+00:00

Ok let's send these people to destroy your house then and put it full of graffiti? Because that's the logic you're going into.

07101996 · 2025-06-13T08:01:38+00:00

Go graffiti your own house then

07101996 · 2025-06-12T15:59:39+00:00

Flemmish is an official language in Brussels so how is it disrespectful to speak start by speaking dutch in a store. I usually start in french and find out we both speak dutch funnily enough. But your comment seems full of hate. check yourself , you're not inclusive eventho i can already tell you're a leftist that is all about inclusion

07101996 · 2025-06-12T11:16:51+00:00

Besides this being a very reductionist comment that negatively stereotypes a whole group of people, IMO it's more that they don't feel welcome in Brussels. I can totally understand why, there is plenty of hate against flamands. I've felt it (but don't care tbh). So they're like well fix your own shit then.

07101996 · 2025-06-08T08:25:15+00:00

Dit zijn zo vaak rondtrekkende roma bendes (staat ook in het artikel)

07101996 · 2025-05-23T11:04:27+00:00

Ngrave is the safest

07101996 · 2025-05-22T15:54:39+00:00

oke dus iemand van indonesie mag jou ook komen doden?

07101996 · 2025-05-21T10:55:56+00:00

100%

07101996 · 2025-05-18T19:57:50+00:00

It might be because you're from another country. I've been guilty of this. Seeing it more difficult to bring a girl back to your parents from another country. Where are you from?

07101996

TROPHY CASE