Google Web Optimizer -- How long until winning combination?

Posted by Django Reinhardt on Stack Overflow See other posts from Stack Overflow or by Django Reinhardt
Published on 2010-06-11T10:14:33Z Indexed on 2010/06/13 9:12 UTC
Read the original article Hit count: 268

I've had an A/B Test running in Google Web Optimizer for six weeks now, and there's still no end in sight. Google is still saying: "We have not gathered enough data yet to show any significant results. When we collect more data we should be able to show you a winning combination."

Is there any way of telling how close Google is to making up its mind? (Does anyone know what algorithm does it use to decide if there's been any "high confidence winners"?)

According to the Google help documentation:

Sometimes we simply need more data to be able to reach a level of high confidence. A tested combination typically needs around 200 conversions for us to judge its performance with certainty.

But all of our conversions have over 200 conversations at the moment:

230 / 4061 (Original)
223 / 3937 (Variation 1)
205 / 3984 (Variation 2)
205 / 4007 (Variation 3)

How much longer is it going to have to run??

Thanks for any help.

© Stack Overflow or respective owner

Related posts about website

Related posts about ab-testing