A/B testing Results from both Frequentist and Bayesian A/B Testing
| GA factor | p−value A/B | μ A/B | σ2 A/B | μ-Low on CI | μ-High on CI | σ2-Low on CI | σ2-High on CI | μ for post−E(loss) | σ2 for post−E(loss) |
|---|---|---|---|---|---|---|---|---|---|
| Sales | 0.204 | 0.203 | 0.136 | −13.296 | 9.389 | −0.642 | 0.234 | −1.424 | 0.643 |
| New visitors | 0.289 | 0.287 | 0.330 | −7.008 | 5.365 | −0.544 | 0.566 | 1.754 | 0.332v |
| Users | 0.276 | 0.276 | 0.872 | −8.426 | 6.351 | −0.181 | 1.827 | −0.895 | 0.030 |
| Bounces | 0.058 | 0.058 | 0.791 | −3.674 | 0.168 | −0.278 | 1.494 | −1.163 | 0.056 |
| Bounce rate | 0.002 | 0.001 | 0.995 | −3.185 | −1.153 | 0.449 | 3.983 | 0.000 | 0.001 |
| Average session duration | 0.173 | 0.172 | 0.999 | −8.356 | 4.466 | 0.975 | 5.847 | −1.308 | 0.000 |
| Session duration | 0.183 | 0.180 | 1.000 | −8.668 | 4.820 | 0.985 | 5.804 | −2.311 | 0.000 |
| Unique dimension combinations | 0.043 | 0.042 | 0.788 | −3.441 | −0.153 | −0.274 | 1.480 | −3.903 | 0.056 |
| Entrance rate | 0.301 | 0.300 | 0.992 | −10.351 | 8.365 | 0.351 | 3.650 | −0.074 | 0.001 |
| Time on page | 0.182 | 0.181 | 0.995 | −8.339 | 4.769 | 0.455 | 4.001 | −2.471 | 0.001 |
| GA factor | |||||||||
|---|---|---|---|---|---|---|---|---|---|
| Sales | 0.204 | 0.203 | 0.136 | −13.296 | 9.389 | −0.642 | 0.234 | −1.424 | 0.643 |
| New visitors | 0.289 | 0.287 | 0.330 | −7.008 | 5.365 | −0.544 | 0.566 | 1.754 | 0.332v |
| Users | 0.276 | 0.276 | 0.872 | −8.426 | 6.351 | −0.181 | 1.827 | −0.895 | 0.030 |
| Bounces | 0.058 | 0.058 | 0.791 | −3.674 | 0.168 | −0.278 | 1.494 | −1.163 | 0.056 |
| Bounce rate | 0.002 | 0.001 | 0.995 | −3.185 | −1.153 | 0.449 | 3.983 | 0.000 | 0.001 |
| Average session duration | 0.173 | 0.172 | 0.999 | −8.356 | 4.466 | 0.975 | 5.847 | −1.308 | 0.000 |
| Session duration | 0.183 | 0.180 | 1.000 | −8.668 | 4.820 | 0.985 | 5.804 | −2.311 | 0.000 |
| Unique dimension combinations | 0.043 | 0.042 | 0.788 | −3.441 | −0.153 | −0.274 | 1.480 | −3.903 | 0.056 |
| Entrance rate | 0.301 | 0.300 | 0.992 | −10.351 | 8.365 | 0.351 | 3.650 | −0.074 | 0.001 |
| Time on page | 0.182 | 0.181 | 0.995 | −8.339 | 4.769 | 0.455 | 4.001 | −2.471 | 0.001 |
Sharing content requires targeting cookies to be enabled. Please update your cookie preferences to use this feature.