SD formula for $A/B$ testing
Clash Royale CLAN TAG#URR8PPP
up vote
0
down vote
favorite
I'm trying to understand the statistic behind $A/B$ testing and link it to a statistic I know from school.
I'm struggling to translate binominal distribution and sampling to A/B test.
I found online (VWO) formula for SD (standard deviation) as
Standard Error (SE) = $sqrt(p cdot (1-p))/ n$ where $p$ is conversion and $n$ is number of trials.
One answer here What is the difference and relationship between the binomial and Bernoulli distributions?
gives SD formula as $sqrt(kp(1-p))/n $ where $k$ is a number of trials
and $n$ is a sample size.
How does it translate to $A/B$ testing?
I assume $p$ is a conversion rate/probability of success
$K$ is the number of people in the test group
$n$ is it a number of people in the test size too?
I also read somewhere that for samples you divide by $n-1$, not $n$? Why that's not the case here?
standard-deviation
add a comment |Â
up vote
0
down vote
favorite
I'm trying to understand the statistic behind $A/B$ testing and link it to a statistic I know from school.
I'm struggling to translate binominal distribution and sampling to A/B test.
I found online (VWO) formula for SD (standard deviation) as
Standard Error (SE) = $sqrt(p cdot (1-p))/ n$ where $p$ is conversion and $n$ is number of trials.
One answer here What is the difference and relationship between the binomial and Bernoulli distributions?
gives SD formula as $sqrt(kp(1-p))/n $ where $k$ is a number of trials
and $n$ is a sample size.
How does it translate to $A/B$ testing?
I assume $p$ is a conversion rate/probability of success
$K$ is the number of people in the test group
$n$ is it a number of people in the test size too?
I also read somewhere that for samples you divide by $n-1$, not $n$? Why that's not the case here?
standard-deviation
add a comment |Â
up vote
0
down vote
favorite
up vote
0
down vote
favorite
I'm trying to understand the statistic behind $A/B$ testing and link it to a statistic I know from school.
I'm struggling to translate binominal distribution and sampling to A/B test.
I found online (VWO) formula for SD (standard deviation) as
Standard Error (SE) = $sqrt(p cdot (1-p))/ n$ where $p$ is conversion and $n$ is number of trials.
One answer here What is the difference and relationship between the binomial and Bernoulli distributions?
gives SD formula as $sqrt(kp(1-p))/n $ where $k$ is a number of trials
and $n$ is a sample size.
How does it translate to $A/B$ testing?
I assume $p$ is a conversion rate/probability of success
$K$ is the number of people in the test group
$n$ is it a number of people in the test size too?
I also read somewhere that for samples you divide by $n-1$, not $n$? Why that's not the case here?
standard-deviation
I'm trying to understand the statistic behind $A/B$ testing and link it to a statistic I know from school.
I'm struggling to translate binominal distribution and sampling to A/B test.
I found online (VWO) formula for SD (standard deviation) as
Standard Error (SE) = $sqrt(p cdot (1-p))/ n$ where $p$ is conversion and $n$ is number of trials.
One answer here What is the difference and relationship between the binomial and Bernoulli distributions?
gives SD formula as $sqrt(kp(1-p))/n $ where $k$ is a number of trials
and $n$ is a sample size.
How does it translate to $A/B$ testing?
I assume $p$ is a conversion rate/probability of success
$K$ is the number of people in the test group
$n$ is it a number of people in the test size too?
I also read somewhere that for samples you divide by $n-1$, not $n$? Why that's not the case here?
standard-deviation
edited Jul 14 at 20:45
user401938
asked Jul 14 at 20:13
twopens
11
11
add a comment |Â
add a comment |Â
active
oldest
votes
active
oldest
votes
active
oldest
votes
active
oldest
votes
active
oldest
votes
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f2851918%2fsd-formula-for-a-b-testing%23new-answer', 'question_page');
);
Post as a guest
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password