bayesAB {bayesAB}  R Documentation 
bayesAB: Fast Bayesian Methods for A/B Testing
Description
bayesAB provides a suite of functions that allow the user to analyze A/B test data in a Bayesian framework. bayesAB is intended to be a dropin replacement for common frequentist hypothesis test such as the ttest and chisq test.
Details
Bayesian methods provide several benefits over frequentist methods in the context of A/B tests  namely in interpretability. Instead of pvalues you get direct probabilities on whether A is better than B (and by how much). Instead of point estimates your posterior distributions are parametrized random variables which can be summarized any number of ways. Bayesian tests are also immune to 'peeking' and are thus valid whenever a test is stopped.
The general bayesAB workflow is as follows:
Decide how you want to parametrize your data (Poisson for counts of email submissions, Bernoulli for CTR on an ad, etc.)
Use our helper functions to decide on priors for your data (bayesTest, plotDistributions)
Fit a bayesTest object

print
, plot.bayesTest, and summary.bayesTest to interpret your resultsDetermine whether to stop your test early given the Posterior Expected Loss in
summary
output
Optionally, use banditize and/or deployBandit to turn a precalculated (or empty) bayesTest into a multiarmed bandit that can serve recipe recommendations and adapt as new data comes in.
Note, while bayesAB was designed to exploit data related to A/B/etc tests, you can use the package to conduct Bayesian analysis on virtually any vector of data, as long as it can be parametrized by the available functions.
To learn more about bayesAB, start with the vignettes:
browseVignettes(package = "bayesAB")