Trustworthy online controlled experiments: a practical guide to A/B testing

By:

Kohavi, Ron

Contributor(s):

Publication details: New York: Cambridge University Press, 2023.Description: xviii, 271p.: ill.; pbk.: 22cmISBN:

9781108724265

Subject(s):

DDC classification:

302.231 KOH

Summary: Getting numbers is easy; getting numbers you can trust is hard. This practical guide by experimentation leaders at Google, LinkedIn, and Microsoft will teach you how to accelerate innovation using trustworthy online controlled experiments, or A/B tests. Based on practical experiences at companies that each run more than 20,000 controlled experiments a year, the authors share examples, pitfalls, and advice for students and industry professionals getting started with experiments, plus deeper dives into advanced topics for practitioners who want to improve the way they make data-driven decisions. Learn how to • Use the scientific method to evaluate hypotheses using controlled experiments • Define key metrics and ideally an Overall Evaluation Criterion • Test for trustworthiness of the results and alert experimenters to violated assumptions • Build a scalable platform that lowers the marginal cost of experiments close to zero • Avoid pitfalls like carryover effects and Twyman's law • Understand how statistical issues play out in practice. Dives into over twenty advanced topics, including ramp-up procedures, computations of standard-deviations, and instrumentation issues Addresses practical issues not covered in theoretical statistics, such as violations of independent assumptions Additional online material is featured on the book's website https://www.cambridge.org/in/universitypress/subjects/computer-science/knowledge-management-databases-and-data-mining/trustworthy-online-controlled-experiments-practical-guide-b-testing?format=PB

Tags from this library: No tags from this library for this title. Log in to add tags.

Average rating: 0.0 (0 votes)

Holdings
Item type	Current library	Collection	Call number	Copy number	Status	Date due	Barcode
Books	IIT Gandhinagar	General	302.231 KOH (Browse shelf(Opens below))	1	Available		034293

Getting numbers is easy; getting numbers you can trust is hard. This practical guide by experimentation leaders at Google, LinkedIn, and Microsoft will teach you how to accelerate innovation using trustworthy online controlled experiments, or A/B tests. Based on practical experiences at companies that each run more than 20,000 controlled experiments a year, the authors share examples, pitfalls, and advice for students and industry professionals getting started with experiments, plus deeper dives into advanced topics for practitioners who want to improve the way they make data-driven decisions. Learn how to • Use the scientific method to evaluate hypotheses using controlled experiments • Define key metrics and ideally an Overall Evaluation Criterion • Test for trustworthiness of the results and alert experimenters to violated assumptions • Build a scalable platform that lowers the marginal cost of experiments close to zero • Avoid pitfalls like carryover effects and Twyman's law • Understand how statistical issues play out in practice.

Dives into over twenty advanced topics, including ramp-up procedures, computations of standard-deviations, and instrumentation issues
Addresses practical issues not covered in theoretical statistics, such as violations of independent assumptions
Additional online material is featured on the book's website

https://www.cambridge.org/in/universitypress/subjects/computer-science/knowledge-management-databases-and-data-mining/trustworthy-online-controlled-experiments-practical-guide-b-testing?format=PB

There are no comments on this title.

to post a comment.