This post covers SCRUM vocabulary and processes that product teams use and how that aligns with the process experimenter’s use.
Let’s start with a basic question — why do experimenters need to understand Scrum?
Experimenter’s need to understand Scrum because a large number of organizations are using Agile & Scrum practices and you are likely at one such organization. Typically, such organizations are focused on adding value to their customers through their product. Running experiments provides insights all throughout the product lifecycle from discovery to exploration to validation. …
The Weekly Buzz has gone through a few iterations already in true experimentation spirit — not really backed by data yet, but we’ll get there. For now, in case you are here and want to catch up on some of the important posts in the last few weeks, here they are on LinkedIn.
The LinkedIn posts have takeaways from the articles/ posts below for easy reference.
TWB — Feb 11
👉 Which experimentation metrics should you be measuring? Katie Kelly from Speero (formerly CXL) provides a primer.
🤔 Your turn -> Which metrics do you track for your experimentation program?
In case you are wondering what this is all about, read my previous post introducing The Weekly Buzz and what to expect. And now without further ado, here’s the latest installment of The Weekly Buzz. Scroll down to the video for key takeaways.
- Want to know which half of your advertising spend is wasted? Experimentation to the rescue! Read Tim Wilson’s latest blog post. https://www.searchdiscovery.com/blog/rct-study/
- Is breaking a UX convention worthwhile? Read NN/g’s latest post on maintaining consistency & adhering to standards. https://www.nngroup.com/articles/consistency-and-standards/
- How to get SEO and CRO to dance together? Get AWA Digital’s free e-book. https://www.awa-digital.com/ebook-how-to-get-seo-and-cro-to-dance-together/
- How founders…
While I took a break from writing in the last few weeks, I didn’t take a break from creating experimentation focused content. In December, I began collaborating with Experiment Nation. Spearheaded by Rommil Santiago, Experiment Nation connects experimenters from around the world and is a platform for sharing their experiences and learnings.
So, what is the The Weekly Buzz?
It is a way for busy professionals to stay in touch with the latest in the experimentation space. Every week, I pick 5 important stories covering experimentation news, A/B testing stats, UX research etc. and create a 2-minute video which has bite-sized takeaways from these stories for quick…
I got my Conversion Optimization certification from CXL Institute about two weeks back. And pursuing this course has been quite a journey for me with a lot happening alongside — dealing with the layoff, supporting my daughter’s online schooling, starting this blog and starting off as a freelance consultant. So I am really reveling in the sense of achievement at least for now! It’s also that time of the year. :)
As the conversion optimization (CRO) field matures, I am finding more folks interested in figuring out ways to get some formal education and potentially pursuing the mini-degree. I am…
This blog post is based on Cugelman Emotion Map and draws heavily from his course on “Digital Psychology & Behavioral Design” at CXL Institute.
An emotion is a complex set of physiological changes in response to a perceived threat or opportunity. They’re automatic and mostly unconscious, which is why we’re never fully aware of all the changes we’re experiencing.
Emotions drive behavior or put another way motivation is an emotion that facilitates action. If you have read my previous post on Using Neuromarketing to Drive Conversions, you came across a fascinating study done by researchers at UT Austin where participants were shown photos of two chickens. …
This post explores examples of regression to the mean, what causes it and how to deal with it.
You launch a new A/B test after weeks of planning. Your boss asks you for an update one day into the test and you peek at the results. The test variant is up heavily vs. control! So you tell everyone that the test variant is already outperforming the control. You think your intuition is right — this idea is a winner! You always knew it!
A week later, you are preparing to give an update in the same meeting. You peek at the results and the lift has vanished! What happened? …
In the last few posts, I have introduced basic statistical concepts you need to know for A/B testing. In the last post of this series, I will be covering the concept of statistical power, types of errors and a brief on sample size calculation.
In my last post, we were able to reject the null hypothesis that “Starbucks coffee is not hotter than McDonalds” since the observed p-value of our z-test was lower than the 0.05 p-value we had set apriori.
We also learned that the p-value is the probability of observing results at least as extreme as those measured when the null hypothesis is true or due to random chance. If the observed p-value is less than alpha, then the results are statistically significant i.e. the probability of seeing these results due to random chance is very low.
When we set a 5%…
Building an experimentation culture at your organization is similar to creating and sticking to a good habit. Learn how to apply those lessons.
I watched the Experimentation Culture Awards 2020 a week back and wrote about it. The message from the awards was clear:
“It’s not about that one experiment, it’s about improving the process, structure, trustworthiness, democratization and motivation for experimentation and data-driven decision making.”
As I sat there, I wondered what distinguishes the companies that have or are building an experimentation culture from the ones that are struggling to. At what point does experimentation become second nature at…
Bithika Mehra
On the path to learning all things insights and optimization (linkedin.com/in/bithikamehra) | Foodie | Environmentalist| Loves to travel | Player of a few riffs
