By: Deborah O’Malley| Last updated September, 2023 Which format outperforms?  To increase conversions, should you use buttons or links? This mini meta analysis explores and answers this question, providing you with tangible takeaways and top test ideas, all in an easy-to-scan and easy-to-implement format. Which version wins? Checkout the mini meta analysis below to find out. (Note, available only to Pro Members or for purchase) Oh, snap! Only Pro Members Have Full Access To This Post Unlock Access. Sign up to become a Pro Member. Get complete access to this helpful content, plus s ..read more

Guest post by: Doug McCaffrey | Last updated September, 2023 The limitations of Google Analytics 4 (GA4) Google Analytics 4 (GA4) is a powerful tool that can help you understand both the performance of your website and the effectiveness of your marketing efforts. However, GA4 does have limitations when it comes to tracking site visitor behaviors - and without this data, reports are either blank or they contain some information but are missing the data points crucial for providing actionable insights. For example, a Traffic Acquisition report lists the various channels visitors use to get ..read more

By: Deborah O’Malley| Last updated August, 2023 Which image format outperforms?  To increase conversions, should you use product or lifestyle photos to showcase and sell your product? This mini meta analysis explores and answers this question, providing you with tangible takeaways and top test ideas, all in an easy-to-scan and easy-to-implement format. Which version wins? Checkout the mini meta analysis below to find out. (Note, available only to Pro Members or for purchase) Oh, snap! Only Pro Members Have Full Access To This Post Unlock Access. Sign up to become a Pro Member. Get ..read more

By: Deborah O'Malley, M.Sc. & Dana DiTomaso | Last updated June, 2023 Overview: In this informative 40-minute video interview, analytics expert, Dana DiTomaso, President of Kick Point, discusses what to do to seamlessly transition from Universal Analytics (UA) and Google Optimize (GO) to Google Analytics 4 (GA4) in a new A/B testing paradigm. You'll learn: What's likely to happen as UA transitions to GA4 and what you should do to keep up as an experimenter. The difference between a session-based and an event-based model, and what impact this transition will have on your experimentation wo ..read more

By: Deborah O’Malley| Last updated June, 2023 B/A testing B/A testing is the opposite of A/B testing. In B/A testing, you take the Baseline conversion rate, form data-driven hypotheses, implement changes, and Assess the conversion rate over a reasonable period of time, based on your sales cycle. If the conversion rate is flat or down, your assessment shows you tweaks need to be made. You then go back to the drawing board, form data-driven hypotheses on what you think is lagging, and change those aspects. Then, again, assess, comparing the Before to ..read more

By: Deborah O'Malley | Last updated September, 2022 What is Minimum Detectable Effect (MDE)? If you've been into experimentation long enough, you've likely come across the term MDE -- which stands for Minimum Detectable Effect (MDE). The MDE sounds big and fancy, but the concept is actually quite simple when you break it down. It's the: Minimum = smallest Effect = conversion difference Detectable = you want to see from running the experiment Why is MDE important? As this GuessTheTest article explains, in order to run a trustworthy experiment -- one that's properly powered experiment ..read more

By: Deborah O'Malley | Last updated August, 2022 With a special contribution from Ishan Goel Overview An astounding +364% lift in conversions, an enormous +337 improvement in clickthrough rate, and cruelly disappointing -47% drop in for submissions. What do all these jaw-dropping conversion rates have in common? They’re all extreme results! And, as this article explains, they’re probably not real. Because, according to something known as Twyman’s Law, anytime a result looks interesting or unusual, it’s usually wrong.  The trustworthiness is suspect. Example of +364% lift in conver ..read more

A/B Test Case Studies help business owners to understand their business and find out where they can improve. It is an easy-to-use tool that allows businesses to compare different approaches, such as changes in pricing, on the same website or landing page, or with the same marketing campaign. In this blog, you know very well what is A/B Test Case Studies and how A/B Test Case Studies Help to Analyze Your Business, and what is the benefits of A/B Test Case Studies. Nowadays, A/B Test Case Studies are one of the most common tools used for business analysis. A/B Testing is a method of testing a pr ..read more

By: Deborah O'Malley, M.Sc. & Timothy Chan, Ph.D. | Last updated May, 2022 Overview Awesome! You’ve just run an A/B test, crunched the numbers, and achieved a statistically significant result. It’s time to celebrate. You’ve got another test win. ? Or have you? As this article explains, understanding and calculating statistical significance is actually quite complex. Many experimenters don’t truly know what statistical significance is or how to derive a statistically significant test result. Statistical significance is the standard, accepted way to declare a winning test. It helps us ..read more

By: Deborah O'Malley, M.Sc. | Last updated May, 2022 Nav bars defined A Navigational Menu, also known as a navigational bar, or nav bar, is a menu system, usually located at the top of a website. Its purpose is to help users find categories of interest and access key pages on a website. The nav bar is usually organized into relevant sections and may have a dropdown menu or sub-sections directly below. Most have clear section and sub-section menu titles. These titles should state what the users will get, or where the user will arrive, by clicking into the menu category. A typical nav menu ..read more