{"id":5442,"date":"2023-10-25T21:04:55","date_gmt":"2023-10-25T21:04:55","guid":{"rendered":"https:\/\/conversion.com\/?p=5442"},"modified":"2025-01-24T18:26:29","modified_gmt":"2025-01-24T18:26:29","slug":"holiday-testing","status":"publish","type":"post","link":"https:\/\/conversion.com\/blog\/holiday-testing\/","title":{"rendered":"A\/B Testing During Black Friday Promotions"},"content":{"rendered":"<section class=\"c-post-content\" data-ref=\"case-content\">\n\t<div class=\"post-content\">\n\t\t<div class=\"post-content__container container container--medium\">\n\t\t\t<aside class=\"post-content__sidebar post-content__sidebar--links\">\n\t\t\t\t<div class=\"sticky-menu\" data-ref=\"case-content-menu\">\n\t\t\t\t\t<h3 class=\"sticky-menu__title\">Contents<\/h3>\n\t\t\t\t\t<ul class=\"sticky-menu\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t                            \t\t\t\t\t\t\t<li class=\"sticky-menu__item\">\n\t\t\t\t\t\t\t\t<a class=\"sticky-menu__item-link  active\" href=\"#introduction\" data-ref=\"case-content-menu-item\">\n\t\t\t\t\t\t\t\t\t<span class=\"arrow\"><svg viewBox=\"0 0 16 20\" fill=\"none\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\"><path d=\"M10.6875 9.34375V7.34375L13.3438 10L10.6875 12.6562V10.6562H2.65625V9.34375H10.6875Z\" fill=\"#F6876F\"\/><\/svg><\/span>\n\t\t\t\t\t\t\t\t\t<span class=\"sticky-menu__item-text\">Introduction<\/span>\n\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t<\/li>\n\t\t\t\t\t\t\t\t\t\t\t\t\t                            \t\t\t\t\t\t\t<li class=\"sticky-menu__item\">\n\t\t\t\t\t\t\t\t<a class=\"sticky-menu__item-link \" href=\"#thebjfoggmodelunderstandingconsumerbehaviorstotestbetter\" data-ref=\"case-content-menu-item\">\n\t\t\t\t\t\t\t\t\t<span class=\"arrow\"><svg viewBox=\"0 0 16 20\" fill=\"none\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\"><path d=\"M10.6875 9.34375V7.34375L13.3438 10L10.6875 12.6562V10.6562H2.65625V9.34375H10.6875Z\" fill=\"#F6876F\"\/><\/svg><\/span>\n\t\t\t\t\t\t\t\t\t<span class=\"sticky-menu__item-text\">The BJ Fogg Model: Understanding consumer behaviors to test better<\/span>\n\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t<\/li>\n\t\t\t\t\t\t\t\t\t\t\t\t\t                            \t\t\t\t\t\t\t<li class=\"sticky-menu__item\">\n\t\t\t\t\t\t\t\t<a class=\"sticky-menu__item-link \" href=\"#externalityandthebjfoggmodelcapturingtheboostonblackfriday\" data-ref=\"case-content-menu-item\">\n\t\t\t\t\t\t\t\t\t<span class=\"arrow\"><svg viewBox=\"0 0 16 20\" fill=\"none\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\"><path d=\"M10.6875 9.34375V7.34375L13.3438 10L10.6875 12.6562V10.6562H2.65625V9.34375H10.6875Z\" fill=\"#F6876F\"\/><\/svg><\/span>\n\t\t\t\t\t\t\t\t\t<span class=\"sticky-menu__item-text\">Externality and the Bj Fogg Model: Capturing the Boost on Black Friday<\/span>\n\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t<\/li>\n\t\t\t\t\t\t\t\t\t\t\t\t\t                            \t\t\t\t\t\t\t<li class=\"sticky-menu__item\">\n\t\t\t\t\t\t\t\t<a class=\"sticky-menu__item-link \" href=\"#customerinsightsintroducingnewshopperstoyourbrand\" data-ref=\"case-content-menu-item\">\n\t\t\t\t\t\t\t\t\t<span class=\"arrow\"><svg viewBox=\"0 0 16 20\" fill=\"none\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\"><path d=\"M10.6875 9.34375V7.34375L13.3438 10L10.6875 12.6562V10.6562H2.65625V9.34375H10.6875Z\" fill=\"#F6876F\"\/><\/svg><\/span>\n\t\t\t\t\t\t\t\t\t<span class=\"sticky-menu__item-text\">Customer Insights: Introducing new Shoppers to your Brand<\/span>\n\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t<\/li>\n\t\t\t\t\t\t\t\t\t\t\t\t\t                            \t\t\t\t\t\t\t<li class=\"sticky-menu__item\">\n\t\t\t\t\t\t\t\t<a class=\"sticky-menu__item-link \" href=\"#\" data-ref=\"case-content-menu-item\">\n\t\t\t\t\t\t\t\t\t<span class=\"arrow\"><svg viewBox=\"0 0 16 20\" fill=\"none\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\"><path d=\"M10.6875 9.34375V7.34375L13.3438 10L10.6875 12.6562V10.6562H2.65625V9.34375H10.6875Z\" fill=\"#F6876F\"\/><\/svg><\/span>\n\t\t\t\t\t\t\t\t\t<span class=\"sticky-menu__item-text\"><\/span>\n\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t<\/li>\n\t\t\t\t\t\t\t\t\t\t\t<\/ul>\n\t\t\t\t<\/div>\n\t\t\t<\/aside>\n\n\t\t\t<div class=\"post-content__content\">\n\t\t\t\t<ul class=\"post-content__sections\">\n\t\t\t\t\t                        \t\t\t\t\t\t<li class=\"post-content__section\" id=\"introduction\" data-ref=\"case-content-item\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<div class=\"post-content__section-content\"><p>&nbsp;<\/p>\n<p>Black Friday, and its counterpart Cyber Monday, are some of the largest consumer transaction days for the American economy. Shoppers come out in droves to either complete their holiday shopping, upgrade large ticket appliances\/electronics, or just take advantage of great deals and promotions. Those of us who have ventured to participate in Black Friday or Cyber Monday have experienced long lineups in every part of the retail process, and even worse: slow and buggy websites.<\/p>\n<p>However, many of us are so motivated by the fear of missing out on a great deal that we are willing to put up with seemingly anything to check off our holiday shopping list! Let\u2019s take a closer look at why this happens, and how companies can build a testing and shopping experience around it to better understand their shoppers and lift conversion rates throughout the year.<\/p>\n<\/div>\n\t\t\t\t\t\t\t\t\t\t\t\t\t<\/li>\n\t\t\t\t\t\t\t\t\t\t\t\t\t<div class=\"post-content__index\">\n\t\t\t\t\t\t\t\t<h3 class=\"post-content__index-title\">Contents<\/h3>\n\t\t\t\t\t\t\t\t<ul class=\"post-content__index-links\" data-ref=\"case-content-menu\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<li class=\"post-content__index-link\">\n\t\t\t\t\t\t\t\t\t\t\t<a href=\"#introduction\" data-ref=\"case-content-menu-item\">\n\t\t\t\t\t\t\t\t\t\t\t\tIntroduction\n\t\t\t\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t\t\t\t<\/li>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<li class=\"post-content__index-link\">\n\t\t\t\t\t\t\t\t\t\t\t<a href=\"#thebjfoggmodelunderstandingconsumerbehaviorstotestbetter\" data-ref=\"case-content-menu-item\">\n\t\t\t\t\t\t\t\t\t\t\t\tThe BJ Fogg Model: Understanding consumer behaviors to test better\n\t\t\t\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t\t\t\t<\/li>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<li class=\"post-content__index-link\">\n\t\t\t\t\t\t\t\t\t\t\t<a href=\"#externalityandthebjfoggmodelcapturingtheboostonblackfriday\" data-ref=\"case-content-menu-item\">\n\t\t\t\t\t\t\t\t\t\t\t\tExternality and the Bj Fogg Model: Capturing the Boost on Black Friday\n\t\t\t\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t\t\t\t<\/li>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<li class=\"post-content__index-link\">\n\t\t\t\t\t\t\t\t\t\t\t<a href=\"#customerinsightsintroducingnewshopperstoyourbrand\" data-ref=\"case-content-menu-item\">\n\t\t\t\t\t\t\t\t\t\t\t\tCustomer Insights: Introducing new Shoppers to your Brand\n\t\t\t\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t\t\t\t<\/li>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<li class=\"post-content__index-link\">\n\t\t\t\t\t\t\t\t\t\t\t<a href=\"#\" data-ref=\"case-content-menu-item\">\n\t\t\t\t\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t\t\t\t<\/li>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/ul>\n\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\t\t\t                        \t\t\t\t\t\t<li class=\"post-content__section\" id=\"thebjfoggmodelunderstandingconsumerbehaviorstotestbetter\" data-ref=\"case-content-item\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<h2 class=\"post-content__section-title\">The BJ Fogg Model: Understanding consumer behaviors to test better<\/h2>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<div class=\"post-content__section-content\"><p>The<a href=\"https:\/\/behaviormodel.org\/\"> BJ Fogg mode<\/a>l can help companies understand persuasive design and user behavior. The three parts of this model are \u201cMotivation\u201d up the y axis, \u201cAbility\u201d across the x , and an action line curve in the model as illustrated below:<\/p>\n<p><img decoding=\"async\" class=\"aligncenter size-full wp-image-5449\" src=\"https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/fogg-behavioral-Model-1.png\" alt=\"\" width=\"1920\" height=\"865\" srcset=\"https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/fogg-behavioral-Model-1.png 1920w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/fogg-behavioral-Model-1-300x135.png 300w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/fogg-behavioral-Model-1-1024x461.png 1024w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/fogg-behavioral-Model-1-768x346.png 768w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/fogg-behavioral-Model-1-1536x692.png 1536w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/fogg-behavioral-Model-1-1600x721.png 1600w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/fogg-behavioral-Model-1-800x360.png 800w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/fogg-behavioral-Model-1-400x180.png 400w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/fogg-behavioral-Model-1-1440x649.png 1440w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/fogg-behavioral-Model-1-720x324.png 720w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/fogg-behavioral-Model-1-360x162.png 360w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/fogg-behavioral-Model-1-920x414.png 920w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/fogg-behavioral-Model-1-460x207.png 460w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/fogg-behavioral-Model-1-230x104.png 230w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/fogg-behavioral-Model-1-115x52.png 115w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/fogg-behavioral-Model-1-1140x514.png 1140w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/fogg-behavioral-Model-1-570x257.png 570w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/fogg-behavioral-Model-1-285x128.png 285w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/fogg-behavioral-Model-1-142x64.png 142w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/fogg-behavioral-Model-1-100x45.png 100w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/fogg-behavioral-Model-1-50x23.png 50w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/fogg-behavioral-Model-1-25x11.png 25w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/fogg-behavioral-Model-1-12x5.png 12w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/fogg-behavioral-Model-1-1670x752.png 1670w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/fogg-behavioral-Model-1-835x376.png 835w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/fogg-behavioral-Model-1-417x188.png 417w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/fogg-behavioral-Model-1-208x94.png 208w\" sizes=\"(max-width: 1920px) 100vw, 1920px\" \/><\/p>\n<p>What the BFM tells us is that:<\/p>\n<ol>\n<li>If you have low motivation to do something, but that thing is \u201ceasy to do\u201d, there is a strong likelihood that you would do it<\/li>\n<li>If something is \u201dhard to do\u201d, but you are highly motivated to do it then you are also likely to put up with the difficulty and still do it<\/li>\n<\/ol>\n<p>What we help our partners do with experimentation, is take the baseline point which sits somewhere in the space along the axis of the Fogg model, and move the desired action above the action line, it is here where the user is most likely to convert and complete their checkout journey. If the desired action remains below the action line, then the shopper is much less likely to convert.<\/p>\n<p>How do we do this? We can think of the optimizations we make to a website as focused on improving a user\u2019s motivation to convert, ability to convert, or both.<\/p>\n<p>Hypotheses aimed at improving a user\u2019s ability to convert may be focused around reducing steps in the funnel or process, improving product discoverability, or increasing ease of use on the site.<\/p>\n<p>Alternatively, hypotheses aimed at improving a user\u2019s motivation to convert may be focused around improving the value perception of the product, presence and depth of product information, or &#8211; you guessed it &#8211; sales (an urgency tactic).<\/p>\n<\/div>\n\t\t\t\t\t\t\t\t\t\t\t\t\t<\/li>\n\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\t\t\t                        \t\t\t\t\t\t<li class=\"post-content__section\" id=\"externalityandthebjfoggmodelcapturingtheboostonblackfriday\" data-ref=\"case-content-item\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<h2 class=\"post-content__section-title\">Externality and the Bj Fogg Model: Capturing the Boost on Black Friday<\/h2>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<div class=\"post-content__section-content\"><p>Events like Black Friday are unique in that they cause a dramatic shake-up in both user motivation &amp; ability, creating an opportunity to convert individuals who may otherwise be below the action line.<\/p>\n<p>We can see below the substantial shift in the model, with shoppers becoming highly motivated during the Black Friday period, however the ability to shop during this period also decreases. This can be because of long lineups at crowded stores, or websites experiencing an influx of traffic and rapidly fluctuating stock levels that makes them slow, unresponsive, or unreliable.<\/p>\n<p><img decoding=\"async\" class=\"aligncenter size-full wp-image-5448\" src=\"https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-2.png\" alt=\"\" width=\"1920\" height=\"865\" srcset=\"https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-2.png 1920w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-2-300x135.png 300w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-2-1024x461.png 1024w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-2-768x346.png 768w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-2-1536x692.png 1536w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-2-1600x721.png 1600w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-2-800x360.png 800w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-2-400x180.png 400w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-2-1440x649.png 1440w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-2-720x324.png 720w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-2-360x162.png 360w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-2-920x414.png 920w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-2-460x207.png 460w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-2-230x104.png 230w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-2-115x52.png 115w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-2-1140x514.png 1140w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-2-570x257.png 570w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-2-285x128.png 285w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-2-142x64.png 142w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-2-100x45.png 100w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-2-50x23.png 50w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-2-25x11.png 25w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-2-12x5.png 12w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-2-1670x752.png 1670w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-2-835x376.png 835w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-2-417x188.png 417w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-2-208x94.png 208w\" sizes=\"(max-width: 1920px) 100vw, 1920px\" \/><\/p>\n<p>The focus here should be on increasing the shoppers ability to purchase and not their motivation, as their motivation is already at very high levels. We can see in the graphic below that moving a user along the ability axis is most likely to make the shopper convert, while making equivalent improvements in motivation will still likely not yield any conversion. We are experiencing diminished returns on motivation.<\/p>\n<p><img decoding=\"async\" class=\"aligncenter size-full wp-image-5447\" src=\"https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-3.png\" alt=\"\" width=\"1920\" height=\"896\" srcset=\"https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-3.png 1920w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-3-300x140.png 300w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-3-1024x478.png 1024w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-3-768x358.png 768w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-3-1536x717.png 1536w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-3-1600x747.png 1600w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-3-800x373.png 800w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-3-400x187.png 400w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-3-1440x672.png 1440w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-3-720x336.png 720w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-3-360x168.png 360w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-3-920x429.png 920w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-3-460x215.png 460w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-3-230x107.png 230w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-3-115x54.png 115w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-3-1140x532.png 1140w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-3-570x266.png 570w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-3-285x133.png 285w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-3-142x66.png 142w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-3-100x47.png 100w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-3-50x23.png 50w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-3-25x12.png 25w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-3-12x6.png 12w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-3-1670x779.png 1670w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-3-835x390.png 835w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-3-417x195.png 417w, https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/BJ-fogg-Model-3-208x97.png 208w\" sizes=\"(max-width: 1920px) 100vw, 1920px\" \/><\/p>\n<p>Black Friday and Cyber Monday can sometimes see an expected<a href=\"https:\/\/abcnews.go.com\/Business\/black-friday-hits-record-report\/story?id=74435965\"> 173%-380% increase<\/a> in sales. A massive increase no retailer can afford to ignore! As such, many retailers with an e-commerce presence will have developed plans for Black Friday far in advance, whether it be items they wish to feature or customized items stocked directly for the event.<\/p>\n<p>As a result, users are flocking to shop online with a heightened motivation to purchase. They likely have a product (or a list of products) they\u2019re looking to shop for and while price will be the key driver of their purchase decision, the ability to purchase will also play an important role.<\/p>\n<p>Historically, some companies might be hesitant to test during Black Friday &#8212; the reason being they don&#8217;t want to \u201cbreak something\u201d, and consequently risk losing customers because of a sub-optimal process. Some companies will institute a \u201ccode freeze\u201d on Black Friday\/Cyber Monday, where no new code is to be added to a site at all for a period of 1-2 weeks around the actual date in an attempt to mitigate the risk of any unintentional website performance issues caused by new code releases.<\/p>\n<p>With more mature experimentation programs, we have seen companies capitalize on Black Friday to run tests that help them gain critical new insights and maximize the impact of their site performance which pays dividends over the long term.<\/p>\n<p>While it&#8217;s entirely reasonable to acknowledge the potential risk of testing through the Black Friday period as we have already mentioned, there also exists a large opportunity cost if choosing not to test during this time.<\/p>\n<p>By not experimenting on this surge of traffic and conversions, you\u2019re not only missing a high volume of users to test on, you\u2019re also essentially making a bold statement that your website as it exists today is the most optimal and performant version of your site &#8211; which as optimizers we know is never the case!<\/p>\n<p>While there is a risk of running a test and sending traffic to a sub optimal Variation A or Variation B, there is also the risk that your control IS the sub optimal experience and you\u2019re missing out on the big gains throughout the year by not capitalizing on the opportunity of Black Friday testing.<\/p>\n<p>So how do we mitigate the risk? Companies can focus on testing methodologies like a Multi Armed Bandit (MAB) through this time period. A MAB automatically diverts traffic to the better performing variation in your experiment. You gain fewer insights, because traffic is automatically diverted to the best performing variation, however revenue generation is maximized and risk is mitigated. If a variation (or your control!) is underperforming, the algorithm figures it out and reduces the traffic exposed to that version during the test period. Sounds pretty optimal for a critical time like Black Friday doesn\u2019t it?<\/p>\n<p>The MAB strategy may be the better option for a momentary period of high externality like Black Friday, as the question still remains how representative shopper behavior is during this time. As we demonstrated above, users are likely far more motivated in this period than on average. As a result, the tactics and variations that perform best during Black Friday may not be the best tactics during normal periods. For this reason, you may choose to revalidate some winners from MAB testing in a different period after the holidays to uncover even more insight about the differences in your shopper behaviors during these periods. The difference in performance post-externality could be a big unlock for what you do next year.<\/p>\n<p>If you choose not to test during the Black Friday\/Cyber Monday shopping period, you can still take this time to learn about users through qualitative research. Interviews can be conducted at a later date with some of the shoppers that chose to visit your site during the Black Friday\/Cyber Monday period for further external insights.<\/p>\n<\/div>\n\t\t\t\t\t\t\t\t\t\t\t\t\t<\/li>\n\t\t\t\t\t\t\n\t\t\t\t\t\t                            <div data-target=\"post-newsletter-anchor\" data-device=\"mobile\"><\/div>\n                        \t\t\t\t\t                        \t\t\t\t\t\t<li class=\"post-content__section\" id=\"customerinsightsintroducingnewshopperstoyourbrand\" data-ref=\"case-content-item\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<h2 class=\"post-content__section-title\">Customer Insights: Introducing new Shoppers to your Brand<\/h2>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<div class=\"post-content__section-content\"><p>Customer insights can help you develop future tests and even help inform brand strategy. Many shoppers will be newly introduced to your site during the uptick in visits during Black Friday and Cyber Monday. Conducting experiments and testing during that time period can help you gain new insights about these users with the potential of turning them into repeat customers.<\/p>\n<p>Ready to learn more about how Conversion can help you with your CRO efforts, including testing during the holidays? <a href=\"https:\/\/conversion.com\/contact\/\">Get in touch<\/a> with our team today.<\/p>\n<\/div>\n\t\t\t\t\t\t\t\t\t\t\t\t\t<\/li>\n\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\t\t\t                        \t\t\t\t\t\t<li class=\"post-content__section\" id=\"\" data-ref=\"case-content-item\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/li>\n\t\t\t\t\t\t\n\t\t\t\t\t\t                            <div data-target=\"post-newsletter-anchor\" data-device=\"mobile\"><\/div>\n                        \t\t\t\t\t\n\t\t\t\t<\/ul>\n\t\t\t<\/div>\n\n\t\t\t<aside class=\"post-content__sidebar post-content__sidebar--form\">\n\t\t\t\t<div class=\"sticky-newsletter\" data-target=\"post-newsletter-anchor\" data-device=\"desktop\">\n                \t<div class=\"post-newsletter\" data-target=\"post-newsletter\">\n    <h4 class=\"post-newsletter__title\">Real-world growth experiments. In your inbox. Every week. <\/h4>\n            <div class=\"post-newsletter__form post-newsletter__form--world kam-world\">\n        <script charset=\"utf-8\" type=\"text\/javascript\" src=\"\/\/js.hsforms.net\/forms\/embed\/v2.js\"><\/script> <script>   hbspt.forms.create({     region: \"na1\",     portalId: \"9358319\",     formId: \"4e927e03-4f90-466a-8646-7f94947f860c\"   }); <\/script>\n    <\/div>\n            <div class=\"post-newsletter__form post-newsletter__form--uk-us kam-uk-us\">\n            <script charset=\"utf-8\" type=\"text\/javascript\" src=\"\/\/js.hsforms.net\/forms\/embed\/v2.js\"><\/script><script>hbspt.forms.create({ region: \"na1\", portalId: \"9358319\", formId: \"03e799e7-ee63-4857-9182-cb3a687dba40\" });<\/script>\n        <\/div>\n        <div class=\"post-newsletter__terms\"><p>Join 5,000+ optimizers who subscribe to our content<\/p>\n<\/div>\n<\/div>\n\t\t\t\t<\/div>\n            <\/aside>\n\t\t<\/div>\n\t<\/div>\n<\/section>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":62,"featured_media":5443,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"content-type":"","footnotes":""},"categories":[12],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v21.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>A\/B Testing During Black Friday Promotions | Conversion<\/title>\n<meta name=\"description\" content=\"Mature experimentation programs can capitalize on Black Friday to discover new customer insights and the most performant version of their website.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/conversion.com\/blog\/holiday-testing\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"A\/B Testing During Black Friday Promotions | Conversion\" \/>\n<meta property=\"og:description\" content=\"Mature experimentation programs can capitalize on Black Friday to discover new customer insights and the most performant version of their website.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/conversion.com\/blog\/holiday-testing\/\" \/>\n<meta property=\"og:site_name\" content=\"Conversion\" \/>\n<meta property=\"article:published_time\" content=\"2023-10-25T21:04:55+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-01-24T18:26:29+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/AB-testing-during-black-friday_feature_1580x830.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1580\" \/>\n\t<meta property=\"og:image:height\" content=\"830\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"James Flory\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"James Flory\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/conversion.com\/blog\/holiday-testing\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/conversion.com\/blog\/holiday-testing\/\"},\"author\":{\"name\":\"James Flory\",\"@id\":\"https:\/\/conversion.com\/#\/schema\/person\/843da25bf5d8480f182badf116cc1b4d\"},\"headline\":\"A\/B Testing During Black Friday Promotions\",\"datePublished\":\"2023-10-25T21:04:55+00:00\",\"dateModified\":\"2025-01-24T18:26:29+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/conversion.com\/blog\/holiday-testing\/\"},\"wordCount\":7,\"publisher\":{\"@id\":\"https:\/\/conversion.com\/#organization\"},\"articleSection\":[\"Conversion Optimization\"],\"inLanguage\":\"en-GB\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/conversion.com\/blog\/holiday-testing\/\",\"url\":\"https:\/\/conversion.com\/blog\/holiday-testing\/\",\"name\":\"A\/B Testing During Black Friday Promotions | Conversion\",\"isPartOf\":{\"@id\":\"https:\/\/conversion.com\/#website\"},\"datePublished\":\"2023-10-25T21:04:55+00:00\",\"dateModified\":\"2025-01-24T18:26:29+00:00\",\"description\":\"Mature experimentation programs can capitalize on Black Friday to discover new customer insights and the most performant version of their website.\",\"breadcrumb\":{\"@id\":\"https:\/\/conversion.com\/blog\/holiday-testing\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/conversion.com\/blog\/holiday-testing\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/conversion.com\/blog\/holiday-testing\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/conversion.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"A\/B Testing During Black Frida&hellip;\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/conversion.com\/#website\",\"url\":\"https:\/\/conversion.com\/\",\"name\":\"Conversion\",\"description\":\"Better results with evidence\",\"publisher\":{\"@id\":\"https:\/\/conversion.com\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/conversion.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/conversion.com\/#organization\",\"name\":\"Conversion\",\"url\":\"https:\/\/conversion.com\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/conversion.com\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/conversion.com\/wp-content\/uploads\/2022\/12\/Colour-Logo.png\",\"contentUrl\":\"https:\/\/conversion.com\/wp-content\/uploads\/2022\/12\/Colour-Logo.png\",\"width\":1821,\"height\":193,\"caption\":\"Conversion\"},\"image\":{\"@id\":\"https:\/\/conversion.com\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/conversion.com\/#\/schema\/person\/843da25bf5d8480f182badf116cc1b4d\",\"name\":\"James Flory\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/conversion.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/30287cbe25c2d5bb42ba74b00f2223af?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/30287cbe25c2d5bb42ba74b00f2223af?s=96&d=mm&r=g\",\"caption\":\"James Flory\"},\"url\":\"https:\/\/conversion.com\/blog\/author\/james-flory\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"A\/B Testing During Black Friday Promotions | Conversion","description":"Mature experimentation programs can capitalize on Black Friday to discover new customer insights and the most performant version of their website.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/conversion.com\/blog\/holiday-testing\/","og_locale":"en_GB","og_type":"article","og_title":"A\/B Testing During Black Friday Promotions | Conversion","og_description":"Mature experimentation programs can capitalize on Black Friday to discover new customer insights and the most performant version of their website.","og_url":"https:\/\/conversion.com\/blog\/holiday-testing\/","og_site_name":"Conversion","article_published_time":"2023-10-25T21:04:55+00:00","article_modified_time":"2025-01-24T18:26:29+00:00","og_image":[{"width":1580,"height":830,"url":"https:\/\/conversion.com\/wp-content\/uploads\/2023\/10\/AB-testing-during-black-friday_feature_1580x830.jpg","type":"image\/jpeg"}],"author":"James Flory","twitter_card":"summary_large_image","twitter_misc":{"Written by":"James Flory"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/conversion.com\/blog\/holiday-testing\/#article","isPartOf":{"@id":"https:\/\/conversion.com\/blog\/holiday-testing\/"},"author":{"name":"James Flory","@id":"https:\/\/conversion.com\/#\/schema\/person\/843da25bf5d8480f182badf116cc1b4d"},"headline":"A\/B Testing During Black Friday Promotions","datePublished":"2023-10-25T21:04:55+00:00","dateModified":"2025-01-24T18:26:29+00:00","mainEntityOfPage":{"@id":"https:\/\/conversion.com\/blog\/holiday-testing\/"},"wordCount":7,"publisher":{"@id":"https:\/\/conversion.com\/#organization"},"articleSection":["Conversion Optimization"],"inLanguage":"en-GB"},{"@type":"WebPage","@id":"https:\/\/conversion.com\/blog\/holiday-testing\/","url":"https:\/\/conversion.com\/blog\/holiday-testing\/","name":"A\/B Testing During Black Friday Promotions | Conversion","isPartOf":{"@id":"https:\/\/conversion.com\/#website"},"datePublished":"2023-10-25T21:04:55+00:00","dateModified":"2025-01-24T18:26:29+00:00","description":"Mature experimentation programs can capitalize on Black Friday to discover new customer insights and the most performant version of their website.","breadcrumb":{"@id":"https:\/\/conversion.com\/blog\/holiday-testing\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/conversion.com\/blog\/holiday-testing\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/conversion.com\/blog\/holiday-testing\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/conversion.com\/"},{"@type":"ListItem","position":2,"name":"A\/B Testing During Black Frida&hellip;"}]},{"@type":"WebSite","@id":"https:\/\/conversion.com\/#website","url":"https:\/\/conversion.com\/","name":"Conversion","description":"Better results with evidence","publisher":{"@id":"https:\/\/conversion.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/conversion.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-GB"},{"@type":"Organization","@id":"https:\/\/conversion.com\/#organization","name":"Conversion","url":"https:\/\/conversion.com\/","logo":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/conversion.com\/#\/schema\/logo\/image\/","url":"https:\/\/conversion.com\/wp-content\/uploads\/2022\/12\/Colour-Logo.png","contentUrl":"https:\/\/conversion.com\/wp-content\/uploads\/2022\/12\/Colour-Logo.png","width":1821,"height":193,"caption":"Conversion"},"image":{"@id":"https:\/\/conversion.com\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/conversion.com\/#\/schema\/person\/843da25bf5d8480f182badf116cc1b4d","name":"James Flory","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/conversion.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/30287cbe25c2d5bb42ba74b00f2223af?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/30287cbe25c2d5bb42ba74b00f2223af?s=96&d=mm&r=g","caption":"James Flory"},"url":"https:\/\/conversion.com\/blog\/author\/james-flory\/"}]}},"_links":{"self":[{"href":"https:\/\/conversion.com\/wp-json\/wp\/v2\/posts\/5442"}],"collection":[{"href":"https:\/\/conversion.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/conversion.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/conversion.com\/wp-json\/wp\/v2\/users\/62"}],"replies":[{"embeddable":true,"href":"https:\/\/conversion.com\/wp-json\/wp\/v2\/comments?post=5442"}],"version-history":[{"count":25,"href":"https:\/\/conversion.com\/wp-json\/wp\/v2\/posts\/5442\/revisions"}],"predecessor-version":[{"id":8156,"href":"https:\/\/conversion.com\/wp-json\/wp\/v2\/posts\/5442\/revisions\/8156"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/conversion.com\/wp-json\/wp\/v2\/media\/5443"}],"wp:attachment":[{"href":"https:\/\/conversion.com\/wp-json\/wp\/v2\/media?parent=5442"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/conversion.com\/wp-json\/wp\/v2\/categories?post=5442"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}