{"id":307,"date":"2020-02-26T15:43:39","date_gmt":"2020-02-26T23:43:39","guid":{"rendered":"https:\/\/grayson.consulting\/blog\/?p=307"},"modified":"2020-02-26T15:43:40","modified_gmt":"2020-02-26T23:43:40","slug":"conversion-rate-optimization-tips-how-to-prioritize-tests","status":"publish","type":"post","link":"https:\/\/grayson.consulting\/blog\/2020\/02\/conversion-rate-optimization-tips-how-to-prioritize-tests\/","title":{"rendered":"Conversion Rate Optimization Tips: How to Prioritize Tests"},"content":{"rendered":"\n<p>You know your business goals. You\u2019ve run the audience research and developed great <a rel=\"noreferrer noopener\" aria-label=\"hypotheses (opens in a new tab)\" href=\"https:\/\/grayson.consulting\/blog\/2019\/12\/how-to-construct-a-hypothesis\/\" target=\"_blank\">hypotheses<\/a>. You\u2019re all set to test, but you have too many tests to choose from. How do you decide on which ones to prioritize?<\/p>\n\n\n\n<p>When prioritizing, it helps to consider:<\/p>\n\n\n\n<ul><li>Impact<\/li><li>Confidence<\/li><li>Scope<\/li><li>Cost<\/li><li>Timeline<\/li><li>Dependencies<\/li><li>Risk<\/li><\/ul>\n\n\n\n<h3>Impact<\/h3>\n\n\n\n<p>Impact is an estimate of how much a winning test will increase your conversions. It\u2019s usually what people think of first when prioritizing tests.<\/p>\n\n\n\n<p>You won\u2019t know the impact of a test before you run it. If you knew that, then you wouldn\u2019t need to run tests. But you can make an educated guess based on what you&#8217;re testing and its influence on conversions.<\/p>\n\n\n\n<p>Big-Impact tests are more attractive than low-impact ones as they move the business forward faster.<\/p>\n\n\n\n<h3>Confidence<\/h3>\n\n\n\n<p>Confidence is a measure of how certain you are that the test will succeed.<\/p>\n\n\n\n<p>Confidence is based on the amount of data you have to support the test idea.<\/p>\n\n\n\n<p>Maybe you have a lot of data that suggests this change is going to work. In which case you\u2019d have high confidence for the test.&nbsp;<\/p>\n\n\n\n<p>On the other hand, maybe it\u2019s a hunch. The data suggests this might be a good idea, but it\u2019s weak data and you don\u2019t really know.<\/p>\n\n\n\n<p>Depending on where you work, it\u2019s usually okay (and sometimes necessary) to run tests with low confidence. But generally speaking, it\u2019s a good idea to mix in high-confidence tests so you avoid a string of poor outcomes.<\/p>\n\n\n\n<h3>Scope<\/h3>\n\n\n\n<p>Scope is an estimate of how much work is needed to complete a project.<\/p>\n\n\n\n<p>A headline test is usually a low scope test. You might be able to write the new headline and set up the test by yourself.<\/p>\n\n\n\n<p>At the other extreme, a total product page redesign is likely to have a high scope because you need a designer, copy writer, developer and QA. Likewise completely reworking a purchase flow is often a very high scope project.<\/p>\n\n\n\n<p>For most conversion rate optimizers, resources are limited. It\u2019s a good idea to preserve resources for the tests that really matter. A scope estimate can help you do that.<\/p>\n\n\n\n<h3>Cost<\/h3>\n\n\n\n<p>One way to measure cost is by estimating how much money is required for a project. Costs can include purchasing software or hiring specialist consultants.<\/p>\n\n\n\n<p>Costs can also refer to opportunity costs. If you run the test, what other projects will be delayed and for how long? There are usually more projects than resources, so this is a common problem.<\/p>\n\n\n\n<h3>Timeline<\/h3>\n\n\n\n<p>How long will it take to get the project live?<\/p>\n\n\n\n<p>If it takes a very long time to get the project live, it may be worth adapting or abandoning it.&nbsp;<\/p>\n\n\n\n<p>With a very long timeline, business needs, requirements, and the competitive landscape might shift enough that your test is no longer relevant by the time it launches.<\/p>\n\n\n\n<h3>Dependencies<\/h3>\n\n\n\n<p>Dependencies between pages and sections on the site can also influence priority lists.<\/p>\n\n\n\n<p>Suppose you were optimizing a site with poor product pages and a terrible purchase flow. Which do you fix first?<\/p>\n\n\n\n<p>Your best strategy would probably be to fix the purchase flow first.&nbsp;<\/p>\n\n\n\n<p>If you improve the product page first, then the test results are likely to be depressed by the poor purchase flow. Some percentage of users will simply give up when confronted with a terrible purchase flow.&nbsp;<\/p>\n\n\n\n<p>In this case, it will be harder to get an accurate read on the impact of the product page changes. In extreme cases, it might even appear that there was no improvement.<\/p>\n\n\n\n<p>But if you improve the purchase flow first, then you can be confident that the purchase flow isn\u2019t artificially depressing your results.<\/p>\n\n\n\n<p>In this case, the product page changes are dependent on fixing the purchase flow.<\/p>\n\n\n\n<p>While I\u2019ve simplified the situation in this example, the logic holds true. A site is a collection of pages that work together. Consider dependencies between pages and site sections when building your priority list.<\/p>\n\n\n\n<h3>Risk<\/h3>\n\n\n\n<p>Every site change has risks. Depending on the change, the risk can be anything from minor to serious.<\/p>\n\n\n\n<p>Before you launch any change, consider the possible negative impacts.&nbsp;For instance, could the test versions negatively impact your audience\u2019s perception of the company?<\/p>\n\n\n\n<p>Also consider any internal political risks. If the test fails, will that be a problem? If it is going to be a problem, is it worth running a few \u201csafer\u201d tests first?<\/p>\n\n\n\n<h3>Bonus: What will you learn?<\/h3>\n\n\n\n<p>I\u2019ve recently added \u201cWhat will I learn?\u201d to my list when thinking about prioritization.<\/p>\n\n\n\n<p>Testing teaches you about your audience. If a test can teach you something valuable about your audience\u2019s motivations or goals, it\u2019s worth considering that when prioritizing. Especially if it is a key question that could alter your testing roadmap.<br><\/p>\n","protected":false},"excerpt":{"rendered":"<p>You know your business goals. You\u2019ve run the audience research and developed great hypotheses. You\u2019re all set to test, but you have too many tests to choose from. How do you decide on which ones to prioritize? When prioritizing, it helps to consider: Impact Confidence Scope Cost Timeline Dependencies Risk Impact Impact is an estimate&hellip;&nbsp;<a href=\"https:\/\/grayson.consulting\/blog\/2020\/02\/conversion-rate-optimization-tips-how-to-prioritize-tests\/\" class=\"\" rel=\"bookmark\">Read More &raquo;<span class=\"screen-reader-text\">Conversion Rate Optimization Tips: How to Prioritize Tests<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"neve_meta_sidebar":"","neve_meta_container":"","neve_meta_enable_content_width":"","neve_meta_content_width":0,"neve_meta_title_alignment":"","neve_meta_author_avatar":"","neve_post_elements_order":"","neve_meta_disable_header":"","neve_meta_disable_footer":"","neve_meta_disable_title":""},"categories":[2],"tags":[20,11,21,22,23,8,4],"_links":{"self":[{"href":"https:\/\/grayson.consulting\/blog\/wp-json\/wp\/v2\/posts\/307"}],"collection":[{"href":"https:\/\/grayson.consulting\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/grayson.consulting\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/grayson.consulting\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/grayson.consulting\/blog\/wp-json\/wp\/v2\/comments?post=307"}],"version-history":[{"count":11,"href":"https:\/\/grayson.consulting\/blog\/wp-json\/wp\/v2\/posts\/307\/revisions"}],"predecessor-version":[{"id":318,"href":"https:\/\/grayson.consulting\/blog\/wp-json\/wp\/v2\/posts\/307\/revisions\/318"}],"wp:attachment":[{"href":"https:\/\/grayson.consulting\/blog\/wp-json\/wp\/v2\/media?parent=307"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/grayson.consulting\/blog\/wp-json\/wp\/v2\/categories?post=307"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/grayson.consulting\/blog\/wp-json\/wp\/v2\/tags?post=307"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}