{"id":9394,"date":"2020-10-20T11:56:00","date_gmt":"2020-10-20T11:56:00","guid":{"rendered":"https:\/\/smarter-ecommerce.com\/blog\/en\/?p=9394"},"modified":"2022-06-24T12:04:13","modified_gmt":"2022-06-24T12:04:13","slug":"testing-the-solution-ai-based-bidding-goes-live-in-google-shopping","status":"publish","type":"post","link":"https:\/\/smarter-ecommerce.com\/blog\/en\/data-science\/testing-the-solution-ai-based-bidding-goes-live-in-google-shopping\/","title":{"rendered":"Testing the solution: AI-based bidding goes live in Google Shopping"},"content":{"rendered":"\n<p>In my last\u00a0<a href=\"https:\/\/smarter-ecommerce.com\/blog\/en\/data-science\/designing-the-solution-ai-based-item-level-bidding-automation-in-google-shopping\/\" target=\"_blank\" rel=\"noreferrer noopener\">post<\/a>, I discussed the challenging task of automated, item-level bidding in Google Shopping, and revealed how smec\u2019s data science team goes about designing an AI-based solution.<\/p>\n\n\n\n<p>We start by clearly defining the problem and choosing the appropriate data, and then we engineer this data to make it as useful as possible for our machine learning models. Next, we build and train those models, and tweak them to perfection. It\u2019s a great sneak-peek into the daily life of a data scientist in an industry setting, so if you haven\u2019t read it yet, take a look.<\/p>\n\n\n\n<p>Whenever we build or improve on a machine learning model, we need to thoroughly test it to ensure it benefits all customers. We\u2019ve developed a testing pipeline inspired by the pharmaceutical industry to do just that. Just like in a medical clinical trial, a proposed new drug must move through three stages and show real benefits at each one.<\/p>\n\n\n\n<p>To see how our testing procedure reflects this, let\u2019s walk through it with a hypothetical case study: introducing a new input feature to a model.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"457\" src=\"https:\/\/smarter-ecommerce.com\/blog\/en\/wp-content\/uploads\/2020\/10\/The-3-stages-of-testing-1024x457.png\" alt=\"\" class=\"wp-image-7609\" srcset=\"https:\/\/smarter-ecommerce.com\/blog\/en\/wp-content\/uploads\/2020\/10\/The-3-stages-of-testing-1024x457.png 1024w, https:\/\/smarter-ecommerce.com\/blog\/en\/wp-content\/uploads\/2020\/10\/The-3-stages-of-testing-300x134.png 300w, https:\/\/smarter-ecommerce.com\/blog\/en\/wp-content\/uploads\/2020\/10\/The-3-stages-of-testing-768x343.png 768w, https:\/\/smarter-ecommerce.com\/blog\/en\/wp-content\/uploads\/2020\/10\/The-3-stages-of-testing-1536x685.png 1536w, https:\/\/smarter-ecommerce.com\/blog\/en\/wp-content\/uploads\/2020\/10\/The-3-stages-of-testing-2048x914.png 2048w, https:\/\/smarter-ecommerce.com\/blog\/en\/wp-content\/uploads\/2020\/10\/The-3-stages-of-testing-640x286.png 640w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption>Our three stages of testing ensure \nimprovement at every step.<\/figcaption><\/figure>\n\n\n\n<p>For those who need a recap from the last post, our AI solution automatically generates item-level bids for any product in a retailer\u2019s inventory, on any browsing device, at any time. To do this, we train various machine learning algorithms to predict certain aspects of performance, which are used to calculate the best possible bid.<\/p>\n\n\n\n<p>The training data consists of \u2018features\u2019, carefully chosen aspects of the catalog and performance data. Each time we develop a new input feature for our models, we must test its effectiveness, before we can finally deploy the change.<\/p>\n\n\n\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_82_2 counter-hierarchy ez-toc-counter ez-toc-grey ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\"><p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<\/div><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/smarter-ecommerce.com\/blog\/en\/data-science\/testing-the-solution-ai-based-bidding-goes-live-in-google-shopping\/#stage-1-offline-evaluation\" >Stage 1: Offline Evaluation<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/smarter-ecommerce.com\/blog\/en\/data-science\/testing-the-solution-ai-based-bidding-goes-live-in-google-shopping\/#stage-2-dry-run\" >Stage 2: Dry-Run<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/smarter-ecommerce.com\/blog\/en\/data-science\/testing-the-solution-ai-based-bidding-goes-live-in-google-shopping\/#stage-3-ab-testing\" >Stage 3: A\/B Testing<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/smarter-ecommerce.com\/blog\/en\/data-science\/testing-the-solution-ai-based-bidding-goes-live-in-google-shopping\/#going-live-doesnt-mean-%e2%80%98set-and-forget\" >Going live doesn\u2019t mean \u2018Set and forget\u2019<\/a><\/li><\/ul><\/nav><\/div>\n<h2 class=\"wp-block-heading\" id=\"h-stage-1-offline-evaluation\"><span class=\"ez-toc-section\" id=\"stage-1-offline-evaluation\"><\/span><strong>Stage 1: Offline Evaluation<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>In this step, we train both the current \u2018live\u2019 model and the model with the proposed new feature on a large amount of historical catalog data and the corresponding products\u2019 performance metrics. Then we ask both models to make performance predictions for a subsequent historical period, and verify these against the true performance results achieved in that time. Various statistical methods are used to measure accuracy and error rate of both models, so that we can be sure our new variant shows improvements.<\/p>\n\n\n\n<p>This stage can be executed very quickly, since we already have all the required data. This makes it excellent for fine-tuning our proposed change if we feel the results could be even better. Furthermore, it\u2019s a 100% safe way to try new approaches. Thus, we can quickly and constantly adapt to new market trends and insights, discovered through our own research or via smec\u2019s customer-facing teams.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"stage-2-dry-run\"><\/span><strong>Stage 2: Dry-Run<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>If our model with the proposed new feature generates offline improvements, we can move to a dry-run. With Whoop! continuously receiving information on new products and their Google Shopping campaign performance, we train both model variants on this data and query both for their predictions.<\/p>\n\n\n\n<p>Crucially, the predictions from the new variant are never used to generate bids, so we are still 100% safe. We again check machine learning metrics, like error rate, and now also check that the bids which would have been produced using the new model\u2019s predictions make sense from a business perspective. For example, if the model has discovered certain products have untapped revenue potential, then we might expect the bids to be higher, but not astronomically so.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"stage-3-ab-testing\"><\/span><strong>Stage 3: A\/B Testing<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>Arriving at stage three means we are confident we\u2019re working with something great, having seen improvements to machine learning metrics and a reasonable effect on business indicators via the proposed bids. Now, it\u2019s time to carefully go live.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"475\" src=\"https:\/\/smarter-ecommerce.com\/blog\/en\/wp-content\/uploads\/2020\/10\/Stage-3-of-the-testing-pipeline-1024x475.png\" alt=\"\" class=\"wp-image-7610\" srcset=\"https:\/\/smarter-ecommerce.com\/blog\/en\/wp-content\/uploads\/2020\/10\/Stage-3-of-the-testing-pipeline-1024x475.png 1024w, https:\/\/smarter-ecommerce.com\/blog\/en\/wp-content\/uploads\/2020\/10\/Stage-3-of-the-testing-pipeline-300x139.png 300w, https:\/\/smarter-ecommerce.com\/blog\/en\/wp-content\/uploads\/2020\/10\/Stage-3-of-the-testing-pipeline-768x357.png 768w, https:\/\/smarter-ecommerce.com\/blog\/en\/wp-content\/uploads\/2020\/10\/Stage-3-of-the-testing-pipeline-1536x713.png 1536w, https:\/\/smarter-ecommerce.com\/blog\/en\/wp-content\/uploads\/2020\/10\/Stage-3-of-the-testing-pipeline-640x297.png 640w, https:\/\/smarter-ecommerce.com\/blog\/en\/wp-content\/uploads\/2020\/10\/Stage-3-of-the-testing-pipeline.png 1999w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption>Stage 3 of our testing pipeline: a careful, controlled test of a proposed new bidding model on a live subset of the product catalog<\/figcaption><\/figure>\n\n\n\n<p>Both variants of the model receive a subset of the product catalog, and are trained on live data and used to generate real predictions and bids. Just as patients are carefully chosen in a clinical trial, so too are the catalog subsets, as we randomly spit them in a way that nevertheless ensures the expected performance is balanced across the sets. After a predefined period we swap the subsets, so that both models have the chance to work on each.<\/p>\n\n\n\n<p>In stage three, we can observe machine learning measures such as accuracy, business indicators such as average CPC, and \u2013 finally \u2013 the true effect on business metrics such as turnover and ROAS. If the new model variant continues to outperform the other (which, having gotten this far, it generally does!), we can safely roll out the change for the entire catalog.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"going-live-doesnt-mean-%e2%80%98set-and-forget\"><\/span><strong>Going live doesn\u2019t mean \u2018Set and forget\u2019<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>In the data science team, we are driven by a desire to constantly innovate and improve. Our custom-built dashboards give continuous insight into how the models are doing, and our alerting system lets us react immediately to any significant changes caused by unexpected events.<\/p>\n\n\n\n<p>Sometimes this reveals new areas for improvement, and our close relationship with smec\u2019s customer-facing teams means client feedback can always be used to derive new ideas. Furthermore, given our team\u2019s diverse academic backgrounds and engagement with the latest research, we are constantly discovering new ways to potentially improve our bidding models.<\/p>\n\n\n\n<p>This is particularly important in dynamic markets, where changing competitors, sales events, trends and so on make fast adjustments essential.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"165\" src=\"https:\/\/smarter-ecommerce.com\/blog\/en\/wp-content\/uploads\/2020\/10\/Example-situations-for-quickly-adjusting-bidding-1024x165.png\" alt=\"\" class=\"wp-image-7611\" srcset=\"https:\/\/smarter-ecommerce.com\/blog\/en\/wp-content\/uploads\/2020\/10\/Example-situations-for-quickly-adjusting-bidding-1024x165.png 1024w, https:\/\/smarter-ecommerce.com\/blog\/en\/wp-content\/uploads\/2020\/10\/Example-situations-for-quickly-adjusting-bidding-300x48.png 300w, https:\/\/smarter-ecommerce.com\/blog\/en\/wp-content\/uploads\/2020\/10\/Example-situations-for-quickly-adjusting-bidding-768x124.png 768w, https:\/\/smarter-ecommerce.com\/blog\/en\/wp-content\/uploads\/2020\/10\/Example-situations-for-quickly-adjusting-bidding-1536x248.png 1536w, https:\/\/smarter-ecommerce.com\/blog\/en\/wp-content\/uploads\/2020\/10\/Example-situations-for-quickly-adjusting-bidding-640x103.png 640w, https:\/\/smarter-ecommerce.com\/blog\/en\/wp-content\/uploads\/2020\/10\/Example-situations-for-quickly-adjusting-bidding.png 1999w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption>Example situations in which it is essential to quickly adjust bidding models to market trends.<\/figcaption><\/figure>\n\n\n\n<p>Whenever an improvement is proposed, we start with targeted research in the applicable domain, and use descriptive statistics to better understand our data from this new perspective. Next, we create quick prototypes, a.k.a. \u2018model sandboxing\u2019, to see whether the idea has promise. And if it does, the entire testing pipeline begins again.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In my last\u00a0post, I discussed the challenging task of automated, item-level bidding in Google Shopping, and revealed how smec\u2019s data science team goes about designing an AI-based solution. We start by clearly defining the problem and choosing the appropriate data, and then we engineer this data to make it as &#8230;<\/p>\n","protected":false},"author":73,"featured_media":7613,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[],"class_list":["post-9394","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-data-science"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v26.7 (Yoast SEO v27.5) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>Testing the solution: AI-based bidding goes live in Google Shopping - smec<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/smarter-ecommerce.com\/blog\/en\/data-science\/testing-the-solution-ai-based-bidding-goes-live-in-google-shopping\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Testing the solution: AI-based bidding goes live in Google Shopping\" \/>\n<meta property=\"og:description\" content=\"In my last\u00a0post, I discussed the challenging task of automated, item-level bidding in Google Shopping, and revealed how smec\u2019s data science team goes about designing an AI-based solution. We start by clearly defining the problem and choosing the appropriate data, and then we engineer this data to make it as ...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/smarter-ecommerce.com\/blog\/en\/data-science\/testing-the-solution-ai-based-bidding-goes-live-in-google-shopping\/\" \/>\n<meta property=\"og:site_name\" content=\"smec Blog | Follow current Ecommerce News, Trends &amp; Insights\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/SmarterEcommerce\" \/>\n<meta property=\"article:published_time\" content=\"2020-10-20T11:56:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-06-24T12:04:13+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/smarter-ecommerce.com\/blog\/en\/wp-content\/uploads\/2020\/10\/Testing-the-solution-\u2013-AI-based-bidding-goes-live-in-Google-Shopping.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"2420\" \/>\n\t<meta property=\"og:image:height\" content=\"1217\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Katherine Munro\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@smec\" \/>\n<meta name=\"twitter:site\" content=\"@smec\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Katherine Munro\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/smarter-ecommerce.com\\\/blog\\\/en\\\/data-science\\\/testing-the-solution-ai-based-bidding-goes-live-in-google-shopping\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/smarter-ecommerce.com\\\/blog\\\/en\\\/data-science\\\/testing-the-solution-ai-based-bidding-goes-live-in-google-shopping\\\/\"},\"author\":{\"name\":\"Katherine Munro\",\"@id\":\"https:\\\/\\\/smarter-ecommerce.com\\\/blog\\\/en\\\/#\\\/schema\\\/person\\\/c4a25e4fffafcb690638c32f3472786b\"},\"headline\":\"Testing the solution: AI-based bidding goes live in Google Shopping\",\"datePublished\":\"2020-10-20T11:56:00+00:00\",\"dateModified\":\"2022-06-24T12:04:13+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/smarter-ecommerce.com\\\/blog\\\/en\\\/data-science\\\/testing-the-solution-ai-based-bidding-goes-live-in-google-shopping\\\/\"},\"wordCount\":978,\"publisher\":{\"@id\":\"https:\\\/\\\/smarter-ecommerce.com\\\/blog\\\/en\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/smarter-ecommerce.com\\\/blog\\\/en\\\/data-science\\\/testing-the-solution-ai-based-bidding-goes-live-in-google-shopping\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/smarter-ecommerce.com\\\/blog\\\/en\\\/wp-content\\\/uploads\\\/2020\\\/10\\\/Testing-the-solution-\u2013-AI-based-bidding-goes-live-in-Google-Shopping.jpg\",\"articleSection\":[\"Data Science\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/smarter-ecommerce.com\\\/blog\\\/en\\\/data-science\\\/testing-the-solution-ai-based-bidding-goes-live-in-google-shopping\\\/\",\"url\":\"https:\\\/\\\/smarter-ecommerce.com\\\/blog\\\/en\\\/data-science\\\/testing-the-solution-ai-based-bidding-goes-live-in-google-shopping\\\/\",\"name\":\"Testing the solution: AI-based bidding goes live in Google Shopping - smec\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/smarter-ecommerce.com\\\/blog\\\/en\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/smarter-ecommerce.com\\\/blog\\\/en\\\/data-science\\\/testing-the-solution-ai-based-bidding-goes-live-in-google-shopping\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/smarter-ecommerce.com\\\/blog\\\/en\\\/data-science\\\/testing-the-solution-ai-based-bidding-goes-live-in-google-shopping\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/smarter-ecommerce.com\\\/blog\\\/en\\\/wp-content\\\/uploads\\\/2020\\\/10\\\/Testing-the-solution-\u2013-AI-based-bidding-goes-live-in-Google-Shopping.jpg\",\"datePublished\":\"2020-10-20T11:56:00+00:00\",\"dateModified\":\"2022-06-24T12:04:13+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/smarter-ecommerce.com\\\/blog\\\/en\\\/data-science\\\/testing-the-solution-ai-based-bidding-goes-live-in-google-shopping\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/smarter-ecommerce.com\\\/blog\\\/en\\\/data-science\\\/testing-the-solution-ai-based-bidding-goes-live-in-google-shopping\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/smarter-ecommerce.com\\\/blog\\\/en\\\/data-science\\\/testing-the-solution-ai-based-bidding-goes-live-in-google-shopping\\\/#primaryimage\",\"url\":\"https:\\\/\\\/smarter-ecommerce.com\\\/blog\\\/en\\\/wp-content\\\/uploads\\\/2020\\\/10\\\/Testing-the-solution-\u2013-AI-based-bidding-goes-live-in-Google-Shopping.jpg\",\"contentUrl\":\"https:\\\/\\\/smarter-ecommerce.com\\\/blog\\\/en\\\/wp-content\\\/uploads\\\/2020\\\/10\\\/Testing-the-solution-\u2013-AI-based-bidding-goes-live-in-Google-Shopping.jpg\",\"width\":2420,\"height\":1217},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/smarter-ecommerce.com\\\/blog\\\/en\\\/data-science\\\/testing-the-solution-ai-based-bidding-goes-live-in-google-shopping\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/smarter-ecommerce.com\\\/blog\\\/en\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Testing the solution: AI-based bidding goes live in Google Shopping\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/smarter-ecommerce.com\\\/blog\\\/en\\\/#website\",\"url\":\"https:\\\/\\\/smarter-ecommerce.com\\\/blog\\\/en\\\/\",\"name\":\"smec Blog | Follow current Ecommerce News, Trends &amp; Insights\",\"description\":\"smec - Smarter Ecommerce\",\"publisher\":{\"@id\":\"https:\\\/\\\/smarter-ecommerce.com\\\/blog\\\/en\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/smarter-ecommerce.com\\\/blog\\\/en\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/smarter-ecommerce.com\\\/blog\\\/en\\\/#organization\",\"name\":\"smec - Smarter Ecommerce\",\"url\":\"https:\\\/\\\/smarter-ecommerce.com\\\/blog\\\/en\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/smarter-ecommerce.com\\\/blog\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/smarter-ecommerce.com\\\/blog\\\/en\\\/wp-content\\\/uploads\\\/2022\\\/04\\\/smec-company-logo.png\",\"contentUrl\":\"https:\\\/\\\/smarter-ecommerce.com\\\/blog\\\/en\\\/wp-content\\\/uploads\\\/2022\\\/04\\\/smec-company-logo.png\",\"width\":500,\"height\":389,\"caption\":\"smec - Smarter Ecommerce\"},\"image\":{\"@id\":\"https:\\\/\\\/smarter-ecommerce.com\\\/blog\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/SmarterEcommerce\",\"https:\\\/\\\/x.com\\\/smec\",\"https:\\\/\\\/www.instagram.com\\\/smarterecommerce\\\/\",\"https:\\\/\\\/www.linkedin.com\\\/company\\\/smarter-ecommerce-gmbh\",\"https:\\\/\\\/www.youtube.com\\\/channel\\\/UCgEKAonH-2IoV2fIDyCJFMA\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/smarter-ecommerce.com\\\/blog\\\/en\\\/#\\\/schema\\\/person\\\/c4a25e4fffafcb690638c32f3472786b\",\"name\":\"Katherine Munro\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/34f9bd64259e28210a36873bafdce505f276c75a3f261543e0f709a1c3961099?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/34f9bd64259e28210a36873bafdce505f276c75a3f261543e0f709a1c3961099?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/34f9bd64259e28210a36873bafdce505f276c75a3f261543e0f709a1c3961099?s=96&d=mm&r=g\",\"caption\":\"Katherine Munro\"},\"url\":\"https:\\\/\\\/smarter-ecommerce.com\\\/blog\\\/en\\\/author\\\/munro\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Testing the solution: AI-based bidding goes live in Google Shopping - smec","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/smarter-ecommerce.com\/blog\/en\/data-science\/testing-the-solution-ai-based-bidding-goes-live-in-google-shopping\/","og_locale":"en_US","og_type":"article","og_title":"Testing the solution: AI-based bidding goes live in Google Shopping","og_description":"In my last\u00a0post, I discussed the challenging task of automated, item-level bidding in Google Shopping, and revealed how smec\u2019s data science team goes about designing an AI-based solution. We start by clearly defining the problem and choosing the appropriate data, and then we engineer this data to make it as ...","og_url":"https:\/\/smarter-ecommerce.com\/blog\/en\/data-science\/testing-the-solution-ai-based-bidding-goes-live-in-google-shopping\/","og_site_name":"smec Blog | Follow current Ecommerce News, Trends &amp; Insights","article_publisher":"https:\/\/www.facebook.com\/SmarterEcommerce","article_published_time":"2020-10-20T11:56:00+00:00","article_modified_time":"2022-06-24T12:04:13+00:00","og_image":[{"width":2420,"height":1217,"url":"https:\/\/smarter-ecommerce.com\/blog\/en\/wp-content\/uploads\/2020\/10\/Testing-the-solution-\u2013-AI-based-bidding-goes-live-in-Google-Shopping.jpg","type":"image\/jpeg"}],"author":"Katherine Munro","twitter_card":"summary_large_image","twitter_creator":"@smec","twitter_site":"@smec","twitter_misc":{"Written by":"Katherine Munro","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/smarter-ecommerce.com\/blog\/en\/data-science\/testing-the-solution-ai-based-bidding-goes-live-in-google-shopping\/#article","isPartOf":{"@id":"https:\/\/smarter-ecommerce.com\/blog\/en\/data-science\/testing-the-solution-ai-based-bidding-goes-live-in-google-shopping\/"},"author":{"name":"Katherine Munro","@id":"https:\/\/smarter-ecommerce.com\/blog\/en\/#\/schema\/person\/c4a25e4fffafcb690638c32f3472786b"},"headline":"Testing the solution: AI-based bidding goes live in Google Shopping","datePublished":"2020-10-20T11:56:00+00:00","dateModified":"2022-06-24T12:04:13+00:00","mainEntityOfPage":{"@id":"https:\/\/smarter-ecommerce.com\/blog\/en\/data-science\/testing-the-solution-ai-based-bidding-goes-live-in-google-shopping\/"},"wordCount":978,"publisher":{"@id":"https:\/\/smarter-ecommerce.com\/blog\/en\/#organization"},"image":{"@id":"https:\/\/smarter-ecommerce.com\/blog\/en\/data-science\/testing-the-solution-ai-based-bidding-goes-live-in-google-shopping\/#primaryimage"},"thumbnailUrl":"https:\/\/smarter-ecommerce.com\/blog\/en\/wp-content\/uploads\/2020\/10\/Testing-the-solution-\u2013-AI-based-bidding-goes-live-in-Google-Shopping.jpg","articleSection":["Data Science"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/smarter-ecommerce.com\/blog\/en\/data-science\/testing-the-solution-ai-based-bidding-goes-live-in-google-shopping\/","url":"https:\/\/smarter-ecommerce.com\/blog\/en\/data-science\/testing-the-solution-ai-based-bidding-goes-live-in-google-shopping\/","name":"Testing the solution: AI-based bidding goes live in Google Shopping - smec","isPartOf":{"@id":"https:\/\/smarter-ecommerce.com\/blog\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/smarter-ecommerce.com\/blog\/en\/data-science\/testing-the-solution-ai-based-bidding-goes-live-in-google-shopping\/#primaryimage"},"image":{"@id":"https:\/\/smarter-ecommerce.com\/blog\/en\/data-science\/testing-the-solution-ai-based-bidding-goes-live-in-google-shopping\/#primaryimage"},"thumbnailUrl":"https:\/\/smarter-ecommerce.com\/blog\/en\/wp-content\/uploads\/2020\/10\/Testing-the-solution-\u2013-AI-based-bidding-goes-live-in-Google-Shopping.jpg","datePublished":"2020-10-20T11:56:00+00:00","dateModified":"2022-06-24T12:04:13+00:00","breadcrumb":{"@id":"https:\/\/smarter-ecommerce.com\/blog\/en\/data-science\/testing-the-solution-ai-based-bidding-goes-live-in-google-shopping\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/smarter-ecommerce.com\/blog\/en\/data-science\/testing-the-solution-ai-based-bidding-goes-live-in-google-shopping\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/smarter-ecommerce.com\/blog\/en\/data-science\/testing-the-solution-ai-based-bidding-goes-live-in-google-shopping\/#primaryimage","url":"https:\/\/smarter-ecommerce.com\/blog\/en\/wp-content\/uploads\/2020\/10\/Testing-the-solution-\u2013-AI-based-bidding-goes-live-in-Google-Shopping.jpg","contentUrl":"https:\/\/smarter-ecommerce.com\/blog\/en\/wp-content\/uploads\/2020\/10\/Testing-the-solution-\u2013-AI-based-bidding-goes-live-in-Google-Shopping.jpg","width":2420,"height":1217},{"@type":"BreadcrumbList","@id":"https:\/\/smarter-ecommerce.com\/blog\/en\/data-science\/testing-the-solution-ai-based-bidding-goes-live-in-google-shopping\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/smarter-ecommerce.com\/blog\/en\/"},{"@type":"ListItem","position":2,"name":"Testing the solution: AI-based bidding goes live in Google Shopping"}]},{"@type":"WebSite","@id":"https:\/\/smarter-ecommerce.com\/blog\/en\/#website","url":"https:\/\/smarter-ecommerce.com\/blog\/en\/","name":"smec Blog | Follow current Ecommerce News, Trends &amp; Insights","description":"smec - Smarter Ecommerce","publisher":{"@id":"https:\/\/smarter-ecommerce.com\/blog\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/smarter-ecommerce.com\/blog\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/smarter-ecommerce.com\/blog\/en\/#organization","name":"smec - Smarter Ecommerce","url":"https:\/\/smarter-ecommerce.com\/blog\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/smarter-ecommerce.com\/blog\/en\/#\/schema\/logo\/image\/","url":"https:\/\/smarter-ecommerce.com\/blog\/en\/wp-content\/uploads\/2022\/04\/smec-company-logo.png","contentUrl":"https:\/\/smarter-ecommerce.com\/blog\/en\/wp-content\/uploads\/2022\/04\/smec-company-logo.png","width":500,"height":389,"caption":"smec - Smarter Ecommerce"},"image":{"@id":"https:\/\/smarter-ecommerce.com\/blog\/en\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/SmarterEcommerce","https:\/\/x.com\/smec","https:\/\/www.instagram.com\/smarterecommerce\/","https:\/\/www.linkedin.com\/company\/smarter-ecommerce-gmbh","https:\/\/www.youtube.com\/channel\/UCgEKAonH-2IoV2fIDyCJFMA"]},{"@type":"Person","@id":"https:\/\/smarter-ecommerce.com\/blog\/en\/#\/schema\/person\/c4a25e4fffafcb690638c32f3472786b","name":"Katherine Munro","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/34f9bd64259e28210a36873bafdce505f276c75a3f261543e0f709a1c3961099?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/34f9bd64259e28210a36873bafdce505f276c75a3f261543e0f709a1c3961099?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/34f9bd64259e28210a36873bafdce505f276c75a3f261543e0f709a1c3961099?s=96&d=mm&r=g","caption":"Katherine Munro"},"url":"https:\/\/smarter-ecommerce.com\/blog\/en\/author\/munro\/"}]}},"_links":{"self":[{"href":"https:\/\/smarter-ecommerce.com\/blog\/en\/wp-json\/wp\/v2\/posts\/9394","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/smarter-ecommerce.com\/blog\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/smarter-ecommerce.com\/blog\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/smarter-ecommerce.com\/blog\/en\/wp-json\/wp\/v2\/users\/73"}],"replies":[{"embeddable":true,"href":"https:\/\/smarter-ecommerce.com\/blog\/en\/wp-json\/wp\/v2\/comments?post=9394"}],"version-history":[{"count":3,"href":"https:\/\/smarter-ecommerce.com\/blog\/en\/wp-json\/wp\/v2\/posts\/9394\/revisions"}],"predecessor-version":[{"id":9398,"href":"https:\/\/smarter-ecommerce.com\/blog\/en\/wp-json\/wp\/v2\/posts\/9394\/revisions\/9398"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/smarter-ecommerce.com\/blog\/en\/wp-json\/wp\/v2\/media\/7613"}],"wp:attachment":[{"href":"https:\/\/smarter-ecommerce.com\/blog\/en\/wp-json\/wp\/v2\/media?parent=9394"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/smarter-ecommerce.com\/blog\/en\/wp-json\/wp\/v2\/categories?post=9394"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/smarter-ecommerce.com\/blog\/en\/wp-json\/wp\/v2\/tags?post=9394"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}