Search Advertising's Effect on In-Store Sales

ConversionKalyanam, K.; McAteer, J.; Marek, J.; Hodges, J.; Lin, L. · 2018Quantitative Marketing and Economics
Topicssearch advertising·cross channel·offline sales·field experiments·bayesian meta-analysis·roas·retail

The search budget comes with a clear online sales case, while in-store sales sit in a separate reporting system. Before approving it, decide whether the plan credits in-store sales affected by search advertising. The board case still needs a margin test because offline-only return on ad spend averaged below break-even, while several retailers' estimates cleared it.

Broad category search advertising can create in-store sales that online attribution misses.

Data chart

Every retailer experiment shows an estimated rise in store sales

Percent rise in total-store sales over matched control stores, across each test plus the two weeks after. Total store is the whole store in some experiments and a group of departments that includes the advertised categories in others. One bar per retailer experiment; the dashed line is the combined estimate for all 14 experiments, not an experiment.

All 14 combined: +1.18%Experiment J+1.52%Experiment L+1.45%Experiment M+1.41%Experiment K+1.40%Experiment N+1.37% (n.s.)Experiment H+1.35%Experiment I+1.33%Experiment G+1.17%Experiment E+1.15% (n.s.)Experiment F+1.04%Experiment D+1.02%Experiment C+0.87%Experiment B+0.78% (n.s.)Experiment A+0.62% (n.s.)
  • Ten of the 14 rises are clearly above zero.

Every one of the 14 retailer experiments that reported total-store sales shows an estimated rise, so losses in the other categories each experiment measured did not cancel the gains in the advertised categories.

Model estimates from 14 randomized market-level field experiments at well-known U.S. multichannel retailers; a 15th experiment did not report total-store sales. The model pulls each experiment toward the overall average; the retailers' own reported rises ran from 0.01% to 8.80%. Pale bars marked (n.s.) have ranges that include zero. Broad category terms were held in search positions 1-3.

Data chart

The combined in-store return falls short of break-even, while seven experiments' estimates exceed it

Dollars of extra in-store sales for each extra dollar spent on search ads, one bar per retailer experiment; the dashed lines mark break-even at a 35% gross margin (2.86) and the combined estimate for all 14 experiments (2.50).

All 14 combined: 2.50Break-even: 2.86Experiment H3.95Experiment G3.87Experiment M3.54Experiment K3.49 (n.s.)Experiment N3.49Experiment C3.36Experiment F3.04 (n.s.)Experiment J2.77Experiment I2.56Experiment D2.24Experiment E1.33 (n.s.)Experiment L1.14Experiment A0.75 (n.s.)Experiment B0.75 (n.s.)
  • Online and future sales are not counted.

The combined in-store return on search advertising falls short of break-even at a 35% gross margin, while seven experiments' estimated returns sit above it, each with a range that reaches below break-even.

Model estimates of return on ad spend from the same 14 experiments, counting incremental brick-and-mortar sales only; online and future sales were excluded, so the returns are conservative. The model pulls each experiment toward the overall average. Pale bars marked (n.s.) have ranges that include zero; that test compares each return with zero, not with break-even. Each of the seven estimates above break-even has a range that reaches below it.

Action guide

  1. Require search business cases to include in-store sales, adjusted by category and retail format.For similar large U.S. multichannel retailers, broad category search in top positions created net new store sales that online-only attribution would miss.
  2. Set a margin-based break-even target for each investment.Compare measured offline-only return on ad spend with that target, and report online and future sales separately.
  3. Set separate approval rules for broad and branded search.This evidence covers broad, non-branded category terms in positions 1-3, not branded search.
  4. If large retailers sell your products, count in-store sales when you fund category search.That includes co-operative advertising budgets you set with those retailers.

Evidence

  • When retailers moved broad, non-branded category terms into search positions 1-3, advertised-category sales rose 1.27% and total-store sales rose 1.18% versus matched controls.
  • Counting brick-and-mortar sales alone, return on ad spend was 2.50 versus a 2.86 break-even at a 35% average gross margin. Online and future sales were excluded.
  • The estimated rise in store sales was positive in all 18 broad product categories tested. Its size varied across categories and retail formats, but which ones gain most is not reliably established.

Key takeaway

Broad category search advertising can create net new in-store sales that online attribution misses.

Limitations

The experiments covered large U.S. multichannel retailers advertising on broad, non-branded Google search terms in positions 1 to 3. They measured store sales and offline return on ad spend, not online sales or sales beyond two weeks after each test.

Source

Kalyanam, K., McAteer, J., Marek, J., Hodges, J., & Lin, L. (2018). Cross-channel effects of search engine advertising on brick & mortar retail sales. Quantitative Marketing and Economics. Experiments ran on Google.com. The protocol committed in advance that neither Google nor the retailers could drop an experiment from the analysis on the strength of its result, and non-significant experiments were retained. https://doi.org/10.1007/s11129-017-9188-7

https://doi.org/10.1007/s11129-017-9188-7