History of Web Analytics…Annotated.

Most history of Web analytics postings and stories routinely cover Analog by Dr. Steve Turner a rather simplistic log file analyzer. Others mention i/Pro, netGenesis, Interse, NetCount and WebTrends.

What they often miss is Lilypad, a marketing and adertising oriented Web-based analytics application. Lilypad was developed by Streams Online Media Development in 1995 and announced in the Fall of 1995. Unlike most of the other technical log file analytics tools, Lilypad was original in that it focused on promotional measurement. Importantly, Lilypad utilized its own database of activity and was coded in Perl leveraging server-side inludes the predecessor to JavaScript page tags.

Lilypad was programmed by James Allenspach under my direction during dowtime in-between client projects. Dave Skwarzek and I worked to brand and promote the product in  way that marketers could appreciate. A seminal offering by a scrappy Web boutique start-up to be sure, Lilypad was influential as an early site metrics tracking application:

If you are doing research on the history of site analytics, digital media tracking or online media measurement, you can learn more about Lilypad here.

Response to Who Will Rid Us of this Meddlesome Click?

Great post by Gian Fulgoni of ComScore and very timely!

After over a decade in the digital advertising industry, I don’t find the click emphasis to be a fascination as much as a perpetual crutch. Continuing to nibble at our heels, clickthrough has really just been the path of least resistance. I’ve heard this from many colleagues:

Ad sales execs seeking to close business tread uneasily and rarely bring up alternate success measures that require too much thought or set-up

Agencies attempt to educate clients about such matters but that doesn’t always work (relationship/credibility/pick your battles/technical complexity)

Client-side marketers are all too often organizationally overwhelmed and only now starting to internalize meaningful digital measurement process

Technology vendors who often have the most expertise, ironically tend to be perceived as the most unreliable sources with their marketing often ahead of actual capabilities

For some reason, easy-to-measure clickthrough are meticulously collected, analyzed and reported. It is as if through the mass willing suspension of disbelief that somehow the display clicks might conceivably convert or are implicitly valuable. The ongoing independent reports from ComScore suggest otherwise to anyone listening. While this post rightfully educates all of us about the troublesome reliance on clickthrough, it also raises the opportunity to raise awareness about passive incremental response.

Instead of skipping down the funnel past post-view response and straight on to purchase, consider the in-between, i.e. non-clicker viewthrough. Even in Gian’s post, viewthrough is not mentioned explicitly but post-view reponse is only suggested in the context of conversion – this is part of the problem. Yet, in practice we all know that very few clickers will convert (super promo-oriented messaging aside).

This measurement incongruity routinely happens whenever post-view activity is mentioned. In so doing, the more executionally challenged, but likely valuable viewthrough response remains unmeasured and therefore invisible.

It is analogous to calculating auto mileage looking at RPMs (engine speed) and not MPH (land speed).

The reality is that implementing an alternative quantitative measurement like viewthrough pushes many marketers to the edge, requiring patience, precise technical set-up and methodical execution. To Gian’s point clickthroughs are fast, cheap and easy to measure; they’re also potentially misleading for all the reasons ComScore and others have researched. What’s more, viewthrough impact accrues over time, which flies in the face of the commonplace action bias to optimize campaigns on something.

So while probably not that final Canterburian cleric’s foot-on-the-neck of clickthrough, viewthrough might at least be one of the assasinative knights.

An industry appeal to standardize or define viewthrough can be found here http://goo.gl/LA8Iv

Groupon vs. Advertising? Response to Bernhard

Of course, I disagree with Eric Bernhard’s simplistic view of advertising posted on TechCunch.

It echoes the obsession with media decisions that are simply easier to measure (vis-a-vis conversion rates) alluded to in my prior post about defining viewthrough. Rule #1 of analytics: Just because it is easy to measure doesn’t mean you should – although there are some cynical arguments about job security.

Effective advertising is dangerous as Jeff Molander put it, but potentially very powerful – it always has been as it continues to evolve. Unfortunately, executing and measuring advertising is *much* more complex than pushing a button and signing up for a Groupon promotion: there are media choices to plan and buy as well as serious creative and messaging decisions.

Compare that to Groupon’s appeal: “No one makes it happen faster”,”savvy young audience”,etc…

 
Sales pitch aside, Eric is onto something deeper in his primal mistrust of brand advertising. The perception that a Groupon is inherently less risky than advertising alternatives is actually a clever meme that is apparently being well-tapped by Groupon’s sales force and marketing. 
That a business can actually tangibly see people (customers as they are buying) coming in the door (profitable transactions or not) is new, powerful and real. Less easy to measure is the long-term impact of this Pavlovian bell. Naturally, business owners assume some will be sticky to make up for the price-sensitive deal shoppers. Basic accounting should clue the business owner in as to the actual cost of the promotion.
Meanwhile, it is just not that easy to measure the impact of branding on an ephemeral mass of people that didn’t come in – to the point about conversion rates. 
What is going on here? Game Theory proves over and over again that most people are VERY risk-averse. Ultimately, if we reframed the opportunity instead by offering each of the $20K advertising deals for FREE to business owners – what do you think their response would be? 
Many will prefer take the certainty of free advertising over a specific and likely loss.

New for 2011! Standardizing the Definition of View-through

It has been over 17 years since the advent of the Netscape Web browser in 1993 and almost as many years since the first AT & T banner ads were served on Hotwired.com. Back then, the Internet was heralded as the most accountable medium ever.

Fast-forward to 2010: the digital advertising industry has gone mainstream and will likely generate more than $25 Billion (US only). At the same time, a subject that concerns far too many people is declining or flat click-through rates. Last week’s gushing “news” from a rich media vendor that clickthrough rates have supposedly leveled off after years of decline is a good example. 

Definition of Insanity
In a business that obsesses about such meaningless metrics, the digital advertising industry simply cannot continue worrying about click-through rates. Although most will recognize that the novelty of clicking banner ads has largely worn off, this measure which still provides almost no insight on the effectiveness of most campaigns just won’t go away – regardless of marketing objectives.

In the no man’s land somewhere between the ad server and site tracking is an analytics oddity called viewthough: a useful albeit tortured metric. Testament to this is thats not one of the major industry trade groups recognizes viewthrough by including it in their standards glossaries:  IAB, OPA, ARF or the WAA.

Despite early work by DoubleClick, plenty of practioner interest and ongoing research by ComScore, the digital advertising industry still somehow lacks an official definition of a viewthrough. At times, it seems like we’re all too often measuring what is easy or expedient. And, clearly that is not working for the industry.

Here is a sampling of viewthrough articles over the last 10 years:

  • Lilypad White Paper Response Assessment in the Web Site Promotional Mix (2/1997) A very early attempt by the author to describe the phenomenon in the context of measuring ad response; see the diagram.Online Awareness Model of Banner Advertising Promotional Models. At that time there was not yet a way to measure such passive behavior.
  • Conversion Measurement: Definitions and Discussions (9/2003) An early article that focused on “people that ultimately convert but did not click”. Technically, viewthroughs are not people and are probably better described as visits. Also, depending on the campaign objective, a conversion event is optional.
  • Neglecting Non-Click Conversions (11/2003) A pretty thorough piece on the subject, although the term “viewthrough” is not used and there is again an emphasis on conversion.
  • Lies, Damn Lies and Viewthroughs (8/2005) Again, the focus is exclusively on viewthrough conversion, which is clearly a trend. However, it is misleading as it misses all the non-converter traffic.
  • The Most Measurable Medium? We Still Have A Lot To Do! (9/2007) David Smith actually made a literal plea for the industry trade groups to define viewthrough. A great idea, unfortunately it fell on deaf ears and several years later not much has changed.
  • Why view-through is a key component of campaign ROI (9/2010) provides a more balanced look at what viewthrough is but still brings up conversion. Also, th acronym “VTR” is confusing as that is what most people might consider a viewthrough rate similar to how a “CTR” means clickthrough rate.
  • Different Views of View-Through Tracking (10/2010) More of the same, although this article actually quotes Wikipedia (scary) and further convolutes the matter referencing a Google Display Network definition that focuses on viewthrough conversion. Consistent with the theme, the term VTR is used to mean viewthrough conversion rate not view-through rate – two very different measures. On the upside the potential of viewthrough for media planning and optimization was right on.

Curiously absent from the ongoing discussion is what viewthrough inherently represents: measurable incremental value from an affirmative self-directed post-exposure response. With just syndicated panels and qualitative market research to divine results, traditional electronic media could never quantify this .

At the same time, the advertising industry now has over 10 years of similar “directional” qualitative research focused on the familiar yet ephemeral measurements of post-exposure attitudes and intentions (notoriously unreliable). Many see these brand lift studies as rife with data collection challenges and ultimately of dubious value. Just this year, Professor Paul Lavrakas on behalf of the IAB released a critical assessment of the rampant practice.

Parsing The Metrics
It is bizarre that many digital marketers insist on defining viewthrough rates in conversion terms while clickthrough rates are always measured separate from subsequent conversion rates. Mixing metrics has confused the matter but effectively left viewthrough to be held to the higher standard of conversion. Ironic, since very few clickthrough (in volume and rate terms) even result in conversion.

While “clickthrough rate” is always understood to be relative to impressions (# of clicks / # of impressions), “viewthrough rate” seems to have skipped the middle response step and gone all the way to conversion. That doesn’t make sense when there are so many other factors that influence the purchase decision after arriving on a Web site.

To be very specific, viewthrough rate (VTR) should be similarly calculated, i.e. # of (logical) viewthroughs / # of impressions. “Logical” means that the viewthrough is observed where a branded post-exposure visit is most likely to happen analogous to the target landing page of a click-through;usually this means the brand.com home page. 

Measurement Details
The real problem underlying the apparent confusion is that viewthrough measurement invokes several raging and simultaneous, inter-related and often technical debates: branding vs. response, optimization, cookie-deletion, cookie-stuffing, panel recruitment bias, correlation vs. causation and last-click attribution. Anyone one of these arguments can cause a fight.

Nonetheless, in defining what viewthrough actually means it would be helpful to overview the two basic ways of measuring view-through:

  1. Cookie-based: This a browser-server technique that relies on cookie synchronization between the ad server and the target brand site. When the user receives the ad, a cookie is set on their browser that is later recognized upon visit to the target site, which is then matched via speical page tags back to the associated campaign. There are several ways this can be done, e.g.  DART for Agencies (DFA)/Atlas/Mediaplex page tags, ad server integrations (Omniture) or ad unit ridealong pixel tracking (Coremetrics). Optionally, PSA campaigns can be run alongside a camapign for a simultaneous test-control comparison of viewthrough “true” lift;essentially you can measure a baseline amount of viewthrough traffic that would end-up at the site anyway. Downside: subject to browser cookie limitations.
  2. Panel-based: Alternately, a standing Internet behavioral panel can be utilized, e.g. ComScore and Compete. In this approach, two comparable groups are observed: an exposed test group and an unexposed control group that represents the baseline viewthrough. The difference between the rate by which the test group (exposed to ad campaign) and the control group (received PSA or other’s ads) subsequently visit the target site reveals the lift that is explained by the presence of display advertising. This method may also include ad or page tracking, but does not require cookies. Downside: subject to panel bias.

The Impact of Time
Next, an additional layer to viewthrough measurement that is worth mentioning is time, i.e. delayed response. Like traditional advertising media, display ads exhibit an asynchronous response curve where the effect of the advertising decreases over time.In our real-time data collection world, it seems the common sense realities of human behavior are often overlooked.

Many factors can impact the viewthrough response curve, including messaging, frequency, share of voice and creative execution to start. And, one size does not fit all: a considered purchases could reasonably have longer shopping cycles than CPGs. Depending on the method of measuring view-through, typically 30 days or 4 weeks are often used as initial “lookback windows.”

Et Cui Bono?
Although that was fairly straightforward, as soon as viewthrough is connected to a site conversion (through deeper page tracking), the thorny issue of attribution arises (and cookie-based measurement is implied). Viewthrough measurement often goes off on a tangent t this point because there are two layers to attribution.

  • Channel attribution is simply put: which digital channel is assignedtr credit for the conversion event? Measuring display advertising happens to be more complex and most site metrics tools punted on tracking this capability. That means that simpler response channels like paid search, natural search, affiliates, CSEs and email to receive last credit as a default. For many marketers, measuring conversion attribution or participation gets complex and often political very quickly.
  • Media attribution gets really contentious, especially for lead generation and ecommerce-oriented marketers. Performance ad networks often insist on having their own special page tag in place where the conversion event occurs;in this way they can independently measure conversions and potentially optimize their ad delivery. The problem is that there usually are multiple ad network vendor tags on the conversion event page and all of them will count the page load as a conversion. Worse, this is an easy way for the ad network to shoehorn themselves a retargeting cookie pool. Unchallenged, media vendors may claim credit for everything such that marketers end up overpaying for the same conversion. Alternately, some very Byzantine schemes have arisen to guestimate credit. 

Despite all of the above, here is a working definition of a viewthrough for 2011:

Definition of View-through
Viewthrough is a measure of the passive but self-directed impact from a partiucular display ad unit (banner, rich media, video or audio). The viewthrough event follows one or more ad exposures and when the ad unit is clickable can be post-click (initial click visit timed-out) or post-impression (with no click). Importantly, a viewthrough may or may not be associated with a purchase conversion event but must be associated with a target page load or other high-value action. VTR or viewthrough rate is calculated as # of viewthrough / # of impressions.

Viewthroughs decay over time from ad exposure. In-flight viewthrough are observed during the live ad campaign while the post-flight “vapor-trail” begins immediately after the associated ad is served.

Don’t like this definition? Come up with a better one or edit the above…and, the sooner the better or the industry might get stuck with this sketchy Wikipedia entry.

Control Your Ad Preferences!

With all the hub-ub from the New York Times, WSJ, gubment (including former Black Panther and Chicago’s very own Bobby Rush) and consumer fanatics you must be growing VERY concerned. For your handy reference below is a list of major consumer settings panels where you can adjust your advertising preferences that is actually much easier than correcting information on your credit report.
  • Blue Kai – by far the most interesting. Plenty of behavioral ad targeting fodder in here. Also, you can really see the presence of offline credit ratings companies busily creating a whole new revenue stream off you; interesting that because it is just as creepy yet harder to see.
  • Exelate -not as behavior dominated but many interest categories.
  • Lotame – fairly innocuous interest and sub-interest categories with observed behavior.
  • Google – comprehensive interest-based; no observed behavior.
  • Microsoft – another comprehensive list of interests; no observed behavior
  • Yahoo – fairly deep interest profile; no observed behavior.
  • Safecount –  totlly different with no behavioral segments but plenty of ad creative and sites you’ve been to; no interest preferences here.
If anyone has any other suggestions for the above list, please drop me a line!

If you really don’t want advertising tailored to you and you can set your NAI opt-out cookie and then get lots of irelavant ads – enjoy!


Also, in case you were looking for a Flash cookie control panel to view and/remove such locally stored objects: http://bit.ly/2fZi


Last, don’t be evil and enjoy your new Google Toilet ™!





Comment on Andy Grove’s Bloomberg Opinion

It’s been while since the last post, but Andy Grove recently wrote an interesting Bloomberg opinion piece called, “How to Make an American Job Before It’s Too Late: Andy Grove. It was mentioned by WebGuild, which usually offers some interesting angles to the technology business and Silicon Valley life.

MANUFACTURING VALUE. Certainly Andy Grove is a successful businessman with some very valid points about the back-end/residual value of manufacturing jobs to the broader US economy. Andy bemoans the fact that many Asian countries (and Mexico) have gained manufacturing jobs at the American economy’s collective expense. Most people would agree that this has had a generally negative effect on the US economy.

GAME THEORY. Outside of winning on philosophy, game theory tells suggests that China, India, Mexico and others beat us at our own game; the USA’s shrinking manufacturing economy and trade deficit suggests we lost a lot. It is a tricky situation because China and other countries rigged their economies to absorb more and more manufacturing business. At the same time, the US stuck to it’s libertarian free-market roots on the one-hand (pushing for free trade) but continued to tack-on more and more regulation of business (nanny-state).

The bottom-line is that this was a terrible combination that resulted in fewer US manufacturing businesses, shrinking jobs with what was left over being even more costly (outside Silicon Valley, think Detroit auto-industry). Unfortunately, as many states (California, Illinois, Michigan, New York) are now finding, you can’t collect tax revenues to fund their bureaucracies off of business and people that left or went bankrupt. Consider that it took just that – bankruptcy for GM to renegotiate with their unions.

Does eschewing those capitalist American ideas by imposing new tariffs on imported goods and new taxes on offshore operations make sense? Probably not.


DON’T THROW THE BABY OUT WITH THE BATHWATER. Rather than penalize smart businesses with higher costs and reward inefficient American companies, maybe a better approach is for the Federal government to provide more log-term incentives to build manufacturing plants in the US. In other words, change the game so that costs in the US could compete and be a much lower cost place to do business. However, that means allowing individual Americans to better control their own wages/compensation not the states, US Congress and certainly not grafty unions.

GET MANUFACTURING-FRIENDLY Many American businesses would prefer to build operations here but simply can’t afford to when they are facing global competition. Think about it: there is a reason why the non-union auto industry developed away from the politics of the Michigan economy, e.g. BMW in North Carolina and Honda in Indiana, etc…Unfortunately, the current Obama administration is already going the wrong-way way with “health-care reform.” Only by reducing the colossal HR red-tape and onerous labor laws states or counties could compete for business and WIN.

INTERNATIONAL TRADE-RELATIONS. To channel Keynes for a moment, “in the long run we are all dead.”
The US needs to play hardball with other countries when it comes to international trade negotiations. There is certainly some room for improvement there to Andy’s point; no country should be permitted to “get” without “giving”…simple quid pro quo.

START-UPS. Andy also notes the media-driven fascination with start-ups by politicians and others. Few people speak about about their tiny *real* contribution to the economy…sure they can have an impact but the vast majority fail after burning through vast amounts of capital…capital that could have been invested in businesses that are more likely to produce return. Many people and start-ups chase their tails for a long-time wasting money…this is not always apparent to journalists. Meanwhile, big companies MUST make a profit from operations (usually) in order to continue. Yet the mythical start-up and the romanticized ideas of entrepreneurship makes for good stories and dreams.

Finally, I do agree with some of the posted WebGuild responses. It seems a bit hipocritical for Andy to be wagging his finger and arguing for more government influence over the economy today, while he’s comfy retiring from massive wealth created by a less-regulated system (US in the 70s and 80s).

Maybe Andy will contribute from his Intel stock to help fund this!

CIMA May 2010 Panel on Analytics

Measuring and Monetizing Digital Media ROI

– How has successful marketing ROI been measured?

– What are the standard measurements of ROI and what tools are available to support the standards?

– Should there be different ROI standards for digital media and offline media?

– Branding campaigns and DR campaigns?

– Differences in metrics associated with display and search vs. video, mobile & social.

– Examples of the best emerging tools for measurement.

– Upcoming changes throughout the next 5 years.

Pictured from Left to Right:  Moderator Cary Goss , Brett Mowry of Digitas, Perianne Grignon of x+1, Domenico Tassone and Andy Stein, both of Sears Holdings – 5/19/10.

Photo by Dan Merlo