Friday, November 14, 2008

The Super Trooper.

The Isuzu Trooper was my baby. We called it the Super Trooper. And boy, it was super. I bought it a few years into school when everyone went all country and I could no longer try to be country and drive a Nissan Maxima at the same time. The Trooper was like a giant dumpster with windows and wheels. I think if I would have bolted a giant piece of plywood to the bumper, it might have improved the gas mileage. This was an SUV from an era when SUVs were actually sport utility vehicles.

It was a 4x4 in every sense of the term. You had to get out and lock up the hubs, guaranteeing you'd slip and fall in the mud. We used to go bogging out along the Oconee River because it was like a cheap trip to the amusement park and because the girls liked it so much. It made them feel rustic, which is hard to do in the 'burbs.

One afternoon we decided to go get muddy and I gassed up the Super Trooper and picked up the girls at their house. We roared down the old jeep trails and through the mud pits until not a speck of the Trooper's white paint was visible. And then came the monster. The monster was a pit of mud 20 feet across, 4 feet deep, with a slanted bottom. When we rolled up on it, two Jeeps were already stuck side by side. Bryan was trying to plug the hole in his Jeep's floorboard as muddy water shot through like Old Faithful. Cory was standing on the hood of his Jeep, hopeless. We sent another vehicle around to the other side to pull them out.

I don't know what I was thinking. I just got in the Super and drove right in. The Trooper lunged to the side and I saw muddy water crawl up the passenger side widow. The engine shut off and I heard the people outside yelling. They were holding onto the roof rack to keep two of the tires on the ground so I wouldn't tip over.

They pulled Super out of the pit with a tow strap and I took her home to wash her. I thoroughly got my 75 cents worth at the local car wash when I noticed it. Just a little rainbow in the suds. Getting bigger. An oil leak.

I hypothesized the worst. The bottoming out of the Trooper in the muddy pit hit the transmission hard enough to weaken the rear main seal. I knew from people who had the rear main seal repaired how expensive it could be. I took the Super to the shadiest mechanic in Athens and he confirmed my suspicion. The cost to repair old Super was as much as I had paid for her.

Over time, the leak got worse. It got to where I would drive around with a case of oil to fill her up every hundred miles. Eventually, I bought a new car and parked old Super. Once in a while, I'd go out and wash her or just let the engine run a bit.

Then Maura and I bought a house and we had to move. The Trooper had fallen into enough disrepair that she could not be driven. I had her towed to a mechanic recommended by a friend to fix the things so at least we could drive her. The mechanic called and said, "I found a brake caliper and a few hoses for that power steering line cheap so don't pee yourself over the price. I should be able to get all this installed by the end of the week. Oh, by the way, I tightened down the head so you shouldn't be leaking anymore oil".

Tightened down the head? What happened to the rear main seal? I've been leaking enough oil around rural Georgia to rival the Valdez. You mean it was a few loose bolts?
I was tempted to go punch that first mechanic in the throat. However, I was so happy that Super Trooper's oil leaking days were over. For now. Until she sprung another leak, as vehicles with 220k miles often do.

I have paid a lot of money to mechanics for the wrong diagnoses. I've had mechanics ignore what I brought the car in for and fix something else entirely. I've paid for a fix that lasted about as long as it took to leave the mechanic's driveway. Shade tree mechanic does not come close to some of the fools I've hired. My mechanics would cut down the shade tree into logs, stuff some of the logs in the trunk and say they fixed that pull in the suspension. They're just plain shady - no tree required.

Then again, I've met some shade tree marketers as well. They change the oil hoping it will inflate the tires. They put washer fluid in the gas tank to save a few bucks and want to know why the engine won't run. They paint the inside of the car while sanding the outside and call that a long term strategy.

Making the right diagnoses of your marketing is a crucial but often overlooked procedure. We marketers could have meetings about planning meetings to plan something, but when it comes to discussing how to get the lead out we seemed more inclined to let the air out instead.

We need one of those diagnostic computers that mechanics hook up to the car so that it will tell you what is wrong. Sorry. They don't make anything like that for marketing plans. No, we'll have to do this the old fashioned way. Pop the hood and hand me that flashlight.


The best test of whether or not it will run is to try to start it.

The easiest test of a marketing plan is to see if it is doing what it is intended to do. Are sales rising? Are we making money? Sure, this is simplistic, but I ask you, if the marketing plan couldn't even turn over, is that not a good indicator that something might be wrong?


Work backwards from the starter.

Take the entire drive train of marketing and do diagnoses. Have you done things to build awareness? Are customers building enough interest? How are we helping customers gain knowledge or make a decision to buy? When they want to buy, how helpful are we? After the sale, do we reinforce their decision or run away laughing with the money, which, by the way, is what that first mechanic did.


Check for burning oil.

If the machine is in good running order, you should not only have decent efficiency, it should be getting better. As many marketing activities are cumulative, the cost incurred to make each sale should be decreasing either by an elevation in sales or a savings in costs due to ever-bettering practices. Unnecessary smoke is most often the use of price reductions and financial incentives which you can run on for a while but it'll run like crap and eventually clog your engine.


Check the gaps and the timing.

As consumers are made more aware of your offerings and you are constantly evolving your offerings with the consumer, the gap between their desires and your offerings should narrow. This should always be an ongoing process of improvement and refinement. The idea that if you just get it right once and it'll run forever is just as true as it is with cars.


Kick your tires for a change.

Every marketing plan is worth a little diagnosis if just to head off bald tires and poor alignment that is inevitable in every business over time. Regular maintenance helps ensure a long running machine and more enjoyable experience when driving. And you never know, you might have a leak that you can't even see yet.

The Trooper is still alive and hauling things on my in-laws property. There is a good reason for this. The oil leak meant the Trooper always had fresh oil and it was checked every 100 miles. Also, the spray of leaking oil coated a bunch of parts that would have otherwise rusted long ago. She self preserved like one of those ancient mosquitoes trapped in amber. It's pretty amazing. Well, we didn't call her Super for nothing.

What a Lamppost Uses a Drunk For.

A friend of mine told me that, though he received his law degree from Vandy, he had to do extra study at Harvard before he became a professor. I asked him why he had to go to Harvard and he explained that his bosses wanted to make sure that in a courtroom he could correctly identify who was the plaintiff and who was the defendant. So now you have your highbrow humor for the day. The appropriate reaction is a slight snicker.

My own education had its own gauntlet of sorts, though I imagine nowhere near as perilous as an LLM from Harvard Law. For me, it was two research classes required of all who studied psychology at the University of Georgia's very research orientated psychology program.

I took the first class, Research Design, in the summer, when I had quite possibly the sweetest living arrangement in town. I was a couple blocks from the building where I would be taking my one class for the summer, not paying for utilities and the cost...$50. No, that's not per month. That was the cost for the whole summer. And when you're saving that much money in rent, you have excess funds to spend on other college activities, like taking your best girl to the picture show and singing festive songs at the local orphanage. Yeah, right. We partied like the members of Motley Crue only wished they could.

The professor was one of those laid back PhD candidates who basically promised you'd get an A anyways, but please show up so his review board doesn't get suspicious. Despite our encouraged lackadaisical attitude, however, designing research was interesting. Between rising at the crack of noon and raucous summer bashes, we learned how to create studies, control variables and make comparisons. I wished my entire education would have gone just like that.

But then came the second class, Research Analysis. Our teacher was nice enough, although a bit strange. He was a PhD candidate who didn't really seem to like or be interested in people, an odd characteristic for a psychologist. The class was at dawn and by that time I had moved into a house miles away, meaning I had to fight the other twenty thousand students for the apparently 30 allocated parking spaces. And the class was horrible. With the analysis of research, all the energy and enjoyment of designing research was drained out into the nearby Oconee River. Instead of using research to investigate and solve problems, we now seemed to be finding ways to use research to create new problems, which solved very little. Except we could now point at the amazing complexity of the process we used to say nothing.

As I yearned for the summer days where we pontificated confounds and null hypotheses, I questioned why we were taught the process in two parts. It would seem more logical to teach the design and analysis of a research method, in addition to teaching a variety of methods, rather than break the process apart. Yes, to do that would have been logical. But to put windows in the psychology building with some regular pattern would have also been logical. Instead, the university asked professors if they wanted a window and if they said yes they got one. If they said no, no window and the resulting building looked like it was designed by 8 year-olds who just floated a keg of soda. Logic has nothing to do with it.

And so it often goes in the wild world of marketing research. The design of studies and the interpretation of results too often seem disjointed. And if that is not enough to question validity, many studies start out with no real defined subject, only to follow up the act with an ethereal interpretation designed to support a pre-existing notion. As the late, great David Ogilvy said, marketers often use research like a drunk uses a lamppost: for support rather than illumination.

I routinely see studies designed to measure broad and barely defined aspects with a tiny population of participants with obvious confounds, such as an Internet survey to study people who don't use the Internet.

Now for the record, I have worked with some of the most fantastic researchers in the marketing business. Yet even with great research, I have seen managers cherry-pick the results and ignore a huge swath of important data. I have sat in the room and watched my friend Jim Nelems tell a company's leaders to their faces what the issues are, only to watch said leaders either try to discount the findings or ignore them altogether.

I am no research expert. But I am practical and I don't commission research unless I have questions I want answered. And when I do get data, I don't reengineer the questions to fit the results. In the studies I have been involved with, I have observed some amazing technique and skill and, while I could detail all the things I have liked, I think this subject is best addressed by the strongest lessons I learned. These few tidbits stand out to me either because they were not what I was expecting or because they fundamentally shaped the role I see for marketing research.

Better road map than treasure map.
One particularly terrible mistake marketers make is assuming research will predict the future. Sure, we test products and flavors and advertising and that gives us directions for where to put money, time and effort. But what research cannot do is control all the variables. In the lab, a consumer can tell you they prefer a flavor of cough drop. In the real world, you don't know how far the distance is from their house to the drug store that carries your cough drop. This is not to say the research is incorrect. You asked the consumers if they liked the flavor and they said, "Yes". There is a considerable difference, however, between liking the flavor and buying the product.

In my experience, research does a far better job of defining the problem rather than offering the solution. This notion should affect where marketers place the role of research. In at least a few efforts, I have observed marketers develop a product and then attempt to use research to affirm certain notions. Instead, well conducted marketing research should have informed the creation of the product to put it more in line with consumer preference. While some companies do this, the vast majority do not.


Better fairy godmother then magic genie in a lamp.
The genie gives you three wishes and goes back in the lamp until the next wisher happens along. Similarly, plenty of marketers rub their researchers and ask a few questions only to stuff them back in the bottle. Research, however, can advise and inform on all phases of a product's life cycle. Research can flush out attributes most desired by the consumers. It can test positioning strategies and communications. Why put the genie back in the bottle when it can grant all these wishes as well:

Allows benchmarking and testing of strategies in development.
Strategy testing all along the consumer marketing spectrum.
Verifies that strategy from research is aligned and has not skewed.
The better idea is to use your research as a fairy godmother. She exists more like a counselor, helping to inform decisions and granting the occasional wish when needed. Just don't ask for the world and then ignore her advice. She might turn you into a pumpkin.


Doesn't always have to be in a room with one-way glass and lots of M&Ms.
The best researchers can pull data out of anywhere. They can read the b-roll from your corporate videos. They can make inferences from the distribution of your brand magazine. The can diagnose issues from past efforts. I have seen focus groups take place at a customer's house. I have sat in a restaurant and observed customers for an upcoming in-store promotion.

The belief that research must always look like research is a self-imposed restriction. While the controlled setting has its value, one should not eschew the whole other world that is out there.

In today's marketing world, boundaries are falling. Sales and marketing departments have not only signaled a cease-fire, they are beginning to work together. Finance and marketing are beginning to teach each other a common language. And so, the world of research should drop the curtain and begin to better integrate into the whole workings of an organization. Research is a primary window into the life of customers. For the customer-led firm, research is not just an expense or luxury. In fact, a lack of research can be a liability.

They still teach Research Design and Research Analysis separately at the University of Georgia, despite plenty of complaints. I told them that methods should be taught alongside data analysis. I think I made a decent case for connecting the means of getting and understanding data. I put all my concepts on a survey of the course.

A survey, I imagine, nobody ever read.