The “Mojave Experiment” has been compared to MTV’s Ashton Kutcher show, “Punk’d,” which is a “Candid Camera” show, but with celebrities. It’s also been compared to the “Pepsi Challenge.”
Neither of these correlates well to the “Mojave Experiment.” The “Punk’d” show is about tricking people, but its aim is humor, and the enjoyment of watching celebrities squirm under stress. The “Pepsi Challenge” is a straightforward taste test comparing one sugary drink to an even more sugary one.
Because the “Mojave Experiment” was designed to show that people actually like something they thought they didn’t like, the perfect analogy is the Folgers Crystals commercials from the early 1980s.
In those commercials, Folgers people went to fancy restaurants and replaced coffee normally served with Folgers Crystals instant coffee. Then a camera crew confronted the diners, and asked them how they liked the coffee. Of course, the coffee was delicious, and people were surprised to learn that they were drinking instant decaf. (Watch the commercials here, here and here.)
The Folgers ads proved exactly the same things that the “Mohave Experiment” proved. They proved that people say nice things to strangers on camera. And they proved that you can make people say they like something if you control the conditions in which they’re exposed to it.
Folger’s “switch” commercials were apparently effective, because parent company Procter & Gamble made several of them and spent a lot of money running them on TV.
But you know what? Decaf instant coffee is still crap.
Nobody at Microsoft drinks Folgers Crystals instant coffee, for example. Folgers’ “Mojave Experiment” didn’t work on Microsoft, so why does Microsoft think theirs will work on us?
Since Microsoft cast this marketing push as an “Experiment” — i.e., science — I would like to hereby publicly challenge Microsoft to answer the following questions:
? The “Mojave Experiment” involved 120 people. But the Web site shows 55 people saying nice things about Vista. What did the other 65 people think?
? Most or all “Mojave Experiment” videos posted to date feature an expert or marketing person showing neato features to someone. If Vista is so great, why didn’t you let people touch the computers?
? When people were initially asked their opinion of Vista, was it clear yet that Microsoft was doing the focus groups? How about when asked the second time? (I’ve personally developed and conducted many focus groups, and once you tell who is sponsoring it, everybody gets very complimentary about that company’s products.)
? Did the Mac, Linux, Windows XP and Windows 2000 users run out and buy Vista? If so, what do they think now? How about some follow-up?
? Will you make all video footage available (not just the favorable bits), at least to the press? How about just me?
? How is getting people to respond to controlled demos superior to surveys of people who actually use Vista?
The problem with Vista is not that it doesn’t demo well. Vista looks great when an expert cherry picks features for you and shows them to you with a Microsoft-configured and optimized machine. The problem with Vista is the experience of using it every day in the real world with real third-party hardware and software.
Also: The problem with Vista isn’t that its good qualities aren’t good, it’s just that its bad qualities are bad and, more importantly, overall it’s not as usable as XP. Cherry picking a tiny number of Vista’s best features and showing them to people doesn’t have anything at all to do with the bad features people struggle with.
Microsoft, here’s my advice to you: Stop trying to convince us that we like something we don’t like. Instead, just be glad millions of people do like one of your operating systems. Bring back XP, and sell it openly as an alternative to Vista. Meanwhile, make Windows 7 better than either Vista or XP.
If you can’t create an appealing operating system, don’t think you can fix that with tricky marketing. It’s insulting. It’s discouraging. And it erodes trust in Microsoft.