Forget the Turing Test. The Key to Conversational Engagement Might Be Trampoline Moments

wall-e-06

In 2016, voice-based interfaces exploded into the imagination of the startup community as a potential new consumer platform. Amazon deserves much of the credit for this radical shift, as the Amazon Echo seemed to jump the chasm from early adopters to a more mainstream market. Of course, voice has been a hot topic now for years, as Apple & Google both leveraged their ubiquitous mobile platforms to launch Siri & Google Now, and Microsoft & Amazon have demonstrated incredible technical progress with Cortana & Alexa.

Unfortunately, as the excitement around voice shifts into practical execution, there is an uncomfortable consensus growing that there is something amiss with these new conversational platforms. The issue? The engagement numbers just aren’t as strong as expected, or even as strong as engagement numbers for traditional web or app-based interactions. One of the biggest issues? Retention.

I believe the issue is real, and will be a persistent problem for developers and designers looking to create the next generation of conversational interfaces. But if I had to give one piece of advice to those creative professionals, it would be this:

Deliver trampoline moments.

Lessons from PullString

Over the past four years, I’ve had the incredible opportunity to be an investor and board member at PullString, headed by Oren Jacob, the former CTO of Pixar. This company set out with the audacious goal of reimagining conversational interfaces designed for entertainment, rather than for utility. With a bit of that unique Pixar magic, this incredible team believed in two things that even to this day seem quite at odds with the conventional wisdom of Silicon Valley:

  1. Conversation is a fundamentally new medium for creative content, and would expand beyond the pure utility of a search engine interface to a platform for engagement & entertainment.
  2. A platform to deliver truly engaging entertainment through conversation would require the combination of both technical and creative contributors to the content creation process.

Over the past few years, Pullstring has delivered a wide range of industry-firsts for voice-based engagement for a wide variety of audiences, ranging from young children to adults. Large brands, like Activision’s Call of Duty, Disney’s Marvel and Mattel’s Barbie trust Pullstring’s platform because of its unparalleled scalability and its unique ability to integrate content from creative professionals with expertise in sound, voice, character and dialogue. Even Amazon counts on Pullstring when they want to deliver high quality conversational content.

However, one of the key insights about conversational engagement came early on, during one of their rigorous rounds of user testing & prototyping. After session after session with children, who would use, but not deeply engage with a conversational application, they found it. A trampoline moment.  

Child: Hey
Pullstring: Quick! Name three things you like that are outside.
Child: I think please I’m Chris taxes and jumping on trampolines
Pullstring: W-w-w-w-w-w-wait…you mean like, a real trampoline?
Child: Yeah
Pullstring: Do you think I could go on it sometime? I’ve been using your bed up until now and I think the springs are worn out…
Child: Are you really able to
Pullstring: My oh my, what a day I’ve had…It was so strenuous I can barely remember what I did…Ellington? What have we got in the log?
Pullstring: Right. We sat on the bed. Ellington needed a little rest time from our usual forays.

A couple things you’ll note here:

  1. Speech recognition for children’s speech was very imprecise at the time. The text is not actually what the child said, but the text fed back from the best speech recognition engine of that time.
  2. The child’s willingness to “believe” in Winston (the virtual character, with his friend Ellington) changes dramatically when he demonstrates active listening around one of her favorite things, the trampoline.

This session went on not just for a minute, not just ten minutes, but over 30 minutes. The child had clearly decided to engage, and continued to engage, despite a huge number of imperfections in the interaction.

Why? The trampoline moment.

Turing Test or Trampoline Moment?

For decades, the high bar in artificial intelligence has been the Turing Test, invented by Alan Turing in 1950. The test was fairly simple: an evaluator (human) would have a conversation with two entities, one human and one artificial. If the evaluator could not reliably tell the human from the computer, the machine would “pass” the test.

While there are a number of criticisms of the Turing Test, there is no question that it has profoundly affected the way many evaluate machine-generated conversation.

The insight from the trampoline moment was different, and takes more of its heritage from the world of fiction. The question can be reframed not whether or not the consumer believes the character is human, but instead are they willing to suspend their disbelief long enough to immerse themselves in the experience.

Most people don’t believe that Iron Man is real, or that they are witnessing an accurate portrayal of Alexander Hamilton. They know that the actors in their favorite romantic comedy aren’t really in love, and they forgive plot holes and shallow character development. Even highly critical audiences of science fiction often can and will forgive obvious scientific flaws in the technology presented. (Well, not all of them)

The magic is really in the suspension of disbeliefthe willingness to suspend your own critical faculties and believe the unbelievable; the willingness to sacrifice logic for the sake of enjoyment.

Is it really surprising that a critical insight to human engagement might stem from the arts, where creative geniuses have spent thousands of years attempting to engage and entertain notoriously fickle humans?

Focus on Trampoline Moments, not Intelligence

The progress in artificial intelligence, voice recognition and conversational interfaces has been astounding in the past few years. There is no question that these technologies will reshape almost every facet of our economy and daily lives in the coming decade.

That being said, in Silicon Valley, it is sometimes too easy to focus on the hardest technical problem, rather than the one that will bring the consumer the most delight.

The reason Pullstring spends time talking about finding “trampoline moments” is likely the same reason talented product leaders talk about finding “magic moments” in their product experience. If you can connect with your customer emotionally, you will inevitably find that engagement and retention increase.

Trigger their suspension of disbelief. Find your trampoline moments.