I’m investing substantial time and effort in helping people to better understand what all the hype around AI and conversational commerce technologies like chatbots and intelligent digital assistants is about. It can be rather overwhelming in my experience. And I don’t blame you. I’m overwhelmed at times by all this news on A.I. induced jobless futures and fully automated and self-learning machines as well. It looks as if A.I. will change the world before we can even say “what?”. But we know better.
Why use statistics if we can apply math?
I am convinced Natural Language Processing (NLP) and Machine Learning techniques can do great things, and will be able to do even greater things in the future. But it will take some time and many learnings before we get there. Progress has to be made, and will be made for sure. Just not through claiming ever greater disruptive breakthroughs that are based on assumptions, not evidence. Progress will also not be made by seeing A.I. and machine learning in specific, as the panacea to all problems.
As I’ve been saying in this post: Stop asking the machine to find the most probable answer if you know it with certainty yourself. Just provide the machine with the answer and instruct it to provide it when the question pops up. In most cases this will be a faster fix than asking the machine to learn the answer by comparing 100k+ inputs (Q’s) and outputs (A’s) to come up with the best estimate for the answer. This is specifically true since machine learning algorithms tend to make mistakes and therefor require human supervision.
Invest in relevance, not long tail understanding.
Also, NLP has intent recognition rates of 85% to 95%, depending a bit on the width of the application and the time spent on improving it (should be on the high end after a year). You can of course spend hundred thousands of dollars into getting it to 99,8% or better. But should you? In my experience the return does not often justify the investment. What does justify the investment, is making the answers more relevant to the customer/user by using context and personalisation.
Think of it, what is the reason your customer still makes a call after he’s read the airlines luggage policy? Right, he wants to know what that means to him as an occasional flyer with a last minute discounted ticket on a transatlantic flight. Better NLP will not provide him with the answer he’s looking for. A more personally relevant answer will. And of course the threshold for your company could be at 96% or 84% intent recognition. The exact rate is not the point, the point is you should know when to apply other strategies to improve the customer’s experience and get their jobs done.
AI has reached the peak of inflated expectations
Gartner believes that AI has now passed the peak of inflated expectations. That’s good news for all of us, but mostly for you. Because now you can start using AI, without the BS. And you can start using it to solve your problems and those of your customers, not the problem of a company that lacks experience in the field and has a ‘feeling close to certainty’ that conversational artificial intelligence will change the way the world spins.