Intelligence Satisfaction Score (ISAT)
An industry-first framework to measure the effectiveness of an intelligent virtual assistant
An industry-first framework to measure the effectiveness of an intelligent virtual assistant
Only 2% of users share feedback about their experience with a virtual assistant
Useful but does not say anything about queries resolved, false positives, confidence threshold, etc.
Standard market metrics such as retention rate, engagement, avg time spent, etc. are not applicable for virtual assistants
Complex multi-turn conversations can have various sentiments that make it difficult to analyze
Steps to Arrive at the ISAT for a given virtual assistant or chatbot
Analyzing Positive, Negative and Neutral ISAT Conversations
When the IVA fails to recognize the real intent of the user, it sends a wrong response causing False positives, thereby affecting the user experience negatively.
An IVA ‘breaks’ when it is unable to recognize the intent of the user. An IVA designer configures a response to be sent to the user in such a scenario to convey the context and scope of the IVA.
For one of the world’s largest insurance companies, we used the ISAT as a benchmark to improve the quality of the IVA, thereby improving the overall NPS
“Our customers often contact us with the same kind of requests. Using Haptik, we built Zuri and we have been able to achieve greater business efficiency and 70% end-to-end query resolution. In addition to the positive response from our customers, Zuri has helped us to offer 24x7 support to complement our HelpPoint timings and ensure we are there when our customers need us the most.”
— Mark Cady, Head of Operations, Zurich International
Sign up to recieve the latest updates
