|Monday, 17 October 2016, 11:16 HKT/SGT|
Source: Fujitsu Ltd
|Enables automatic response evaluation in customer interactions in various situations|
TOKYO, Oct 17, 2016 - (JCN Newswire) - Fujitsu Laboratories Ltd. today announced the development of voice-analysis technology that can automatically identify times when customers feel satisfied or dissatisfied in their conversations with service personnel.
|Figure 1: Service personnel training using voice analysis|
|Figure 2: Quantification of voice cheerfulness with this technology|
|Figure 3: Structure of this technology|
Service provided by personnel in support of customers, such as at call centers and bank teller windows, directly relates to the company's image, making training critical. Given this, in the past, efforts have been made to convert conversations with customers to text with speech recognition technology in order to grasp a customer's sense of satisfaction. However, there are cases where the same words can convey either satisfaction or dissatisfaction, depending upon the tone of voice. For this reason, based on word content alone, it was impossible to fully grasp the customer's sense of satisfaction.
Now, using a method that takes into account not only the average pitch of the voice and the degree of variation, but also the characteristic changes at relative points within voice data that covers multiple words - namely at the start or end of speech - Fujitsu has succeeded in a highly accurate quantification of voice cheerfulness. In addition, using machine learning in conjunction with customer-service evaluations, Fujitsu has developed a technology that can automatically identify times in a conversation when a customer is satisfied or dissatisfied with roughly 70% accuracy, as compared with results of a determination made by the human ear.
In a field trial using this technology in Fujitsu Limited and Fujitsu FSAS Inc. call centers, Fujitsu confirmed increases in the efficiency of training, such as monitoring and evaluation of support personnel and feedback on the results, reducing the time required by about 30%. Moreover, there was a greater degree of acceptance by both the evaluator and the person being evaluated due to increased objectivity.
Going forward, Fujitsu Laboratories intends to incorporate this technology into Human Centric AI Zinrai, the AI technology of Fujitsu Limited, and offer it as a product for use in customer-service evaluations and in the training of service personnel in a variety of enterprises that emphasize communication, such as banks and retail stores.
In communication, both remotely, as in call centers and distance learning services, as well as in such face-to-face situations as bank teller windows, the service provided to customers by service personnel is directly related to the company's image. This means that training for service personnel is seen as extremely important.
Until now, information was sometimes gathered through customer surveys and used in training, but in many cases, the only data that could be obtained was the overall evaluation of the service. This made it difficult to determine what service personnel did wrong in the conversation. Also, in addition analyzing purchasing history for individual customers, surveys and other marketing activities, there is a need to discern, based on the customer's actual voice, such as can be heard in call centers, what the customer wants with regard to specific products or services, for example, what the customer's requirements are or what points need improvement. In so doing it is hoped that data from conversations with customers, gathered from service situations where personnel interact directly with customers, could be used in such areas as evaluating the quality of service, training employees, and marketing strategies.
Figure 1: Service personnel training using voice analysis
Previously, there were efforts to grasp customer feelings by converting conversations with customers to text using voice recognition software, but not only do actual conversations not always follow ordinary grammar, but they can also be impacted by surrounding noise. As a result, there were many technological difficulties in converting conversations to text through voice recognition, such as many instances where the conversion was incorrect. In addition, even if people use the same words, the meaning may change in a variety of ways depending on their emotions, so it was difficult to correctly interpret the customer's emotions using methods that analyze speech that has been converted to text.
About the Technology
Fujitsu has now developed technology to automatically determine times in a conversation when customers feel satisfied or dissatisfied based on features of their voices in relation to the way they are speaking with service personnel. With this technology, customer service personnel and service providers can rapidly evaluate service content and improve support methods. Features of the newly developed technology are as follows.
Technology to quantify "voice cheerfulness" from patterns of changes in voice pitch
A cheerful voice is ordinarily one with a high tone, or one in which the voice's tone and volume change a great deal. Moreover, Fujitsu Laboratories has determined through proprietary research that cheerful voices have unique characteristics of change at the beginnings and endings of statements. As a result, by using a method that takes into account unique changes at relative positions in voice data across multiple words, in addition to analyzing a voice's average pitch and changes, Fujitsu Laboratories has succeeded in accurately quantifying the cheerfulness of a voice (Figure 2).
Figure 2: Quantification of voice cheerfulness with this technology
In addition, because there is a highly correlated relationship between perceived voice cheerfulness and degree of satisfaction, Fujitsu Laboratories has quantified the sense of satisfaction in a conversation, using the quantified cheerfulness of a voice in a proprietary conversion formula based on survey results (Figure 3). By combining this with customer-service evaluations, and using machine learning to find a threshold point between satisfaction and dissatisfaction, Fujitsu Laboratories has developed technology to automatically identify times during a conversation when the customer is satisfied or dissatisfied. With the learning, the customer can adopt the results of the response evaluation on site, and fixed standards can also be customized for each location.
Figure 3: Structure of this technology
With this technology, Fujitsu Laboratories was able to determine times of satisfaction and dissatisfaction in conversations in customer service situations with about 70% accuracy compared with results of a determination made with the human ear. This has made it easier, in training customer service personnel, for the person receiving the results to understand which parts of the conversation were good or bad, leading to efficient improvement in service skills.
This technology was field tested in three of Fujitsu and Fujitsu FSAS's call centers. In addition to this technology, the trial used evaluation tools that also implemented technology to identify problem areas in customer interaction, such as when service personnel spoke over customers or paused too long before responding. As a result, the field test confirmed that not only were there great increases in the efficiency of training through monitoring and evaluating service personnel and providing feedback on the results, with a 30% reduction in time required, but the acceptance of the evaluation by both the evaluator and person being evaluated was significantly increased because of the increased objectivity of the evaluation.
This technology can be expected to lead to improvements in customers' sense of satisfaction and training efficiency due to increased service skills in a variety of customer contact situations, including call centers.
By combining this technology with Fujitsu Limited's digital solutions and services, such as automatic interactive answering services, Fujitsu Laboratories is working on initiatives to extract information on highly satisfactory features from products customers offer for use in marketing analysis, as well as service that adapts on the fly to customers' sense of dissatisfaction. Plans call for commercialization as a call center-related service, offered by Fujitsu and Fujitsu FSAS, by the end of March 2017.
In addition, by using this technology in a way that strengthens the sensory-media technology that is part of Human Centric AI Zinrai, Fujitsu Limited's AI technology, Fujitsu Laboratories aims to commercialize it for use in a variety of situations, such as bank teller windows, retail, healthcare and training, by the end of March 2019.
About Fujitsu Laboratories
Founded in 1968 as a wholly owned subsidiary of Fujitsu Limited, Fujitsu Laboratories Ltd. is one of the premier research centers in the world. With a global network of laboratories in Japan, China, the United States and Europe, the organization conducts a wide range of basic and applied research in the areas of Next-generation Services, Computer Servers, Networks, Electronic Devices and Advanced Materials. For more information, please see: http://www.fujitsu.com/jp/group/labs/en/.
About Fujitsu Ltd
Fujitsu is the leading Japanese information and communication technology (ICT) company, offering a full range of technology products, solutions, and services. Approximately 132,000 Fujitsu people support customers in more than 100 countries. We use our experience and the power of ICT to shape the future of society with our customers. For more information, please see www.fujitsu.com.
This release can be found at https://www.fujitsu.com/global/about/resources/news/press-releases/2019/.
Fujitsu Laboratories Ltd.
Media Processing Laboratory
E-mail: [email protected]
Public and Investor Relations
Oct 17, 2016 11:16 HKT/SGT
Source: Fujitsu Ltd
Fujitsu Ltd (TSE: 6702)
Topic: Press release summary
From the Asia Corporate News Network
Copyright © 2019 ACN Newswire. All rights reserved. A division of Asia Corporate News Network.
|Oct 22, 2019 04:00 HKT/SGT|
Fujitsu, SMU and A*STAR Launch Digital Platform Experimentation Project using Quantum-Inspired Computing and Deep Learning Technology|
|Oct 15, 2019 15:25 HKT/SGT|
Fujitsu's Gymnastics Judging Support System Wins the "Minister of Internal Affairs and Communications Award" at CEATEC 2019|
|Oct 15, 2019 15:09 HKT/SGT|
Fujitsu Develops AI based Facial Expression Recognition Technology to Accurately Detect Subtle Changes in Expression|
|Oct 8, 2019 10:20 HKT/SGT|
Fujitsu Launches New Stream Data Processing Platform to Accelerate Use of Automotive Big Data|
|Oct 7, 2019 16:54 HKT/SGT|
Fujitsu Chosen for the Dow Jones Sustainability World Index for 20th Time|
|Oct 2, 2019 12:36 HKT/SGT|
"A step towards the future" with the First Official Use of Fujitsu Technology to Support Judging at the 2019 Artistic Gymnastics World Championships|
|Sept 30, 2019 10:18 HKT/SGT|
Fujitsu Establishes the Fujitsu Group External Advisory Committee on AI Ethics to Ensure the Safe and Secure Deployment of AI in Society|
|Sept 27, 2019 10:31 HKT/SGT|
Fujitsu Develops Technology to Deliver Stable System Quality Even with Frequent Updates to "Microservice" Application Elements|
|Sept 26, 2019 13:40 HKT/SGT|
Fujitsu's Fort# Forum to Support Compliance with Security Standard NIST SP 800-171 for Information Protection in Tandem with Exostar|
|Sept 24, 2019 13:55 HKT/SGT|
JST, Fujitsu, and Tokyo Metropolitan University Develop Highly Sensitive Diode, Converts Microwaves to Electricity|
|More news >>|