Conversational Recommender System

Citations Over TimeTop 1% of 2018 papers

Abstract

A personalized conversational sales agent could have much commercial potential. E-commerce companies such as Amazon, eBay, JD, Alibaba etc. are piloting such kind of agents with their users. However, the research on this topic is very limited and existing solutions are either based on single round adhoc search engine or traditional multi round dialog system. They usually only utilize user inputs in the current session, ignoring users' long term preferences. On the other hand, it is well known that sales conversion rate can be greatly improved based on recommender systems, which learn user preferences based on past purchasing behavior and optimize business oriented metrics such as conversion rate or expected revenue. In this work, we propose to integrate research in dialog systems and recommender systems into a novel and unified deep reinforcement learning framework to build a personalized conversational recommendation agent that optimizes a per session based utility function. In particular, we propose to represent a user conversation history as a semi-structured user query with facet-value pairs. This query is generated and updated by belief tracker that analyzes natural language utterances of user at each step. We propose a set of machine actions tailored for recommendation agents and train a deep policy network to decide which action (i.e. asking for the value of a facet or making a recommendation) the agent should take at each step. We train a personalized recommendation model that uses both the user's past ratings and user query collected in the current conversational session when making rating predictions and generating recommendations. Such a conversational system often tries to collect user preferences by asking questions. Once enough user preference is collected, it makes personalized recommendations to the user. We perform both simulation experiments and real online user studies to demonstrate the effectiveness of the proposed framework.

Related Papers

• → Development and Evaluation of Spoken Dialog Systems with One or Two Agents through Two Domains(2013)8 cited
• → Effect of sympathetic relation and unsympathetic relation in multi-agent spoken dialogue system(2016)3 cited
• → Architecture of a dialog system with an assistant agent(2003)2 cited
• → Domain and Subtask-Adaptive Conversational Agents to Provide an Enhanced Human-Agent Interaction(2014)1 cited
• → Development and evaluation of spoken dialog systems with one or two agents(2013)