Persona-based Multi-turn Conversation Model in an Adversarial Learning Framework - arXiv 1905.01998v1

Aug 21, 2026

Upload by Đào

Persona-based multi-turn dialogue research extends a persona-aware sequence-to-sequence conversation model by modifying the state-of-the-art hredGAN architecture. The approach adds an extra encoder/decoder input modality so the model can condition on external attributes such as speaker identity, location, sub-topics, and other corpus-provided signals. The resulting persona hredGAN (phredGAN) improves performance versus persona Seq2Seq and baseline hredGAN when such attributes are available. Experiments on TV drama character-consistent datasets and the Ubuntu dialogue corpus evaluate perplexity, BLEU, ROUGE, and Distinct n-gram scores.

LanguageEnglish

CategoryResearch & Report

FormatPDF

Pages6

Reading Time15 min

AccessFree to download

Abstract

Introduction

Limitations of existing dialogue models

Prior work on consistency and diversity

Prior work on persona in dialogue

Proposed phredGAN approach

Training and evaluation datasets

Results and analysis (metrics and samples)

A Persona-based Multi-turn Conversation Model inan Adversarial Learning Framework Oluwatobi O. Olabiyi Capital One Conversation Research Vienna, VA Email: [oluwatobi.olabiyi@capitalone.com](oluwatobi.olabiyi@capitalone.com) Anish Khazane Capital One Conversation Research San Francisco, CA Email: [anish.khazane@capitalone.com](anish.khazane@capitalone.com) Erik T. Mueller Capital One Conversation Research Vienna, VA Email: [erik.mueller@capitalone.com](erik.mueller@capitalone.com) arXiv : 1905 .01998v1 [ cs .CL] 29 Apr 2019 Abstract—In this paper, we extend the persona-based sequenceto-sequence (Seq2Seq) neural network conversation model to multi-turn dialogue by modifying the state-of-the-art hredGAN architecture. To achieve this, we introduce an additional input modality into the encoder and decoder of hredGAN to capture other attributes such as speaker identity, location, sub-topics, and other external attributes that might be available from the corpus of human-to-human interactions. The resulting persona hredGAN (phredGAN ) shows better performance than both the existing persona-based Seq2Seq and hredGAN models when those external attributes are available in a multi-turn dialogue corpus. This superiority is demonstrated on TV drama series with character consistency (such as Big Bang Theory and Friends) and customer service interaction datasets such as Ubuntu dialogue corpus in terms of perplexity, BLEU, ROUGE, and Distinct ngram scores. I. INTRODUCTION Recent advances in machine learning especially with deep neural networks has led to tremendous progress in natural language processing and dialogue modeling research [1]–[3] . Nevertheless, developing a good conversation model capable of ﬂuent interactions between a human and a machine is still in its infancy. Most existing work relies on a limited dialogue history to produce responses with the assumption that the model parameters will capture all the modalities within a dataset. However, this is not true as dialogue corpora tend to be strongly multi-modal and practical neural network models ﬁnd it difﬁcult to disambiguate characteristics such as speaker personality, location, and sub-topic in the data. Most work in this domain has primarily focused on optimizing dialogue consistency. For example, Serban et al. [3]–[5] and Xing et al. [6] introduce a Hierarchical Recurrent Encoder-Decoder (HRED) network architecture that combines a series of recurrent neural networks to capture long-term context state within a dialogue. However, the HRED system suffers from lack of diversity and does not support any guarantees on the generator output since the output conditional probability is not calibrated. Olabiyi et al. [7] tackle this problem by training a modiﬁed HRED generator alongside an adversarial discriminator in order to provide a stronger guarantee to the generator's output. While the hredGAN system improves upon response quality, it does not capture speaker and other attributes modalities within a dataset and fails to generate persona-speciﬁc responses in datasets with multiple modalities. At the same time, there has been some recent work on introducing persona into dialogue models. For example, Liet al. [8] integrate learnable speaker attributes into a singleturn (Seq2Seq) generative dialogue model. In this work, Li et al. consider persona models: one with Speaker-only representation and another with Speaker and Addressee representations (Speaker-Addressee model), both of which capture aspects of speaker identity and interactions. Nguyen et al. [9] continue the same line of thought by considering a Seq2Seq dialogue model with Responder-only representations. In both cases, the attribute representation is learned during the system training. Zhang et al. [10] propose a slightly different approach. Here, the attributes are a set of sentences describing the proﬁle of the speaker. In this case, the attribute representation is not learned. The system how

FAQs

Which datasets and metrics are used to demonstrate the model’s advantages?

Evaluation uses character-consistent TV drama scripts (e.g., The Big Bang Theory and Friends) and the Ubuntu dialogue corpus. Performance is reported using perplexity, BLEU, ROUGE, and Distinct n-gram scores, alongside qualitative output samples.

Aug 21, 2026

Upload by Đào