Saad Khan's Publications

Sorted by DateClassified by Publication TypeClassified by Research Category

The education of a crook: reinforcement learning in social-cultural settings

T.S. Bhatia, S.A. Khan, and L. Bölöni. The education of a crook: reinforcement learning in social-cultural settings. In Proc. of 13th Int'l Conf. on Autonomous Agents and Multiagent Systems, (AAMAS), 2014.

Download

[PDF] 

Abstract

The ability to manipulate social and cultural values in order to achieve one's own goals is a hard-to-teach but profitable skill. In this paper we represent a complex social scenario, the Spanish Steps flower selling scam, using a social calculus framework based on culture sanctioned social metrics (CSSMs) and concrete beliefs (CBs). Then, we show how a crooked seller can learn a profitable strategy through reinforcement learning. Although the search space defined by the social calculus is large, we found that function approximation based Q-learning allows us to successfully learn efficient strategies in a relatively small number of runs. The learned strategy allows the seller to manipulate an unprepared tourist's social values of politeness and dignity, as well as his perception of the peers and crowds opinion. This allows the seller to manipulate some of his opponents to act against their own interests by purchasing an overpriced flower while well-knowing that they are being cheated.

BibTeX

@incollection{Bhatia-2014-AAMAS,
   title = "The education of a crook: reinforcement learning in social-cultural settings",
   author = "T.S. Bhatia and S.A. Khan and L. B{\"o}l{\"o}ni",
   booktitle = "Proc. of 13th Int'l Conf. on Autonomous Agents and Multiagent Systems, (AAMAS)",
   year = "2014",
   bib2html_dl_pdf =
   {http://www.eecs.ucf.edu/~skhan/Publications/Download/TBhatia-2014-AAMAS.pdf},
   bib2html_pubtype = {Refereed Conference},
   bib2html_rescat = {Autonomous Agents},
   abstract = {
The ability to manipulate social and cultural values in order to achieve one's own goals is a hard-to-teach but profitable skill. In this paper we represent a complex social scenario, the Spanish Steps flower selling scam, using a social calculus framework based on culture sanctioned social metrics (CSSMs) and concrete beliefs (CBs). Then, we show how a crooked seller can learn a profitable strategy through reinforcement learning. Although the search space defined by the social calculus is large, we found that function approximation based Q-learning allows us to successfully learn efficient strategies in a relatively small number of runs. The learned strategy allows the seller to manipulate an unprepared tourist's social values of politeness and dignity, as well as his perception of the peers and crowds opinion. This allows the seller to manipulate some of his opponents to act against their own interests by purchasing an overpriced flower while well-knowing that they are being cheated.  
}
}

Generated by bib2html.pl (written by Patrick Riley, Saad Khan ) on Thu Jul 10, 2014 15:43:58