View in EDS

Learning bidding strategies with autonomous agents in environments with unstable equilibrium

Saved in:
Bibliographic Details
Title: Learning bidding strategies with autonomous agents in environments with unstable equilibrium
Authors: Sikora, Riyaz T. rsikora@uta.edu, Sachdev, Vishal1 vsachdev@uta.edu
Source: Decision Support Systems. Dec2008, Vol. 46 Issue 1, p101-114. 14p.
Subjects: Automation, Decision support systems, Electronic commerce, Artificial intelligence, Economists, Strategic planning, Bidding strategies
Abstract: The role of automated agents for decision support in the electronic marketplace has been growing steadily and has been attracting a lot of research from the artificial intelligence community as well as from economists. In this paper, we study the efficacy of using automated agents for learning bidding strategies in contexts of strategic interaction involving multiple sellers in reverse auctions. Standard game-theoretic analysis of the problem assumes completely rational and omniscient agents to derive Nash equilibrium seller policy. Most of the literature on use of learning agents uses convergence to Nash equilibrium as the validating criterion. In this paper, we consider a problem where the Nash equilibrium is unstable and hence not useful as an evaluation criterion. Instead, we propose that agents should be able to learn the optimal or best response strategies when they exist (rational behavior) and should demonstrate low variance in profits (convergence). We present rationally bounded, evolutionary and reinforcement learning agents that learn these desirable properties of rational behavior and convergence. [Copyright &y& Elsevier]
Copyright of Decision Support Systems is the property of Elsevier B.V. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Description
Abstract:The role of automated agents for decision support in the electronic marketplace has been growing steadily and has been attracting a lot of research from the artificial intelligence community as well as from economists. In this paper, we study the efficacy of using automated agents for learning bidding strategies in contexts of strategic interaction involving multiple sellers in reverse auctions. Standard game-theoretic analysis of the problem assumes completely rational and omniscient agents to derive Nash equilibrium seller policy. Most of the literature on use of learning agents uses convergence to Nash equilibrium as the validating criterion. In this paper, we consider a problem where the Nash equilibrium is unstable and hence not useful as an evaluation criterion. Instead, we propose that agents should be able to learn the optimal or best response strategies when they exist (rational behavior) and should demonstrate low variance in profits (convergence). We present rationally bounded, evolutionary and reinforcement learning agents that learn these desirable properties of rational behavior and convergence. [Copyright &y& Elsevier]
ISSN:01679236
DOI:10.1016/j.dss.2008.05.005