|
|
D'Ambrosio, D.B. & Stanley, K.O., 2008. Generative Encoding for Multiagent Learning. Atlanta, Georgia.
Abstract: This paper argues that multiagent learning is a potential \killer application" for generative and developmental sys- tems (GDS) because key challenges in learning to coordinate a team of agents are naturally addressed through indirect encodings and information reuse. For example, a signicant problem for multiagent learning is that policies learned sepa- rately for dierent agent roles may nevertheless need to share a basic skill set, forcing the learning algorithm to reinvent the wheel for each agent. GDS is a good match for this kind of problem because it specializes in ways to encode patterns of related yet varying motifs. In this paper, to establish the promise of this capability, the Hypercube-based NeuroEvo- lution of Augmenting Topologies (HyperNEAT) generative approach to evolving neurocontrollers learns a set of coor- dinated policies encoded by a single genome representing a team of predator agents that work together to capture prey. Experimental results show that it is not only possible, but benecial to encode a heterogeneous team of agents with an indirect encoding. The main contribution is thus to open up a signicant new application domain for GDS.
Keywords: ArtificialAgents; NeuralNets
|
|
|
|
Darley, V., 1999. Towards a Theory of Autonomous, Optimising Agents. Ph.D. thesis. Harvard Universtiy.
Abstract: I seek an understanding of the collective dynamics of systems of agents operating under an optimising dynamic. An autonomous agent has independent agency and decision-making capability. Placed in a system of such agents, however, the consequences of its actions, and hence its preferred choice of action (since it strives to behave optimally) are in°uenced and constrained by the activity of other agents. My work is divided into two complementary halves: the ¯rst examining the global consequences of local interactions; the second examines how the existence of global goals places requirements on the nature of those local interactions. Applications of the former lie primarily in the ¯eld of economic modelling; the latter in the ¯eld of distributed optimisation: (I) I propose a method for modelling economics systems in which outcomes depend locally on the predictions agents make of other agents. I investigate the circumstances under which coordination or coordination failure occurs in these predictive systems, and under which they will or will not evolve to (a) utilise all available information, (b) a rational expectations state. I analyse the observed punctuated equilibrium phenomena, and derive approximations to these complex economic systems, showing how qualitatively di®erent regimes of behaviour, and chaotic dynamics can naturally arise. (II) I present a new analysis of the NK search problem, demonstrating the existence of a sudden transition in problem di±culty. The theoretical predic- tions are compared with extensive empirical data from real problem instances. A novel stochastic optimisation algorithm is then introduced, derived from argu- ments motivated by the study of self-organised criticality in natural and arti¯cial systems. Its results and dynamics on several standard NP-complete problems are analysed. Comparisons are made with several of the standard optimisation heuristics used in computer science. I argue that emergent systems are those in which even perfect knowledge and understanding may give us no predictive information. In them the optimal means of prediction is simulation. I discuss the nature of boundedness and emergence in complex systems, arti¯cial intelligence and economics, and the ways in which simulation can help to develop rigorous scienti¯c theories. This thesis is motivated by the application of mathematical analysis to prob- lems which lie on the boundary of Applied Mathematics and the disciplines of Economics, Arti¯cial Intelligence and Computer Science, and so I also situate this work as best possible within the context of its relationships with these other ¯elds.
Keywords: ArtificialAgents
|
|
|
|
Darley, V., Outkin, A., Plate, T. & Gao, F., 2001. Learning, Evolution and Tick Size Effects in a Simulation of the Nasdaq Stock Market.
Abstract: This paper presents the results of our research into the behavior of a dealer-mediated stock market, similar to Nasdaq, by using an agent-based model of the market. We modeled on an individual level the decision-making process of market ma kers (dealers) and investors, as well as explicitly mo deling market infrastructure and rules. The model allows investigation of market behaviors under a variety of scenarios and conditions. As our main goal, we investigated possible effects of tick size reduction, and found that in the simulated market environment it may result in decreasing the market’s ability to perform the function of price discovery. Calibrating the model, we discovered that it exhibits a number of behaviors normally associated with real-world scenarios, such as the presence of fat tails, spread clustering, etc. We also created learning market makers and investigated their behavior and the strategies they use. We found that there is a variety of conditions under which artificial learning strategies outperform those extracted from the data or from the expert knowledge.
Keywords: ArtificialAgents
|
|
|
|
Farmer, J.D., 2001. Toward Agent-Based Models for Investment, AIMR.
Abstract: Although agent-based models are not yet ready for practical investment application, they can yield powerful insights about market behavior, particularly in regard to the “second order” inefficiencies that create profit-making opportunities. When practical use of agent-based models becomes possible (perhaps within the next five years), their effectiveness will cause securities prices to change.
Keywords: ArtificialAgents
|
|
|
|
Gou, C.. Predictability of Shanghai Stock Market by Agent-based Mix-game Model.
Abstract: This paper1 reports the effort of using agent-based mix-game model to predict financial time series. It introduces simple generic algorithm into the prediction methodology, and gives an example of its application to forecasting Shanghai Index. The results show that this prediction methodology is effective and agent-based mix-game model is a potential good model to predict time series of financial markets.
Keywords: ArtificialAgents
|
|
|
|
Jeannequin, N.. Modelling the Stock Market: Chaos, Stochastic processes, Agent based models. Ph.D. thesis.
Abstract: In the course of this special topic, I decided with Dr. Patrick McSharry to analyze the stock market. My aim in this special topic is threefold: to analyze whether chaotic (deterministic) models can be applied to the stock market, explain why simple stochastic models do not reproduce the stock market entirely and lastly, present a relatively new method called agent based modelling.
Keywords: ArtificialAgents
|
|
|
|
Johnson, N.F. et al, 2001. Application of multi-agent games to the prediction of financial time-series.
Keywords: ArtificialAgents
|
|
|
|
Kearns, M. & Wortman, J.. Learning from Collective Behavior.
Keywords: ArtificialAgents
|
|