To Örebro University

oru.seÖrebro University Publications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Q-Learning with a growing RBF network for behavior learning in mobile robotics
Örebro University, Department of Technology. (Learning Systems Lab)
Örebro University, Department of Technology. (Learning Systems Lab)
2005 (English)In: Proceedings,  IASTED International Conference on Robotics and Applications: RA 2005 / [ed] L. A. Gerhardt, 2005Conference paper, Published paper (Refereed)
Abstract [en]

The use of artificial neural networks for approximating value functions in reinforcement learning is a common practice, but usually requires much work on designing the network architecture and refining of the network parame ters. In this paper we present a simple learning system that uses Q-learning with a resource allocating network (RAN) for behaviour learning in mobile robotics. The resource allocating network is used as a function approximator to dynamically represent the continuous sensory space, thus acquiring the sensorimotor mapping for generalization; and Q-learning is used to learn the control policy in ‘off-policy’ fashion that enables the human operator to guide the initial learning process, thus speeding up the reinforcement learn ing. We illustrate our approach using a PeopleBot robot to acquire a wall-following behaviour, and discuss some ob servations on the convergence and online training of our learning algorithm in the experiments.

Place, publisher, year, edition, pages
2005.
National Category
Computer Sciences
Research subject
Computer and Systems Science
Identifiers
URN: urn:nbn:se:oru:diva-3998ISBN: 0-88986-521-3 (print)OAI: oai:DiVA.org:oru-3998DiVA, id: diva2:138297
Conference
IASTED International Conference on Robotics and Applications, RA 2005, October 31 – November 2, 2005, Cambridge, USA
Available from: 2007-09-03 Created: 2007-09-03 Last updated: 2022-08-04Bibliographically approved

Open Access in DiVA

No full text in DiVA

Authority records

Duckett, Tom

Search in DiVA

By author/editor
Duckett, Tom
By organisation
Department of Technology
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 397 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf