Reinforcement learning algorithm based on minimum state method and average reward

LIU Quan1; FU Qi-ming1; GONG Sheng-rong1; FU Yu-chen1; CUI Zhi-ming1

您当前的位置：

首页 >

文章列表页 >

Reinforcement learning algorithm based on minimum state method and average reward

更新时间：2024-10-14

- Reinforcement learning algorithm based on minimum state method and average reward
- Vol. 32, Issue 1, Pages: 66-71(2011)
- 作者机构：
  
  1. 苏州大学计算机科学与技术学院
  2. 南京大学软件新技术国家重点实验室
- 作者简介：
- 基金信息：
- DOI：
  CLC： TP181
- Published：2011
- 稿件说明：
移动端阅览
LIU Quan1, FU Qi-ming1, GONG Sheng-rong1, et al. Reinforcement learning algorithm based on minimum state method and average reward[J]. 2011, 32(1): 66-71.
DOI：

LIU Quan1, FU Qi-ming1, GONG Sheng-rong1, et al. Reinforcement learning algorithm based on minimum state method and average reward[J]. 2011, 32(1): 66-71. DOI：

摘要

针对采用折扣奖赏作为评价目标的Q学习无法体现对后续动作的影响问题

提出将平均奖赏和Q学习相结合的AR-Q-Learning算法

并进行收敛性证明。针对学习参数个数随着状态变量维数呈几何级增长的"维数灾"问题

提出最小状态变元的思想。将最小变元思想和平均奖赏用于积木世界的强化学习中

试验结果表明

该方法更具有后效性

加快算法的收敛速度

同时在一定程度上解决积木世界中的"维数灾"问题。

Abstract

In allusion to the problem that Q-Learning

which was used discount reward as the evaluation criterion

could not show the affect of the action to the next situation

AR-Q-Learning was put forward based on the average reward and Q-Learning.In allusion to the curse of dimensionality

which meant that the computational requirement grew exponen-tially with the number of the state variable.Minimum state method was put forward.AR-Q-Learning and minimum state method were used in reinforcement learning for Blocks World

and the result of the experiment shows that the method has the characteristic of aftereffect and converges more faster than Q-Learning

and at the same time

solve the curse of di-mensionality in a certain extent in Blocks World.

关键词

Keywords

references

Views

875

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

RL-WGAN based method for 5G network anomalous data generation

Study on Co-EDCA mechanism for multi-AP collaboration in FTTR C-WAN architecture

Design and implementation of an IPv6+ based intelligent computing-network scheduling scheme for Internet of vehicles

Survey of node localization scheme in underwater wireless sensor network

Adaptive defense model for critical assets against unknown network threats

Related Author

Ning Zhaolong

Zou Daoyuan

Zhou Li

Ouyang Ruiqi

Xiong Xuanrui

WU Weimin

ZENG Chen

YU Zhaoyang

Related Institution

College of Electronic Science and Technology, National University of Defense Technology

School of Communications and Information Engineering, Chongqing University of Posts and Telecommunications

School of Electronic Information and Communication, Huazhong University of Science and Technology

Intelligent and Connected Vehicle Research Institute, China Unicom Smart Connection Technology Limited

School of Computer Science, Beijing University of Posts and Telecommunications

AI问答

⁰