A wonderful comprehensive read from #Google_Brain and #DeepmindAI on the challenges which we can come across while implementing RL on real-world systems.
Paper-Title: Challenges of Real-World Reinforcement learning
Link to the paper: https://arxiv.org/abs/1904.12901
They highlighted 9 most important challenges as follows:
1. Training off-line from the fixed logs of an external behavior policy.
2. Learning on the real system from limited samples.
3. High-dimensional continuous state and action spaces.
4. Safety constraints that should never or at least rarely be violated.
5. Tasks that may be partially observable, alternatively viewed as non-stationary or stochastic.
6. Reward functions that are unspecified, multi-objective,or risk-sensitive.
7. System operators who desire explainable policies and actions.
8. Inference that must happen in real-time at the controlfrequency of the system.
9. Large and/or unknown delays in the system actuators,sensors, or rewards.
Paper-Title: Challenges of Real-World Reinforcement learning
Link to the paper: https://arxiv.org/abs/1904.12901
They highlighted 9 most important challenges as follows:
1. Training off-line from the fixed logs of an external behavior policy.
2. Learning on the real system from limited samples.
3. High-dimensional continuous state and action spaces.
4. Safety constraints that should never or at least rarely be violated.
5. Tasks that may be partially observable, alternatively viewed as non-stationary or stochastic.
6. Reward functions that are unspecified, multi-objective,or risk-sensitive.
7. System operators who desire explainable policies and actions.
8. Inference that must happen in real-time at the controlfrequency of the system.
9. Large and/or unknown delays in the system actuators,sensors, or rewards.
arXiv.org
Challenges of Real-World Reinforcement Learning
Reinforcement learning (RL) has proven its worth in a series of artificial domains, and is beginning to show some successes in real-world scenarios. However, much of the research advances in RL...