Machine Learning in Radio Resource Scheduling

Abstract

In access networks, the radio resource management is designed to deal with the system capacity maximization while the quality of service (QoS) requirements need be satisfied for different types of applications. In particular, the radio resource scheduling aims to allocate users' data packets in frequency domain at each predefined transmission time intervals (TTIs), time windows used to trigger the user requests and to respond them accordingly. At each TTI, the scheduling procedure is conducted based on a scheduling rule that aims to focus only on particular scheduling objective such as fairness, delay, packet loss, or throughput requirements. The purpose of this chapter is to formulate and solve an aggregate optimization problem that selects at each TTI the most convenient scheduling rule in order to maximize the satisfaction of all scheduling objectives concomitantly TTI-by-TTI. The use of reinforcement learning is proposed to solve such complex multi-objective optimization problem and to ease the decision making on which scheduling rule should be applied at each TTI.