Department of Electrical and Electronics Engineering
Permanent URI for this collectionhttp://localhost:4000/handle/123456789/1925
Browse
3 results
Search Results
Item MERGE: Meta Reinforcement Learning for Tunable RL Agents at the Edge(IEEE, 2023-12) Tripathi, ShardaThe efficient allocation of radio resources is an essential trait of 5G/6G radio access networks (RANs), as they are called to meet diverse QoS requirements of highly demanding applications. To equip RANs with such an ability and, at the same time, meet their function split constraints, we envision a distributed learning approach for radio resource allocation that makes the most out of the Central Unit (CU) and Distributed Unit (DU) components by effectively exploiting their synergy. On the one hand, our solution, named MERGE, leverages the knowledge of the radio connectivity dynamics that each DU can acquire through the local use of a deep reinforcement learning radio agent. On the other hand, it lets the CU collect such agents in a crowdsourcing fashion, and, then, thanks to a meta-learning policy, properly select and aggregate them to create up-to-date radio agents of the right size (hence, complexity level) to fit the computing constraints of the individual DUs. Our results show that MERGE can match the performance of the highest-complexity radio model in [1] with 25% less computational requirements, and, for a given computational resource, it outperforms a single pruned model with a 19% increase in QoS.Item Fair and Scalable Orchestration of Network and Compute Resources for Virtual Edge Services(IEEE, 2023-03) Tripathi, ShardaThe combination of service virtualization and edge computing allows for low latency services, while keeping data storage and processing local. However, given the limited resources available at the edge, a conflict in resource usage arises when both virtualized user applications and network functions need to be supported. Further, the concurrent resource request by user applications and network functions is often entangled, since the data generated by the former has to be transferred by the latter, and vice versa. In this paper, we first show through experimental tests the correlation between a video-based application and a vRAN. Then, owing to the complex involved dynamics, we develop a scalable reinforcement learning framework for resource orchestration at the edge, which leverages a Pareto analysis for provable fair and efficient decisions. We validate our framework, named VERA, through a real-time proof-of-concept implementation, which we also use to obtain datasets reporting real-world operational conditions and performance. Using such experimental datasets, we demonstrate that VERA meets the KPI targets for over 96% of the observation period and performs similarly when executed in our real-time implementation, with KPI differences below 12.4%. Further, its scaling cost is 54% lower than a centralized framework based on deep-Q networksItem VERA: Resource Orchestration for Virtualized Services at the Edge(IEEE, 2022) Tripathi, ShardaThe combination of service virtualization and edge computing allows mobile users to enjoy low latency services, while keeping data storage and processing local. However, the network edge has limited resource availability, and when both virtualized user applications and network functions need to be supported concurrently, a natural conflict in resource usage arises. In this paper, we focus on computing and radio resources and develop a framework for resource orchestration at the edge that leverages a model-free reinforcement learning approach and a Pareto analysis, which is proved to make fair and efficient decisions. Through our testbed, we demonstrate the effectiveness of our solution in resource-limited scenarios, and show an improvement of around 60% in the CPU budget violation rate with respect to RL based standard multi-agent framework.