Restless Multi-Armed Bandit in Opportunistic Scheduling

Kehao Wang received the B.S degree in Electrical Engineering, M.S. degree in Communication and Information System from Wuhan University of Technology, Wuhan, China, in 2003 and 2006, respectively, and Ph.D in the Department of Computer Science, the University of Paris-Sud XI, Orsay, France, in 2012. From Feb. 2013 to Aug. 2013, he was a postdoc with the HongKong Polytechnic University. In 2013, he joined the School of Information Engineering at the Wuhan University of Technology. From 2015 to 2018, he had been a visiting scholar in the Laboratory for Information and Decision Systems, Massachusetts Institute of Technology, Cambridge, MA. USA. His research interests are stochastic optimization, operation research, scheduling, wireless network communications, and embedded operating system.

Lin Chen is a professor in the School of Data and Computer Science at Sun Yat-sen University, which he joined in 2019. He received his B. Sc. degree in Electrical Engineering in 2002 from Southeast University, his M. Sc. in Networking in 2005 from University of Paris 6, and his Engineer Diploma and Ph. D. in Computer Science and Networking in 2005 and 2008 from Telecom ParisTech (ENST). He received his Habilitation thesis at University of Paris-Sud in 2017. He was an associate professor at the Department of Computer Science at University of Paris-Sud from 2009 to 2019. His research is focused on distributed algorithms and protocols in emerging networked systems, with particular emphasis on energy efficiency, resilience, and security.

Introduction.- RMAB in Opportunistic Scheduling.- Optimality of Myopic Policy with Imperfect Sensing.- Whittle Index Policy with Imperfect Sensing.- Heuristic Policy with Imperfect Sensing.- Optimality of Myopic Policy with Imperfect Observation.- Whittle Index Policy for Multi-State Channel Scheduling.- Conclusion.