Deep Reinforcement Learning for Wireless Communications and Networking: Theory, Applications and Implementation

Deep Reinforcement Learning for Wireless Communications and Networking

Comprehensive guide to Deep Reinforcement Learning (DRL) as applied to wireless communication systems

Deep Reinforcement Learning for Wireless Communications and Networking presents an overview of the development of DRL while providing fundamental knowledge about theories, formulation, design, learning models, algorithms and implementation of DRL together with a particular case study to practice. The book also covers diverse applications of DRL to address various problems in wireless networks, such as caching, offloading, resource sharing, and security. The authors discuss open issues by introducing some advanced DRL approaches to address emerging issues in wireless communications and networking.

Covering new advanced models of DRL, e.g., deep dueling architecture and generative adversarial networks, as well as emerging problems considered in wireless networks, e.g., ambient backscatter communication, intelligent reflecting surfaces and edge intelligence, this is the first comprehensive book studying applications of DRL for wireless networks that presents the state-of-the-art research in architecture, protocol, and application design.

Deep Reinforcement Learning for Wireless Communications and Networking covers specific topics such as:

• Deep reinforcement learning models, covering deep learning, deep reinforcement learning, and models of deep reinforcement learning
• Physical layer applications covering signal detection, decoding, and beamforming, power and rate control, and physical-layer security
• Medium access control (MAC) layer applications, covering resource allocation, channel access, and user/cell association
• Network layer applications, covering traffic routing, network classification, and network slicing

With comprehensive coverage of an exciting and noteworthy new technology, Deep Reinforcement Learning for Wireless Communications and Networking is an essential learning resource for researchers and communications engineers, along with developers and entrepreneurs in autonomous systems, who wish to harness this technology in practical applications.

《深度強化學習在無線通訊和網路中的應用》

《深度強化學習在無線通訊和網路中的應用》是一本全面介紹深度強化學習（DRL）在無線通訊系統中應用的指南。本書提供了DRL的發展概述，並提供了有關理論、公式、設計、學習模型、算法和實現DRL的基礎知識，並通過一個特定的案例研究來進行實踐。本書還涵蓋了DRL在無線網絡中解決各種問題的多樣應用，例如緩存、卸載、資源共享和安全性。作者通過介紹一些先進的DRL方法來解決無線通訊和網路中出現的新問題，討論了開放問題。

本書涵蓋了DRL的新進階模型，例如深度對決架構和生成對抗網絡，以及無線網絡中考慮的新問題，例如環境背散射通訊、智能反射表面和邊緣智能。這是第一本全面研究DRL在無線網絡中應用的書籍，介紹了架構、協議和應用設計的最新研究。

《深度強化學習在無線通訊和網路中的應用》涵蓋了以下特定主題：
- 深度強化學習模型，包括深度學習、深度強化學習和深度強化學習模型
- 物理層應用，包括信號檢測、解碼和波束成形、功率和速率控制，以及物理層安全性
- 媒介存取控制（MAC）層應用，包括資源分配、通道存取和用戶/小區關聯
- 網路層應用，包括流量路由、網路分類和網路切片

《深度強化學習在無線通訊和網路中的應用》是一本重要的學習資源，適用於研究人員和通訊工程師，以及自主系統領域的開發人員和企業家，他們希望在實際應用中利用這項技術。

Dinh Thai Hoang, Ph.D., is a faculty member at the University of Technology Sydney, Australia. He is also an Associate Editor of IEEE Communications Surveys & Tutorials and an Editor of IEEE Transactions on Wireless Communications, IEEE Transactions on Cognitive Communications and Networking, and IEEE Transactions on Vehicular Technology.

Nguyen Van Huynh, Ph.D., obtained his Ph.D. from the University of Technology Sydney in 2022. He is currently a Research Associate in the Department of Electrical and Electronic Engineering, Imperial College London, UK.

Diep N. Nguyen, Ph.D., is Director of Agile Communications and Computing Group and a member of the Faculty of Engineering and Information Technology at the University of Technology Sydney, Australia.

Ekram Hossain, Ph.D., is a Professor in the Department of Electrical and Computer Engineering at the University of Manitoba, Canada, and a Fellow of the IEEE. He co-authored the Wiley title Radio Resource Management in Multi-Tier Cellular Wireless Networks (2013).

Dusit Niyato, Ph.D., is a Professor in the School of Computer Science and Engineering at Nanyang Technological University, Singapore. He co-authored the Wiley title Radio Resource Management in Multi-Tier Cellular Wireless Networks (2013).

博士Dinh Thai Hoang是澳洲悉尼科技大學的教職員，同時也是IEEE Communications Surveys & Tutorials的副編輯，以及IEEE Transactions on Wireless Communications, IEEE Transactions on Cognitive Communications and Networking和IEEE Transactions on Vehicular Technology的編輯。

博士Nguyen Van Huynh於2022年獲得悉尼科技大學的博士學位，目前是英國倫敦帝國學院電氣與電子工程系的研究助理。

博士Diep N. Nguyen是澳洲悉尼科技大學敏捷通訊和計算群組的主任，也是工程與資訊技術學院的成員。

博士Ekram Hossain是加拿大曼尼托巴大學電機與電腦工程系的教授，同時也是IEEE的會士。他是2013年Wiley出版的Radio Resource Management in Multi-Tier Cellular Wireless Networks的合著者。

博士Dusit Niyato是新加坡南洋理工大學計算機科學與工程學院的教授。他也是2013年Wiley出版的Radio Resource Management in Multi-Tier Cellular Wireless Networks的合著者。