Information Theory and Rate Distortion Theory (Paperback)

Jerry Gibson

商品描述

This book is very specifically targeted to problems in communications and compression by providing the fundamental principles and results in information theory and rate distortion theory for these applications and presenting methods that have proved and will prove useful in analyzing and designing real systems. The chapters contain treatments of entropy, mutual information, lossless source coding, channel capacity, and rate distortion theory; however, it is the selection, ordering, and presentation of the topics within these broad categories that is unique to this concise book. While the coverage of some standard topics is shortened or eliminated, the standard, but important, topics of the chain rules for entropy and mutual information, relative entropy, the data processing inequality, and the Markov chain condition receive a full treatment. Similarly, lossless source coding techniques presented include the Lempel-Ziv-Welch coding method. The material on rate Distortion theory and exploring fundamental limits on lossy source coding covers the often-neglected Shannon lower bound and the Shannon backward channel condition, rate distortion theory for sources with memory, and the extremely practical topic of rate distortion functions for composite sources.

The target audience for the book consists of graduate students at the master's degree level and practicing engineers. It is hoped that practicing engineers can work through this book and comprehend the key results needed to understand the utility of information theory and rate distortion theory and then utilize the results presented to analyze and perhaps improve the communications and compression systems with which they are familiar.

Table of Contents: Preface / Communications, Compression and Fundamental Limits / Entropy and Mutual Information / Lossless Source Coding / Channel Capacity / Rate Distortion Theory and Lossy Source Coding / Bibliography / Author's Biography

商品描述(中文翻譯)

這本書非常專注於通訊和壓縮問題,提供了資訊理論和速率失真理論在這些應用中的基本原理和結果,並介紹了在分析和設計實際系統中已被證明有用的方法。各章節涵蓋了熵、互信息、無損源編碼、信道容量和速率失真理論的內容;然而,本書獨特之處在於在這些廣泛的類別中選擇、排序和呈現主題。雖然一些標準主題的內容被縮短或省略,但熵和互信息的鏈式規則、相對熵、數據處理不等式和馬爾可夫鏈條件等標準但重要的主題得到了充分的探討。同樣,無損源編碼技術的介紹包括了Lempel-Ziv-Welch編碼方法。有關速率失真理論和對有損源編碼的基本限制的探索,涵蓋了常被忽視的Shannon下界和Shannon反向信道條件,以及對具有記憶的源的速率失真理論和複合源的速率失真函數等實用主題。

本書的目標讀者是碩士學位水平的研究生和實踐工程師。希望實踐工程師能通過閱讀本書,理解資訊理論和速率失真理論的實用性,並利用所介紹的結果來分析和改進他們熟悉的通訊和壓縮系統。

目錄:前言 / 通訊、壓縮和基本限制 / 熵和互信息 / 無損源編碼 / 信道容量 / 速率失真理論和有損源編碼 / 參考文獻 / 作者簡介