Digital Heritage Reconstruction Using Super-resolution and Inpainting (Synthesis Lectures on Visual Computing: Computer Graphics, Animation, Computational Photography, and Imaging)

Heritage sites across the world have witnessed a number of natural calamities, sabotage and damage from visitors, resulting in their present ruined condition. Many sites are now restricted to reduce the risk of further damage. Yet these masterpieces are significant cultural icons and critical markers of past civilizations that future generations need to see. A digitally reconstructed heritage site could diminish further harm by using immersive navigation or walkthrough systems for virtual environments. An exciting key element for the viewer is observing fine details of the historic work and viewing monuments in their undamaged form. This book presents image super-resolution methods and techniques for automatically detecting and inpainting damaged regions in heritage monuments, in order to provide an enhanced visual experience.

The book presents techniques to obtain higher resolution photographs of the digitally reconstructed monuments, and the resulting images can serve as input to immersive walkthrough systems. It begins with the discussion of two novel techniques for image super-resolution and an approach for inpainting a user-supplied region in the given image, followed by a technique to simultaneously perform super-resolution and inpainting of given missing regions. It then introduces a method for automatically detecting and repairing the damage to dominant facial regions in statues, followed by a few approaches for automatic crack repair in images of heritage scenes. This book is a giant step toward ensuring that the iconic sites of our past are always available, and will never be truly lost.

世界各地的文化遺產地曾經經歷過許多自然災害、破壞和遊客的破壞，導致它們現在的狀況十分破敗。為了減少進一步的損害風險，許多遺址現在已經限制進入。然而，這些傑作是重要的文化象徵和過去文明的重要標誌，未來的世代需要看到它們。通過使用沉浸式導航或虛擬環境的步行系統，數位重建的文化遺產地可以減少進一步的損害。對觀眾來說，觀察歷史作品的細節和以未受損的形式觀看紀念碑是一個令人興奮的關鍵元素。本書介紹了圖像超分辨率方法和技術，用於自動檢測和修補文化遺產建築中的損壞區域，以提供更好的視覺體驗。

本書介紹了獲取數位重建文化遺產建築更高解析度照片的技術，並且生成的圖像可以作為沉浸式步行系統的輸入。首先討論了兩種新穎的圖像超分辨率技術和修補給定圖像中用戶提供的區域的方法，接著介紹了一種同時進行超分辨率和修補缺失區域的技術。然後介紹了一種自動檢測和修復雕像主要面部區域損壞的方法，接著介紹了一些自動修復文化遺產場景圖像中裂縫的方法。本書是確保我們過去的標誌性遺址始終可用並永遠不會真正遺失的重要一步。