Data Lake Development with Big Data

Pradeep Pasupuleti, Beulah Salome Purra

  • 出版商: Packt Publishing
  • 出版日期: 2015-11-30
  • 售價: $1,560
  • 貴賓價: 9.5$1,482
  • 語言: 英文
  • 頁數: 164
  • 裝訂: Paperback
  • ISBN: 1785888080
  • ISBN-13: 9781785888083
  • 相關分類: 大數據 Big-data
  • 海外代購書籍(需單獨結帳)

買這商品的人也買了...

商品描述

Explore architectural approaches to building Data Lakes that ingest, index, manage, and analyze massive amounts of data using Big Data technologies

About This Book

  • Comprehend the intricacies of architecting a Data Lake and build a data strategy around your current data architecture
  • Efficiently manage vast amounts of data and deliver it to multiple applications and systems with a high degree of performance and scalability
  • Packed with industry best practices and use-case scenarios to get you up-and-running

Who This Book Is For

This book is for architects and senior managers who are responsible for building a strategy around their current data architecture, helping them identify the need for a Data Lake implementation in an enterprise context. The reader will need a good knowledge of master data management and information lifecycle management, and experience of Big Data technologies.

What You Will Learn

  • Identify the need for a Data Lake in your enterprise context and learn to architect a Data Lake
  • Learn to build various tiers of a Data Lake, such as data intake, management, consumption, and governance, with a focus on practical implementation scenarios
  • Find out the key considerations to be taken into account while building each tier of the Data Lake
  • Understand Hadoop-oriented data transfer mechanism to ingest data in batch, micro-batch, and real-time modes
  • Explore various data integration needs and learn how to perform data enrichment and data transformations using Big Data technologies
  • Enable data discovery on the Data Lake to allow users to discover the data
  • Discover how data is packaged and provisioned for consumption
  • Comprehend the importance of including data governance disciplines while building a Data Lake

In Detail

A Data Lake is a highly scalable platform for storing huge volumes of multistructured data from disparate sources with centralized data management services. This book explores the potential of Data Lakes and explores architectural approaches to building data lakes that ingest, index, manage, and analyze massive amounts of data using batch and real-time processing frameworks. It guides you on how to go about building a Data Lake that is managed by Hadoop and accessed as required by other Big Data applications.

This book will guide readers (using best practices) in developing Data Lake's capabilities. It will focus on architect data governance, security, data quality, data lineage tracking, metadata management, and semantic data tagging. By the end of this book, you will have a good understanding of building a Data Lake for Big Data.

Style and approach

Data Lake Development with Big Data provides architectural approaches to building a Data Lake. It follows a use case-based approach where practical implementation scenarios of each key component are explained. It also helps you understand how these use cases are implemented in a Data Lake. The chapters are organized in a way that mimics the sequential data flow evidenced in a Data Lake.

商品描述(中文翻譯)

探索使用大數據技術建立能夠接收、索引、管理和分析大量數據的數據湖的架構方法

關於本書



  • 了解建立數據湖的複雜性,並圍繞當前的數據架構建立數據策略

  • 高效管理大量數據,並將其傳遞給多個應用程序和系統,具有高度的性能和可擴展性

  • 充滿行業最佳實踐和使用案例,讓您能夠快速上手

本書適合對象


本書適合負責圍繞當前數據架構建立策略的架構師和高級經理,幫助他們在企業環境中確定數據湖實施的需求。讀者需要對主數據管理和信息生命周期管理有良好的了解,並具有大數據技術的經驗。

您將學到什麼



  • 在企業環境中確定數據湖的需求,並學習如何架構數據湖

  • 學習構建數據湖的各個層次,例如數據接收、管理、使用和治理,並聚焦於實際實施場景

  • 了解在構建數據湖的每個層次時需要考慮的關鍵因素

  • 了解基於Hadoop的數據傳輸機制,以批量、微批和實時模式接收數據

  • 探索各種數據集成需求,並學習如何使用大數據技術進行數據豐富和數據轉換

  • 實現數據湖上的數據發現,讓用戶能夠發現數據

  • 了解數據如何打包和提供給使用者

  • 了解在構建數據湖時包含數據治理紀律的重要性

詳細內容


數據湖是一個高度可擴展的平台,用於存儲來自不同來源的大量多結構數據,並提供集中的數據管理服務。本書探討了數據湖的潛力,並探索了使用批處理和實時處理框架構建數據湖的架構方法。它指導您如何構建一個由Hadoop管理並根據其他大數據應用程序的需求進行訪問的數據湖。


本書將指導讀者(使用最佳實踐)開發數據湖的能力。它將聚焦於架構數據治理、安全性、數據質量、數據譜系追踪、元數據管理和語義數據標記。通過閱讀本書,您將對構建大數據數據湖有很好的理解。

風格和方法


《大數據數據湖開發》提供了構建數據湖的架構方法。它採用基於用例的方法,解釋了每個關鍵組件的實際實施場景。它還幫助您了解這些用例在數據湖中的實現方式。本書的章節組織方式模仿了數據湖中的順序數據流。