The Azure Data Lakehouse Toolkit: Building and Scaling Data Lakehouses with Delta Lake, Apache Spark, Azure Databricks and Synapse Analytics, and Snow

L'Esteve, Ron

  • 出版商: Apress
  • 出版日期: 2022-07-14
  • 售價: $1,980
  • 貴賓價: 9.5$1,881
  • 語言: 英文
  • 頁數: 390
  • 裝訂: Quality Paper - also called trade paper
  • ISBN: 1484282329
  • ISBN-13: 9781484282328
  • 相關分類: Microsoft AzureSpark
  • 海外代購書籍(需單獨結帳)

商品描述

Design and implement a modern data lakehouse on the Azure Data Platform using Delta Lake, Apache Spark, Azure Databricks, Azure Synapse Analytics, and Snowflake. This book teaches you the intricate details of the Data Lakehouse Paradigm and how to efficiently design a cloud-based data lakehouse using highly performant and cutting-edge Apache Spark capabilities using Azure Databricks, Azure Synapse Analytics, and Snowflake. You will learn to write efficient PySpark code for batch and streaming ELT jobs on Azure. And you will follow along with practical, scenario-based examples showing how to apply the capabilities of Delta Lake and Apache Spark to optimize performance, and secure, share, and manage a high volume, high velocity, and high variety of data in your lakehouse with ease.

The patterns of success that you acquire from reading this book will help you hone your skills to build high-performing and scalable ACID-compliant lakehouses using flexible and cost-efficient decoupled storage and compute capabilities. Extensive coverage of Delta Lake ensures that you are aware of and can benefit from all that this new, open source storage layer can offer. In addition to the deep examples on Databricks in the book, there is coverage of alternative platforms such as Synapse Analytics and Snowflake so that you can make the right platform choice for your needs.

After reading this book, you will be able to implement Delta Lake capabilities, including Schema Evolution, Change Feed, Live Tables, Sharing, and Clones to enable better business intelligence and advanced analytics on your data within the Azure Data Platform.

What You Will Learn

- Implement the Data Lakehouse Paradigm on Microsoft’s Azure cloud platform
- Benefit from the new Delta Lake open-source storage layer for data lakehouses 
- Take advantage of schema evolution, change feeds, live tables, and more
- Write functional PySpark code for data lakehouse ELT jobs
- Optimize Apache Spark performance through partitioning, indexing, and other tuning options
- Choose between alternatives such as Databricks, Synapse Analytics, and Snowflake


Who This Book Is For
Data, analytics, and AI professionals at all levels, including data architect and data engineer practitioners. Also for data professionals seeking patterns of success by which to remain relevant as they learn to build scalable data lakehouses for their organizations and customers who are migrating into the modern Azure Data Platform. 

商品描述(中文翻譯)

在Azure數據平台上使用Delta Lake、Apache Spark、Azure Databricks、Azure Synapse Analytics和Snowflake設計和實現一個現代化的數據湖屋。本書將教授您數據湖屋範式的細節,以及如何使用高性能和尖端的Apache Spark功能在Azure Databricks、Azure Synapse Analytics和Snowflake上高效地設計基於雲的數據湖屋。您將學習編寫在Azure上進行批處理和流處理ELT作業的高效PySpark代碼。並且您將通過實際的場景示例來學習如何應用Delta Lake和Apache Spark的功能來優化性能,以及輕鬆地安全、共享和管理大量、高速和多樣化的數據湖屋中的數據。

從閱讀本書中獲得的成功模式將幫助您磨練技能,使用靈活且具有成本效益的解耦存儲和計算能力來構建高性能和可擴展的ACID兼容的數據湖屋。Delta Lake的廣泛覆蓋確保您了解並能從這個新的開源存儲層中獲益。除了書中對Databricks的深入示例外,還涵蓋了Synapse Analytics和Snowflake等替代平台,以便您可以根據自己的需求做出正確的平台選擇。

閱讀本書後,您將能夠實施Delta Lake的功能,包括模式演進、變更提要、實時表、共享和克隆,以在Azure數據平台上實現更好的商業智能和高級分析。

您將學到以下內容:
- 在Microsoft的Azure雲平台上實施數據湖屋範式
- 利用新的Delta Lake開源存儲層為數據湖屋獲益
- 利用模式演進、變更提要、實時表等功能
- 編寫功能性的PySpark代碼來處理數據湖屋的ELT作業
- 通過分區、索引和其他調優選項來優化Apache Spark的性能
- 在Databricks、Synapse Analytics和Snowflake等替代方案之間進行選擇

本書適合所有級別的數據、分析和人工智能專業人士,包括數據架構師和數據工程師從業者。同時也適合尋求成功模式的數據專業人士,他們希望在他們的組織和客戶遷移到現代Azure數據平台時保持相關性。

作者簡介

Ron C. L’Esteve is a professional author, trusted technology leader, and digital innovation strategist residing in Chicago, IL, USA. He is well-known for his impactful books and award-winning article publications about Azure Data & AI Architecture and Engineering. He possesses deep technical skills and experience in designing, implementing, and delivering modern Azure Data & AI projects for numerous clients around the world.

Having several Azure Data, AI, and Lakehouse certifications under his belt, Ron has been a go-to technical advisor for some of the largest and most impactful Azure implementation projects on the planet. He has been responsible for scaling key data architectures, defining the road map and strategy for the future of data and business intelligence needs, and challenging customers to grow by thoroughly understanding the fluid business opportunities and enabling change by translating them into high-quality and sustainable technical solutions that solve the most complex challenges and promote digital innovation and transformation.

Ron is a gifted presenter and trainer, known for his innate ability to clearly articulate and explain complex topics to audiences of all skill levels. He applies a practical and business-oriented approach by taking transformational ideas from concept to scale. He is a true enabler of positive and impactful change by championing a growth mindset.

作者簡介(中文翻譯)

Ron C. L'Esteve 是一位居住在美國伊利諾伊州芝加哥的專業作家、值得信賴的技術領導者和數位創新策略師。他以對於 Azure Data & AI 架構和工程的深入研究而聞名,並出版了具有影響力的書籍和獲獎文章。他擁有豐富的技術技能和經驗,為世界各地的眾多客戶設計、實施和交付現代化的 Azure Data & AI 專案。

Ron 擁有多項 Azure Data、AI 和 Lakehouse 認證,成為全球最大且最具影響力的 Azure 實施專案的首選技術顧問。他負責擴展關鍵的資料架構,為未來的資料和商業智能需求定義路線圖和策略,並通過將其轉化為高品質和可持續的技術解決方案,解決最複雜的挑戰,促進數位創新和轉型。

Ron 是一位天賦異稟的演講者和培訓師,以其清晰明確地闡述和解釋複雜主題的能力而聞名。他以實用和以業務為導向的方式,將轉型的想法從概念推向規模化。他是一位真正的促進者,通過倡導成長思維,實現積極和有影響力的變革。