Apache Spark Graph Processing

Rindra Ramamonjison

Apache Spark Graph Processing
  • 出版商: Packt Publishing
  • 出版日期: 2015-09-10
  • 售價: $1,540
  • 貴賓價: 9.5 折 $1,463
  • 語言: 英文
  • 頁數: 148
  • 裝訂: Paperback
  • ISBN: 1784391808
  • ISBN-13: 9781784391805
  • 相關分類: Spark

    • 海外代購書籍(需單獨結帳)

買這商品的人也買了...

商品描述

Build, process and analyze large-scale graph data effectively with Spark

About This Book

  • Find solutions for every stage of data processing from loading and transforming graph data to
  • Improve the scalability of your graphs with a variety of real-world applications with complete Scala code.
  • A concise guide to processing large-scale networks with Apache Spark.

Who This Book Is For

This book is for data scientists and big data developers who want to learn the processing and analyzing graph datasets at scale. Basic programming experience with Scala is assumed. Basic knowledge of Spark is assumed.

What You Will Learn

  • Write, build and deploy Spark applications with the Scala Build Tool.
  • Build and analyze large-scale network datasets
  • Analyze and transform graphs using RDD and graph-specific operations
  • Implement new custom graph operations tailored to specific needs.
  • Develop iterative and efficient graph algorithms using message aggregation and Pregel abstraction
  • Extract subgraphs and use it to discover common clusters
  • Analyze graph data and solve various data science problems using real-world datasets.

In Detail

Apache Spark is the next standard of open-source cluster-computing engine for processing big data. Many practical computing problems concern large graphs, like the Web graph and various social networks. The scale of these graphs - in some cases billions of vertices, trillions of edges - poses challenges to their efficient processing. Apache Spark GraphX API combines the advantages of both data-parallel and graph-parallel systems by efficiently expressing graph computation within the Spark data-parallel framework.

This book will teach the user to do graphical programming in Apache Spark, apart from an explanation of the entire process of graphical data analysis. You will journey through the creation of graphs, its uses, its exploration and analysis and finally will also cover the conversion of graph elements into graph structures.

This book begins with an introduction of the Spark system, its libraries and the Scala Build Tool. Using a hands-on approach, this book will quickly teach you how to install and leverage Spark interactively on the command line and in a standalone Scala program. Then, it presents all the methods for building Spark graphs using illustrative network datasets. Next, it will walk you through the process of exploring, visualizing and analyzing different network characteristics. This book will also teach you how to transform raw datasets into a usable form. In addition, you will learn powerful operations that can be used to transform graph elements and graph structures. Furthermore, this book also teaches how to create custom graph operations that are tailored for specific needs with efficiency in mind. The later chapters of this book cover more advanced topics such as clustering graphs, implementing graph-parallel iterative algorithms and learning methods from graph data.

Style and approach

A step-by-step guide that will walk you through the key ideas and techniques for processing big graph data at scale, with practical examples that will ensure an overall understanding of the concepts of Spark.

商品描述(中文翻譯)

以Spark有效地構建、處理和分析大規模圖形數據

關於本書



  • 從加載和轉換圖形數據到每個數據處理階段找到解決方案

  • 通過完整的Scala代碼提高圖形的可擴展性，並應用於各種實際應用

  • 一本關於使用Apache Spark處理大規模網絡的簡明指南


本書適合對象


本書適合數據科學家和大數據開發人員，他們希望學習在大規模圖形數據集上進行處理和分析。假設具備Scala的基本編程經驗和Spark的基本知識。


你將學到什麼



  • 使用Scala Build Tool編寫、構建和部署Spark應用程序

  • 構建和分析大規模網絡數據集

  • 使用RDD和圖形特定操作分析和轉換圖形

  • 根據特定需求實現新的自定義圖形操作

  • 使用消息聚合和Pregel抽象開發迭代和高效的圖形算法

  • 提取子圖並使用它來發現常見的集群

  • 使用真實世界數據集分析圖形數據並解決各種數據科學問題


詳細內容


Apache Spark是下一代開源集群計算引擎，用於處理大數據。許多實際計算問題涉及大型圖形，如Web圖形和各種社交網絡。這些圖形的規模 - 在某些情況下可能有數十億個頂點，數萬億個邊 - 對其高效處理提出了挑戰。Apache Spark GraphX API通過在Spark數據並行框架內有效地表達圖形計算，結合了數據並行和圖形並行系統的優勢。


本書將教您在Apache Spark中進行圖形編程，並解釋整個圖形數據分析過程。您將通過創建圖形、使用圖形、探索和分析圖形以及將圖形元素轉換為圖形結構的過程進行學習。


本書首先介紹Spark系統、其庫和Scala Build Tool。通過實踐方法，本書將快速教您如何在命令行和獨立Scala程序中交互式安裝和利用Spark。然後，它介紹了使用具有說明性網絡數據集構建Spark圖形的所有方法。接下來，它將引導您通過探索、可視化和分析不同的網絡特性的過程。本書還將教您如何將原始數據集轉換為可用形式。此外，您還將學習到可以用於轉換圖形元素和圖形結構的強大操作。此外，本書還教您如何創建針對特定需求並具有高效性的自定義圖形操作。本書的後幾章涵蓋了更高級的主題，如圖形集群化、實現圖形並行迭代算法和從圖形數據中學習方法。


風格和方法


這是一本逐步指南，將引導您了解處理大規模圖形數據的關鍵思想和技術，並通過實際示例確保對Spark概念的整體理解。

類似商品