Pro Spark Streaming
The Zen of Real-time Analytics using Apache Spark
(Sprache: Englisch)
Learn the right cutting-edge skills and knowledge to leverage Spark Streaming to implement a wide array of real-time, streaming applications. This book walks you through end-to-end real-time application development using real-world applications, data,...
Voraussichtlich lieferbar in 3 Tag(en)
versandkostenfrei
Buch (Kartoniert)
38.49 €
- Lastschrift, Kreditkarte, Paypal, Rechnung
- Kostenlose Rücksendung
Produktdetails
Produktinformationen zu „Pro Spark Streaming “
Klappentext zu „Pro Spark Streaming “
Learn the right cutting-edge skills and knowledge to leverage Spark Streaming to implement a wide array of real-time, streaming applications. This book walks you through end-to-end real-time application development using real-world applications, data, and code. Taking an application-first approach, each chapter introduces use cases from a specific industry and uses publicly available datasets from that domain to unravel the intricacies of production-grade design and implementation. The domains covered in Pro Spark Streaming include social media, the sharing economy, finance, online advertising, telecommunication, and IoT. In the last few years, Spark has become synonymous with big data processing. DStreams enhance the underlying Spark processing engine to support streaming analysis with a novel micro-batch processing model. Pro Spark Streaming by Zubair Nabi will enable you to become a specialist of latency sensitive applications by leveraging the key features of DStreams, micro-batch processing, and functional programming. To this end, the book includes ready-to-deploy examples and actual code. Pro Spark Streamingwill act as the bible of Spark Streaming.
What You'll Learn
... mehr
Data scientists, big data experts, BI analysts, and data architects.
- Discover Spark Streaming application development and best practices
- Work with the low-level details of discretized streams
- Optimize production-grade deployments of Spark Streaming via configuration recipes and instrumentation using Graphite, collectd, and Nagios
- Ingest data from disparate sources including MQTT, Flume, Kafka, Twitter, and a custom HTTP receiver
- Integrate and couple with HBase, Cassandra, and Redis
- Take advantage of design patterns for side-effects and maintaining state across the Spark Streaming micro-batch model
- Implement real-time and scalable ETL using data frames, SparkSQL, Hive, and SparkR
- Use streaming machine learning, predictive analytics, and recommendations
- Mesh batch processing with stream processing via the Lambda architecture
Data scientists, big data experts, BI analysts, and data architects.
... weniger
Inhaltsverzeichnis zu „Pro Spark Streaming “
Table of ContentsChapter 1: Introduction to SparkChapter Goal: Introduce the reader to Spark in general. This book does not assume that the reader is already familiar with Spark.
Sub -Topics
- Introduction to Spark and its key selling points
- The programming model
- Architecture
- Introduction to other systems within the ecosystem, such as MLlib, GraphX, SparkSQL, and SparkR
Chapter 2: Spark Streaming
Chapter Goal: Introduces Spark Streaming and the concept of micro batch processing (DStreams)
Sub - Topics
- Introduction to Spark Streaming/DStreams
- Comparison with traditional stream processing
- How Spark Streaming works under the hood
- Programming API and how it relates to the general Spark API
- First sample application using FileInputDStream
Chapter 3: Best Practices
Chapter Goal: To transfer best practices in terms of application development
Sub - Topics:
- Maintaining state in an application
- Data caching to reduce redundant work
- Offloading RDD maintenance to Tachyon
- Fault-tolerance and check-pointing
Chapter Goal: To enable the reader to understand the various data ingestion options, their pros and cons, and their integration with Spark Streaming
Sub - Topics:
1. Introduction to Receivers
2. Kafka
3. Twitter
4. Flume
5. Other sources
6. Writing your own connector. Example Apache Qpid
Chapter 5: Optimizing and maintaining a Spark Streaming application/deployment
Chapter Goal: To help the user in optimizing an application and how it can be maintained in production
Sub - Topics
... mehr
Chapter 6: Spark Streaming, SQL, and R
Chapter Goal: To illustrate how a SQL/Dataframe interface can simplify common transforms
Chapter 7: Streaming Machine Learning
Chapter Goal: Employ MLlib to implement streaming machine learning applications
Chapter Goal: Blending data at rest with data in motion
Chapter 9: Java and Python APIs for Spark Streaming
Chapter Goal: Introduction to Spark Streaming in Java and Python
Chapter 10: Spark Streaming and Beyond
Chapter Goal: Overview of some of the future plans for Spark Streaming from the open source community
- Different configuration parameters and how they affect the application
- Parallelism
- Serialization, memory, etc. enhancements
- Various monitoring and instrumentation options
Chapter 6: Spark Streaming, SQL, and R
Chapter Goal: To illustrate how a SQL/Dataframe interface can simplify common transforms
- Introduction to SparkSQL and SQLContext
- Various SQL constructs
- Integration with R
- Design of a few real-world applications
Chapter 7: Streaming Machine Learning
Chapter Goal: Employ MLlib to implement streaming machine learning applications
- Introduction to streaming algorithms in MLlib
- Real-world applications using streaming MLlib
Chapter Goal: Blending data at rest with data in motion
- Introduction to the Lambda Architecture
- Design of Lambda Architecture using Spark
Chapter 9: Java and Python APIs for Spark Streaming
Chapter Goal: Introduction to Spark Streaming in Java and Python
- Java API
- Python API
Chapter 10: Spark Streaming and Beyond
Chapter Goal: Overview of some of the future plans for Spark Streaming from the open source community
- Project Tungsten and how its CPU and memory improvements can benefit streaming applications
- Links to useful resources
... weniger
Autoren-Porträt von Zubair Nabi
Zubair Nabi is one of the very few computer scientists who have solved Big Data problems in all three domains: academia, research, and industry. He currently works at Qubit, a London-based start up backed by Goldman Sachs, Accel Partners, Salesforce Ventures, and Balderton Capital. Qubit helps retailers understand their customers and provide personalized customer experience, and which has a rapidly growing client base that includes Staples, Emirates, Thomas Cook, and Topshop. Prior to Qubit, he was a researcher at IBM Research, where he worked at the intersection of Big Data systems and analytics to solve real-world problems in the telecommunication, electricity, and urban dynamics space.Zubair's work has been featured in MIT Technology Review, SciDev, CNET, and Asian Scientist, and on Swedish National Radio, among others. He has authored more than 20 research papers, published by some of the top publication venues in computer science including USENIX Middleware, ECML PKDD, and IEEE BigData; and he also has a number of patents to his credit.
Zubair has an MPhil in computer science with distinction from Cambridge.
Bibliographische Angaben
- Autor: Zubair Nabi
- 2016, 1st ed., XIX, 230 Seiten, 61 farbige Abbildungen, Maße: 17,8 x 25,4 cm, Kartoniert (TB), Englisch
- Verlag: Springer, Berlin
- ISBN-10: 1484214803
- ISBN-13: 9781484214800
- Erscheinungsdatum: 14.06.2016
Sprache:
Englisch
Kommentar zu "Pro Spark Streaming"
Schreiben Sie einen Kommentar zu "Pro Spark Streaming".
Kommentar verfassen