The Author Online Book Forums are Moving

The Author Online Book Forums will soon redirect to Manning's liveBook and liveVideo. All book forum content will migrate to liveBook's discussion forum and all video forum content will migrate to liveVideo. Log in to liveBook or liveVideo with your Manning credentials to join the discussion!

Thank you for your engagement in the AoF over the years! We look forward to offering you a more enhanced forum experience.

Jean Georges Perrin (15) [Avatar] Offline
#1
Hi y'all,

All the examples have been updated to the latest release of Apache Spark, v2.4.0, which has been announced earlier this month.

You will find the source code examples there:

Chapter 1 - So, what is Spark, anyway?
https://github.com/jgperrin/net.jgp.books.sparkWithJava.ch01

Chapter 2 - Architecture and flows
https://github.com/jgperrin/net.jgp.books.sparkWithJava.ch02

Chapter 3 - The majestic role of the dataframe
https://github.com/jgperrin/net.jgp.books.sparkWithJava.ch03

Chapter 4 - Fundamentally lazy
https://github.com/jgperrin/net.jgp.books.sparkWithJava.ch04

Chapter 5 - Building a simple app for deployment
https://github.com/jgperrin/net.jgp.books.sparkWithJava.ch05

Chapter 6 - Deploying your simple app
Note: chapter 6 uses chapter 5's code and repository.
https://github.com/jgperrin/net.jgp.books.sparkWithJava.ch05

Chapter 7 - Ingestion from files
https://github.com/jgperrin/net.jgp.books.sparkWithJava.ch07

Chapter 8 - Ingestion from databases
https://github.com/jgperrin/net.jgp.books.sparkWithJava.ch08

Chapter 9 - Advanced ingestion: finding data sources & building your own
https://github.com/jgperrin/net.jgp.books.sparkWithJava.ch09

Note that the version of Scala used "behind the scene" is v2.11 as Spark v2.4.0's early support for Scala v2.12 is still early.