About the Spark UI Simulator - Databricks Academy

Purpose

This application was developed to aid in the instruction of Apache Spark concepts.

Some of these concepts require an inordinate amount of time to demonstrate making it impractical to do so live or otherwise costly for the student to do so on their own time.

For this reason, pre-ran jobs, all the metrics related to the execution of those jobs, the cluster configuration, and the source code for those jobs are bundled with each simulation.

Students are encouraged to reproduce these scenarios to deepen their understand of Apache Spark

Limitations

As a simulator, there are specific, known limitations:

• Not every part of the screen is interactive - only those elements that are deemed relevant to a simulation are enabled.
• The screen is composed of screen shots making it impossible to grep for text the way you would with the a live application.
• Timestamps across a single simulation will be inaccurate - this is a byproduct of having to rerun experiments multiple times to capture different content.