Spill occurs as a result of executing various wide transformations. However, diagnosing spill requires one to proactively look for key indicators.
Where in the Spark UI are two of the primary indicators that a partition is spilling to disk?
Stage’s detail screen and Executor’s files
Stage’s detail screen and Query’s detail screen
Driver’s and Executor’s log files
Executor’s detail screen and Executor’s log files
Submit