Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Difference between spark standalone and local mode?

What is the difference between Spark standalone and Local mode?

like image 444
Abhinav Kumar Avatar asked Oct 25 '25 14:10

Abhinav Kumar


1 Answers

Spark standalone is a resource manager which can work on a cluster. It is simply the built in resource manager as opposed to an external one like yarn.

Spark local runs without any resource manager, everything runs in a single jvm (you can decide the number of threads). This is aimed for testing locally.

like image 95
Assaf Mendelson Avatar answered Oct 28 '25 04:10

Assaf Mendelson