How to determine if a new transformation in spark causes the creation of a stage? is there a list of them ?
Asked
Active
Viewed 59 times
How to determine if a new transformation in spark causes the creation of a stage? is there a list of them ?
There are some common operator like reducebykey,groupbykey that can cause to shuffle.You can visit spark offical website to learn more.
