Description
My spark job have three partions. This cause many logs entry of type:
"Skipping partition based on stats ..." in SPARK_WORKDIR/<my_app_id>/stderr
We should add a check to disable this kind of working or move the loglevel from Info to Debug