Major Description
Use AQE runtime statistics to decide if we can use shuffled hash join instead of sort merge join. Currently, the formula of shuffled hash join selection does not work due to the dymanic shuffle partition number.
Add a new config `spark.sql.adaptive.maxShuffledHashJoinLocalMapThreshold` to decide if join can be converted to shuffled hash join safely.
