Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7292 Hive on Spark
  3. HIVE-9099

infer_bucket_sort_convert_join.q and mapjoin_hook.q failed.[Spark Branch]

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.1.0
    • Component/s: Spark
    • Labels:

      Description

      infer_bucket_sort_convert_join.q and mapjoin_hook.q failed after HIVE-9078 due to same reason.
      With the following settings in 2 qfiles:

      set hive.auto.convert.join = true;
      set hive.mapjoin.localtask.max.memory.usage = 0.0001;
      set hive.mapjoin.check.memory.rows = 2;
      set hive.auto.convert.join.noconditionaltask = false;
      

      With MR, MapRedTask of join query would failed at first and then driver execute its backup task which would succeed, while we do not have backup task in Spark mode.

        Attachments

        1. HIVE-9099.1-spark.patch
          0.7 kB
          Xuefu Zhang

          Issue Links

            Activity

              People

              • Assignee:
                xuefuz Xuefu Zhang
                Reporter:
                chengxiang li Chengxiang Li
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: