Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7643

ExecMapper static states lead to unpredictable query result.[Spark Branch]

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.1.0
    • Component/s: Spark
    • Labels:
      None

      Description

      ExecMapper contain static states, static variable "done" for example. Spark executor may execute multi tasks concurrently, ExecMapper static state updated by one task would influence the logic of another task, which may lead to unpredictable result. To reproduce, execute

      SELECT COUNT(*) FROM TEST TABLESAMPLE(1 ROWS) s
      

      ,
      TEST should be a table with several blocks source data.

        Attachments

        1. HIVE-7643.1-spark.patch
          12 kB
          Chengxiang Li
        2. HIVE-7643.2-spark.patch
          12 kB
          Brock Noland
        3. HIVE-7643.2-spark.patch
          12 kB
          Chengxiang Li

          Issue Links

            Activity

              People

              • Assignee:
                chengxiang li Chengxiang Li
                Reporter:
                chengxiang li Chengxiang Li
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: