Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7643

ExecMapper static states lead to unpredictable query result.[Spark Branch]

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.1.0
    • Spark
    • None

    Description

      ExecMapper contain static states, static variable "done" for example. Spark executor may execute multi tasks concurrently, ExecMapper static state updated by one task would influence the logic of another task, which may lead to unpredictable result. To reproduce, execute

      SELECT COUNT(*) FROM TEST TABLESAMPLE(1 ROWS) s
      

      ,
      TEST should be a table with several blocks source data.

      Attachments

        1. HIVE-7643.1-spark.patch
          12 kB
          Chengxiang Li
        2. HIVE-7643.2-spark.patch
          12 kB
          Brock Noland
        3. HIVE-7643.2-spark.patch
          12 kB
          Chengxiang Li

        Issue Links

          Activity

            People

              chengxiang li Chengxiang Li
              chengxiang li Chengxiang Li
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: