Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7643

ExecMapper static states lead to unpredictable query result.[Spark Branch]

Log workAgile BoardRank to TopRank to BottomVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.1.0
    • Component/s: Spark
    • Labels:
      None

      Description

      ExecMapper contain static states, static variable "done" for example. Spark executor may execute multi tasks concurrently, ExecMapper static state updated by one task would influence the logic of another task, which may lead to unpredictable result. To reproduce, execute

      SELECT COUNT(*) FROM TEST TABLESAMPLE(1 ROWS) s
      

      ,
      TEST should be a table with several blocks source data.

        Attachments

        1. HIVE-7643.2-spark.patch
          12 kB
          Chengxiang Li
        2. HIVE-7643.2-spark.patch
          12 kB
          Brock Noland
        3. HIVE-7643.1-spark.patch
          12 kB
          Chengxiang Li

        Issue Links

          Activity

          $i18n.getText('security.level.explanation', $currentSelection) Viewable by All Users
          Cancel

            People

            • Assignee:
              chengxiang li Chengxiang Li Assign to me
              Reporter:
              chengxiang li Chengxiang Li

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment