Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-17595

Correct DAG for updating the last.repl.id for a database during bootstrap load

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 3.0.0
    • 3.0.0
    • HiveServer2
    • None

    Description

      We update the last.repl.id as a database property. This is done after all the bootstrap tasks to load the relevant data are done and is the last task to be run. however we are currently not setting up the DAG correctly for this task. This is getting added as the root task for now where as it should be the last task to be run in a DAG. This becomes more important after the inclusion of
      HIVE-17426 since this will lead to parallel execution and incorrect DAG's will lead to incorrect results/state of the system.

      Attachments

        1. HIVE-17595.0.patch
          10 kB
          Anishek Agarwal
        2. HIVE-17595.1.patch
          12 kB
          Anishek Agarwal
        3. HIVE-17595.2.patch
          12 kB
          Anishek Agarwal
        4. HIVE-17595.3.patch
          13 kB
          Anishek Agarwal
        5. HIVE-17595.4.patch
          24 kB
          Anishek Agarwal
        6. HIVE-17595.5.patch
          25 kB
          Anishek Agarwal

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            anishek Anishek Agarwal Assign to me
            anishek Anishek Agarwal
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment