Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-17410

repl load task during subsequent DAG generation does not start from the last partition processed

    XMLWordPrintableJSON

Details

    Description

      DAG generation for repl load task was to be generated dynamically such that if the load break happens at a partition load time then for subsequent runs we should start post the last partition processed.

      We currently identify the point from where we have to process the event but reinitialize the iterator to start from beginning of all partition's to process.

      Attachments

        1. HIVE-17410.1.patch
          8 kB
          Anishek Agarwal
        2. HIVE-17410.2.patch
          8 kB
          Anishek Agarwal
        3. HIVE-17410.3.patch
          10 kB
          Anishek Agarwal

        Issue Links

          Activity

            People

              anishek Anishek Agarwal
              anishek Anishek Agarwal
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: