Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-19708

Repl copy retrying with cm path even if the failure is due to network issue

    XMLWordPrintableJSON

    Details

    • Target Version/s:

      Description

      • During repl load
        • for filesystem based copying of file if the copy fails due to a connection error to source Name Node, we should recreate the filesystem object.
        • the retry logic for local file copy should be triggered using the original source file path ( and not the CM root path ) since failure can be due to network issues between DFSClient and NN.
      • When listing files in tables / partition to include them in _files, we should add retry logic when failure occurs. FileSystem object here also should be recreated since the existing one might be in inconsistent state.

        Attachments

        1. HIVE-19708.01.patch
          7 kB
          mahesh kumar behera
        2. HIVE-19708.02.patch
          7 kB
          mahesh kumar behera
        3. HIVE-19708.04.patch
          8 kB
          mahesh kumar behera
        4. HIVE-19708.05.patch
          11 kB
          mahesh kumar behera
        5. HIVE-19708.06.patch
          11 kB
          mahesh kumar behera
        6. HIVE-19708.06-branch-3.patch
          10 kB
          mahesh kumar behera
        7. HIVE-19708.07-branch-3.patch
          10 kB
          mahesh kumar behera

          Activity

            People

            • Assignee:
              maheshk114 mahesh kumar behera
              Reporter:
              maheshk114 mahesh kumar behera
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Due:
                Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 20m
                20m