Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-19708

Repl copy retrying with cm path even if the failure is due to network issue

    XMLWordPrintableJSON

Details

    Description

      • During repl load
        • for filesystem based copying of file if the copy fails due to a connection error to source Name Node, we should recreate the filesystem object.
        • the retry logic for local file copy should be triggered using the original source file path ( and not the CM root path ) since failure can be due to network issues between DFSClient and NN.
      • When listing files in tables / partition to include them in _files, we should add retry logic when failure occurs. FileSystem object here also should be recreated since the existing one might be in inconsistent state.

      Attachments

        1. HIVE-19708.07-branch-3.patch
          10 kB
          mahesh kumar behera
        2. HIVE-19708.06-branch-3.patch
          10 kB
          mahesh kumar behera
        3. HIVE-19708.06.patch
          11 kB
          mahesh kumar behera
        4. HIVE-19708.05.patch
          11 kB
          mahesh kumar behera
        5. HIVE-19708.04.patch
          8 kB
          mahesh kumar behera
        6. HIVE-19708.02.patch
          7 kB
          mahesh kumar behera
        7. HIVE-19708.01.patch
          7 kB
          mahesh kumar behera

        Activity

          People

            maheshk114 mahesh kumar behera
            maheshk114 mahesh kumar behera
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 20m
                20m