Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.0.2-alpha
    • Component/s: namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Sometimes when primary crashes during image transfer secondary namenode would hang trying to read the image from HTTP connection forever.
      It would be great to set timeouts on the connection so if something like that happens there is no need to restart the secondary itself.
      In our case restarting components is handled by the set of scripts and since the Secondary as the process is running it would just stay hung until we get an alarm saying the checkpointing doesn't happen.

      1. HDFS-1490.patch
        6 kB
        Vinayakumar B
      2. HDFS-1490.patch
        6 kB
        Vinayakumar B
      3. HDFS-1490.patch
        5 kB
        Vinayakumar B
      4. HDFS-1490.patch
        4 kB
        Vinayakumar B

        Issue Links

          Activity

          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk #1187 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1187/)
          HDFS-1490. TransferFSImage should timeout. Contributed by Dmytro Molkov and Vinay. (Revision 1380988)

          Result = SUCCESS
          todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1380988
          Files :

          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/TransferFsImage.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestTransferFsImage.java
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #1187 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1187/ ) HDFS-1490 . TransferFSImage should timeout. Contributed by Dmytro Molkov and Vinay. (Revision 1380988) Result = SUCCESS todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1380988 Files : /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/TransferFsImage.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestTransferFsImage.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk #1156 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1156/)
          HDFS-1490. TransferFSImage should timeout. Contributed by Dmytro Molkov and Vinay. (Revision 1380988)

          Result = SUCCESS
          todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1380988
          Files :

          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/TransferFsImage.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestTransferFsImage.java
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #1156 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1156/ ) HDFS-1490 . TransferFSImage should timeout. Contributed by Dmytro Molkov and Vinay. (Revision 1380988) Result = SUCCESS todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1380988 Files : /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/TransferFsImage.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestTransferFsImage.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk-Commit #2707 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2707/)
          HDFS-1490. TransferFSImage should timeout. Contributed by Dmytro Molkov and Vinay. (Revision 1380988)

          Result = FAILURE
          todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1380988
          Files :

          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/TransferFsImage.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestTransferFsImage.java
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #2707 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2707/ ) HDFS-1490 . TransferFSImage should timeout. Contributed by Dmytro Molkov and Vinay. (Revision 1380988) Result = FAILURE todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1380988 Files : /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/TransferFsImage.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestTransferFsImage.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk-Commit #2746 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2746/)
          HDFS-1490. TransferFSImage should timeout. Contributed by Dmytro Molkov and Vinay. (Revision 1380988)

          Result = SUCCESS
          todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1380988
          Files :

          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/TransferFsImage.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestTransferFsImage.java
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #2746 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2746/ ) HDFS-1490 . TransferFSImage should timeout. Contributed by Dmytro Molkov and Vinay. (Revision 1380988) Result = SUCCESS todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1380988 Files : /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/TransferFsImage.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestTransferFsImage.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Common-trunk-Commit #2683 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2683/)
          HDFS-1490. TransferFSImage should timeout. Contributed by Dmytro Molkov and Vinay. (Revision 1380988)

          Result = SUCCESS
          todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1380988
          Files :

          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/TransferFsImage.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestTransferFsImage.java
          Show
          Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #2683 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2683/ ) HDFS-1490 . TransferFSImage should timeout. Contributed by Dmytro Molkov and Vinay. (Revision 1380988) Result = SUCCESS todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1380988 Files : /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/TransferFsImage.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestTransferFsImage.java
          Hide
          Todd Lipcon added a comment -

          Committed to branch-2 and trunk. Thanks Dmytro and Vinay!

          Show
          Todd Lipcon added a comment - Committed to branch-2 and trunk. Thanks Dmytro and Vinay!
          Hide
          Todd Lipcon added a comment -

          +1, looks good to me. Will commit momentarily.

          Show
          Todd Lipcon added a comment - +1, looks good to me. Will commit momentarily.
          Hide
          Hadoop QA added a comment -

          +1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12543666/HDFS-1490.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 1 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in hadoop-hdfs-project/hadoop-hdfs.

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/3141//testReport/
          Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/3141//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - +1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12543666/HDFS-1490.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 1 new or modified test files. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 javadoc. The javadoc tool did not generate any warning messages. +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in hadoop-hdfs-project/hadoop-hdfs. +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/3141//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/3141//console This message is automatically generated.
          Hide
          Vinayakumar B added a comment -

          Fixed typo.
          Added @VisibleForTesting, since 'timeout' is used in test.

          We have tested this in cluster, when the active nn's n/w broken. GetImage call got timeout.

          Show
          Vinayakumar B added a comment - Fixed typo. Added @VisibleForTesting, since 'timeout' is used in test. We have tested this in cluster, when the active nn's n/w broken. GetImage call got timeout.
          Hide
          Steve Loughran added a comment -
          1. typo in DFS_IMAGE_TRANFER_TIMEOUT_KEY
          2. timeout field should be private, not package scoped

          This really needs a functional test that does a kill -STOP `cat /var/run/whatever.pid` and then verifies that a hung process is picked up. The tests I've been doing for HA on the 1.x branch can trigger things like this; we should consider integrating the test framework w/ hadoop, either as an upstream dependency or in bigtop, with the functional HA test suite there.

          Show
          Steve Loughran added a comment - typo in DFS_IMAGE_TRANFER_TIMEOUT_KEY timeout field should be private, not package scoped This really needs a functional test that does a kill -STOP `cat /var/run/whatever.pid` and then verifies that a hung process is picked up. The tests I've been doing for HA on the 1.x branch can trigger things like this; we should consider integrating the test framework w/ hadoop, either as an upstream dependency or in bigtop, with the functional HA test suite there.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12542908/HDFS-1490.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 1 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          -1 findbugs. The patch appears to introduce 1 new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          -1 core tests. The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs:

          org.apache.hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks
          org.apache.hadoop.hdfs.TestHftpDelegationToken

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/3119//testReport/
          Findbugs warnings: https://builds.apache.org/job/PreCommit-HDFS-Build/3119//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-hdfs.html
          Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/3119//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12542908/HDFS-1490.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 1 new or modified test files. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 javadoc. The javadoc tool did not generate any warning messages. +1 eclipse:eclipse. The patch built with eclipse:eclipse. -1 findbugs. The patch appears to introduce 1 new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs: org.apache.hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks org.apache.hadoop.hdfs.TestHftpDelegationToken +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/3119//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HDFS-Build/3119//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-hdfs.html Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/3119//console This message is automatically generated.
          Hide
          Vinayakumar B added a comment -

          Attached the patch with different config

          Show
          Vinayakumar B added a comment - Attached the patch with different config
          Hide
          Vinayakumar B added a comment -

          Why not introduce a new config which defaults to something like 1 minute?

          Ok, agree. Will introduce new config for this.

          In the test case, shouldn't you somehow notify the servlet to exit? Currently it waits on itself, but nothing notifies it.

          That was just added make the client call get timeout. Ideally while stopping the server, that will be interrupted. Anyway I will add a timeout for that also.

          Thanks todd, for comments. I will post new patch in sometime.

          Show
          Vinayakumar B added a comment - Why not introduce a new config which defaults to something like 1 minute? Ok, agree. Will introduce new config for this. In the test case, shouldn't you somehow notify the servlet to exit? Currently it waits on itself, but nothing notifies it. That was just added make the client call get timeout. Ideally while stopping the server, that will be interrupted. Anyway I will add a timeout for that also. Thanks todd, for comments. I will post new patch in sometime.
          Hide
          Todd Lipcon added a comment -
          • I dont like reusing the ipc ping interval for this timeout here. It's from an entirely separate module, and I don't see why one should correlate to the other. Why not introduce a new config which defaults to something like 1 minute?
          • In the test case, shouldn't you somehow notify the servlet to exit? Currently it waits on itself, but nothing notifies it.
          Show
          Todd Lipcon added a comment - I dont like reusing the ipc ping interval for this timeout here. It's from an entirely separate module, and I don't see why one should correlate to the other. Why not introduce a new config which defaults to something like 1 minute? In the test case, shouldn't you somehow notify the servlet to exit? Currently it waits on itself, but nothing notifies it.
          Hide
          Vinayakumar B added a comment -
          	Call to equals() comparing different types in org.apache.hadoop.hdfs.server.datanode.DataNode.recoverBlock(BlockRecoveryCommand$RecoveringBlock)

          Find bug warning unrelated to current patch

          Failed tests:   testHdfsDelegationToken(org.apache.hadoop.hdfs.TestHftpDelegationToken): wrong tokens in user expected:<2> but was:<1>

          Also test failure is unrelated to current patch

          Show
          Vinayakumar B added a comment - Call to equals() comparing different types in org.apache.hadoop.hdfs.server.datanode.DataNode.recoverBlock(BlockRecoveryCommand$RecoveringBlock) Find bug warning unrelated to current patch Failed tests: testHdfsDelegationToken(org.apache.hadoop.hdfs.TestHftpDelegationToken): wrong tokens in user expected:<2> but was:<1> Also test failure is unrelated to current patch
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12542723/HDFS-1490.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 1 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          -1 findbugs. The patch appears to introduce 1 new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          -1 core tests. The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs:

          org.apache.hadoop.hdfs.TestHftpDelegationToken

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/3105//testReport/
          Findbugs warnings: https://builds.apache.org/job/PreCommit-HDFS-Build/3105//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-hdfs.html
          Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/3105//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12542723/HDFS-1490.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 1 new or modified test files. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 javadoc. The javadoc tool did not generate any warning messages. +1 eclipse:eclipse. The patch built with eclipse:eclipse. -1 findbugs. The patch appears to introduce 1 new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs: org.apache.hadoop.hdfs.TestHftpDelegationToken +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/3105//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HDFS-Build/3105//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-hdfs.html Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/3105//console This message is automatically generated.
          Hide
          Ravi Prakash added a comment -

          +1 lgtm

          Show
          Ravi Prakash added a comment - +1 lgtm
          Hide
          Vinayakumar B added a comment -

          Attaching the latest patch

          Show
          Vinayakumar B added a comment - Attaching the latest patch
          Hide
          Vinayakumar B added a comment -

          Attaching the patch

          Show
          Vinayakumar B added a comment - Attaching the patch
          Hide
          Vinayakumar B added a comment -

          Hi Molkov,

          We also faced same problem in 2.0.1.

          Are you planning post any patch on this..?

          Show
          Vinayakumar B added a comment - Hi Molkov, We also faced same problem in 2.0.1. Are you planning post any patch on this..?
          Hide
          Dmytro Molkov added a comment -

          TransferFsImage.getFileClient is the single point of entry for the code that does transfer of the image and edits and it would be great to set timeouts in there.
          However it is also used for telling the namenode it is time to pick up the image from checkpoint. And this call will sit without response until the namenode fetches the image, which can be a while.

          We could either set the timeout to be rather large, giving the namenode enough time to fetch the image or we could set different timeouts for these cases.
          In the second scenario we can theoretically rely on the fact that File[] localPaths passed into getFileClient is null and act accordingly.

          Any thoughts?

          Show
          Dmytro Molkov added a comment - TransferFsImage.getFileClient is the single point of entry for the code that does transfer of the image and edits and it would be great to set timeouts in there. However it is also used for telling the namenode it is time to pick up the image from checkpoint. And this call will sit without response until the namenode fetches the image, which can be a while. We could either set the timeout to be rather large, giving the namenode enough time to fetch the image or we could set different timeouts for these cases. In the second scenario we can theoretically rely on the fact that File[] localPaths passed into getFileClient is null and act accordingly. Any thoughts?

            People

            • Assignee:
              Vinayakumar B
              Reporter:
              Dmytro Molkov
            • Votes:
              0 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development