Details

    • Type: Sub-task Sub-task
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.5.0
    • Component/s: docs
    • Labels:
      None

      Description

      Document these settings so that recovery can be responsive:

      dfs.socket.timeout = 3sec
      dfs.socket.write.timeout = 5sec
      ipc.client.connect.timeout = 1sec
      ipc.client.connect.max.retries.on.timeouts = 2
      

        Activity

        Hide
        Keith Turner added a comment -

        Eric Newton can you provide some background on why these settings are needed?

        Show
        Keith Turner added a comment - Eric Newton can you provide some background on why these settings are needed?
        Hide
        Eric Newton added a comment -

        To test, stop the datanode and the tserver on the same box with SIGSTOP.

        After the tserver lock is lost, the master calls recoverLease() on the namenode. The namenode tries to talk to the primary node for the pipeline, which is the datanode which is also stopped. Without these settings, the request takes a long time. Eventually, the master calls recoverLease() again, and that restarts the whole cycle.

        There are additional details and analysis in HBASE-8389.

        Show
        Eric Newton added a comment - To test, stop the datanode and the tserver on the same box with SIGSTOP. After the tserver lock is lost, the master calls recoverLease() on the namenode. The namenode tries to talk to the primary node for the pipeline, which is the datanode which is also stopped. Without these settings, the request takes a long time. Eventually, the master calls recoverLease() again, and that restarts the whole cycle. There are additional details and analysis in HBASE-8389 .
        Hide
        Hudson added a comment -

        Integrated in Accumulo-1.5 #93 (See https://builds.apache.org/job/Accumulo-1.5/93/)
        ACCUMULO-1351 document timeout settings for hdfs (Revision 1476220)

        Result = SUCCESS
        ecn :
        Files :

        • /accumulo/branches/1.5/docs/administration.html
        Show
        Hudson added a comment - Integrated in Accumulo-1.5 #93 (See https://builds.apache.org/job/Accumulo-1.5/93/ ) ACCUMULO-1351 document timeout settings for hdfs (Revision 1476220) Result = SUCCESS ecn : Files : /accumulo/branches/1.5/docs/administration.html
        Hide
        Hudson added a comment -

        Integrated in Accumulo-1.5-Hadoop-2.0 #92 (See https://builds.apache.org/job/Accumulo-1.5-Hadoop-2.0/92/)
        ACCUMULO-1351 document timeout settings for hdfs (Revision 1476220)

        Result = SUCCESS
        ecn :
        Files :

        • /accumulo/branches/1.5/docs/administration.html
        Show
        Hudson added a comment - Integrated in Accumulo-1.5-Hadoop-2.0 #92 (See https://builds.apache.org/job/Accumulo-1.5-Hadoop-2.0/92/ ) ACCUMULO-1351 document timeout settings for hdfs (Revision 1476220) Result = SUCCESS ecn : Files : /accumulo/branches/1.5/docs/administration.html
        Hide
        Hudson added a comment -

        Integrated in Accumulo-Trunk #844 (See https://builds.apache.org/job/Accumulo-Trunk/844/)
        ACCUMULO-1351 document timeout settings for hdfs (Revision 1476277)

        Result = UNSTABLE
        ecn :
        Files :

        • /accumulo/trunk
        • /accumulo/trunk/assemble
        • /accumulo/trunk/core
        • /accumulo/trunk/docs/administration.html
        • /accumulo/trunk/examples
        • /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/ZooStore.java
        • /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/zookeeper/ZooSession.java
        • /accumulo/trunk/pom.xml
        • /accumulo/trunk/server
        • /accumulo/trunk/src
        Show
        Hudson added a comment - Integrated in Accumulo-Trunk #844 (See https://builds.apache.org/job/Accumulo-Trunk/844/ ) ACCUMULO-1351 document timeout settings for hdfs (Revision 1476277) Result = UNSTABLE ecn : Files : /accumulo/trunk /accumulo/trunk/assemble /accumulo/trunk/core /accumulo/trunk/docs/administration.html /accumulo/trunk/examples /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/ZooStore.java /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/zookeeper/ZooSession.java /accumulo/trunk/pom.xml /accumulo/trunk/server /accumulo/trunk/src
        Hide
        Hudson added a comment -

        Integrated in Accumulo-Trunk-Hadoop-2.0 #202 (See https://builds.apache.org/job/Accumulo-Trunk-Hadoop-2.0/202/)
        ACCUMULO-1351 document timeout settings for hdfs (Revision 1476277)

        Result = UNSTABLE
        ecn :
        Files :

        • /accumulo/trunk
        • /accumulo/trunk/assemble
        • /accumulo/trunk/core
        • /accumulo/trunk/docs/administration.html
        • /accumulo/trunk/examples
        • /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/ZooStore.java
        • /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/zookeeper/ZooSession.java
        • /accumulo/trunk/pom.xml
        • /accumulo/trunk/server
        • /accumulo/trunk/src
        Show
        Hudson added a comment - Integrated in Accumulo-Trunk-Hadoop-2.0 #202 (See https://builds.apache.org/job/Accumulo-Trunk-Hadoop-2.0/202/ ) ACCUMULO-1351 document timeout settings for hdfs (Revision 1476277) Result = UNSTABLE ecn : Files : /accumulo/trunk /accumulo/trunk/assemble /accumulo/trunk/core /accumulo/trunk/docs/administration.html /accumulo/trunk/examples /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/ZooStore.java /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/zookeeper/ZooSession.java /accumulo/trunk/pom.xml /accumulo/trunk/server /accumulo/trunk/src

          People

          • Assignee:
            Eric Newton
            Reporter:
            Eric Newton
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development