Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.5.0
    • Component/s: docs
    • Labels:
      None

      Description

      Document these settings so that recovery can be responsive:

      dfs.socket.timeout = 3sec
      dfs.socket.write.timeout = 5sec
      ipc.client.connect.timeout = 1sec
      ipc.client.connect.max.retries.on.timeouts = 2
      

        Activity

        Hide
        kturner Keith Turner added a comment -

        Eric Newton can you provide some background on why these settings are needed?

        Show
        kturner Keith Turner added a comment - Eric Newton can you provide some background on why these settings are needed?
        Hide
        ecn Eric Newton added a comment -

        To test, stop the datanode and the tserver on the same box with SIGSTOP.

        After the tserver lock is lost, the master calls recoverLease() on the namenode. The namenode tries to talk to the primary node for the pipeline, which is the datanode which is also stopped. Without these settings, the request takes a long time. Eventually, the master calls recoverLease() again, and that restarts the whole cycle.

        There are additional details and analysis in HBASE-8389.

        Show
        ecn Eric Newton added a comment - To test, stop the datanode and the tserver on the same box with SIGSTOP. After the tserver lock is lost, the master calls recoverLease() on the namenode. The namenode tries to talk to the primary node for the pipeline, which is the datanode which is also stopped. Without these settings, the request takes a long time. Eventually, the master calls recoverLease() again, and that restarts the whole cycle. There are additional details and analysis in HBASE-8389 .
        Hide
        hudson Hudson added a comment -

        Integrated in Accumulo-1.5 #93 (See https://builds.apache.org/job/Accumulo-1.5/93/)
        ACCUMULO-1351 document timeout settings for hdfs (Revision 1476220)

        Result = SUCCESS
        ecn :
        Files :

        • /accumulo/branches/1.5/docs/administration.html
        Show
        hudson Hudson added a comment - Integrated in Accumulo-1.5 #93 (See https://builds.apache.org/job/Accumulo-1.5/93/ ) ACCUMULO-1351 document timeout settings for hdfs (Revision 1476220) Result = SUCCESS ecn : Files : /accumulo/branches/1.5/docs/administration.html
        Hide
        hudson Hudson added a comment -

        Integrated in Accumulo-1.5-Hadoop-2.0 #92 (See https://builds.apache.org/job/Accumulo-1.5-Hadoop-2.0/92/)
        ACCUMULO-1351 document timeout settings for hdfs (Revision 1476220)

        Result = SUCCESS
        ecn :
        Files :

        • /accumulo/branches/1.5/docs/administration.html
        Show
        hudson Hudson added a comment - Integrated in Accumulo-1.5-Hadoop-2.0 #92 (See https://builds.apache.org/job/Accumulo-1.5-Hadoop-2.0/92/ ) ACCUMULO-1351 document timeout settings for hdfs (Revision 1476220) Result = SUCCESS ecn : Files : /accumulo/branches/1.5/docs/administration.html
        Hide
        hudson Hudson added a comment -

        Integrated in Accumulo-Trunk #844 (See https://builds.apache.org/job/Accumulo-Trunk/844/)
        ACCUMULO-1351 document timeout settings for hdfs (Revision 1476277)

        Result = UNSTABLE
        ecn :
        Files :

        • /accumulo/trunk
        • /accumulo/trunk/assemble
        • /accumulo/trunk/core
        • /accumulo/trunk/docs/administration.html
        • /accumulo/trunk/examples
        • /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/ZooStore.java
        • /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/zookeeper/ZooSession.java
        • /accumulo/trunk/pom.xml
        • /accumulo/trunk/server
        • /accumulo/trunk/src
        Show
        hudson Hudson added a comment - Integrated in Accumulo-Trunk #844 (See https://builds.apache.org/job/Accumulo-Trunk/844/ ) ACCUMULO-1351 document timeout settings for hdfs (Revision 1476277) Result = UNSTABLE ecn : Files : /accumulo/trunk /accumulo/trunk/assemble /accumulo/trunk/core /accumulo/trunk/docs/administration.html /accumulo/trunk/examples /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/ZooStore.java /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/zookeeper/ZooSession.java /accumulo/trunk/pom.xml /accumulo/trunk/server /accumulo/trunk/src
        Hide
        hudson Hudson added a comment -

        Integrated in Accumulo-Trunk-Hadoop-2.0 #202 (See https://builds.apache.org/job/Accumulo-Trunk-Hadoop-2.0/202/)
        ACCUMULO-1351 document timeout settings for hdfs (Revision 1476277)

        Result = UNSTABLE
        ecn :
        Files :

        • /accumulo/trunk
        • /accumulo/trunk/assemble
        • /accumulo/trunk/core
        • /accumulo/trunk/docs/administration.html
        • /accumulo/trunk/examples
        • /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/ZooStore.java
        • /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/zookeeper/ZooSession.java
        • /accumulo/trunk/pom.xml
        • /accumulo/trunk/server
        • /accumulo/trunk/src
        Show
        hudson Hudson added a comment - Integrated in Accumulo-Trunk-Hadoop-2.0 #202 (See https://builds.apache.org/job/Accumulo-Trunk-Hadoop-2.0/202/ ) ACCUMULO-1351 document timeout settings for hdfs (Revision 1476277) Result = UNSTABLE ecn : Files : /accumulo/trunk /accumulo/trunk/assemble /accumulo/trunk/core /accumulo/trunk/docs/administration.html /accumulo/trunk/examples /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/ZooStore.java /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/zookeeper/ZooSession.java /accumulo/trunk/pom.xml /accumulo/trunk/server /accumulo/trunk/src

          People

          • Assignee:
            ecn Eric Newton
            Reporter:
            ecn Eric Newton
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development