Uploaded image for project: 'Accumulo'
  1. Accumulo
  2. ACCUMULO-817

Clarify README regarding dfs.support.append

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.5.0
    • docs
    • None

    Description

      Specify in README which versions of Hadoop require dfs.support.append and which require dfs.durable.sync.

      Attachments

        Issue Links

          Activity

            hudson Hudson added a comment -

            Integrated in Accumulo-Trunk #539 (See https://builds.apache.org/job/Accumulo-Trunk/539/)
            ACCUMULO-817 - added version configuration table to tserver failure message (Revision 1403478)

            Result = SUCCESS
            vines :
            Files :

            • /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/tabletserver/TabletServer.java
            hudson Hudson added a comment - Integrated in Accumulo-Trunk #539 (See https://builds.apache.org/job/Accumulo-Trunk/539/ ) ACCUMULO-817 - added version configuration table to tserver failure message (Revision 1403478) Result = SUCCESS vines : Files : /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/tabletserver/TabletServer.java
            hudson Hudson added a comment -

            Integrated in Accumulo-Trunk #538 (See https://builds.apache.org/job/Accumulo-Trunk/538/)
            ACCUMULO-817 - Thorough documentation on append/sync configurations (Revision 1403437)

            Result = SUCCESS
            vines :
            Files :

            • /accumulo/trunk/README
            hudson Hudson added a comment - Integrated in Accumulo-Trunk #538 (See https://builds.apache.org/job/Accumulo-Trunk/538/ ) ACCUMULO-817 - Thorough documentation on append/sync configurations (Revision 1403437) Result = SUCCESS vines : Files : /accumulo/trunk/README
            vines John Vines added a comment -

            I'm also going to merge it into the error tservers throw if things are not set properly.

            vines John Vines added a comment - I'm also going to merge it into the error tservers throw if things are not set properly.
            vines John Vines added a comment -

            Updated with a nice little table in the README to cover vanilla Hadoop, as well as CDH and HDP. There is a bit of an information gap, largest being defaults for HDP, so once I hear back on that I'll close the ticket.

            vines John Vines added a comment - Updated with a nice little table in the README to cover vanilla Hadoop, as well as CDH and HDP. There is a bit of an information gap, largest being defaults for HDP, so once I hear back on that I'll close the ticket.
            billie Billie Rinaldi added a comment -

            Interestingly, Hadoop 2 / trunk still uses dfs.support.append. I wonder if the change will get merged up to trunk at some point.

            billie Billie Rinaldi added a comment - Interestingly, Hadoop 2 / trunk still uses dfs.support.append. I wonder if the change will get merged up to trunk at some point.
            vines John Vines added a comment -

            CDH made the switch to dfs.durable.sync in CDH3u4

            vines John Vines added a comment - CDH made the switch to dfs.durable.sync in CDH3u4
            vines John Vines added a comment -

            I'm waiting to hear back on the state of these in CDH releases.

            vines John Vines added a comment - I'm waiting to hear back on the state of these in CDH releases.
            billie Billie Rinaldi added a comment -

            I believe HDP 1.0 and 1.1 both use Hadoop 1.0.x.

            billie Billie Rinaldi added a comment - I believe HDP 1.0 and 1.1 both use Hadoop 1.0.x.
            billie Billie Rinaldi added a comment -

            Apache Hadoop 1.0.[1-4] still use dfs.support.append. I checked 0.20.205.0, and it uses it as well. Apache Hadoop 1.1.0 does not, and dfs.durable.sync is set to true by default, so users need only avoid setting it to false. Looking into HDP.

            billie Billie Rinaldi added a comment - Apache Hadoop 1.0. [1-4] still use dfs.support.append. I checked 0.20.205.0, and it uses it as well. Apache Hadoop 1.1.0 does not, and dfs.durable.sync is set to true by default, so users need only avoid setting it to false. Looking into HDP.

            People

              Unassigned Unassigned
              billie Billie Rinaldi
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: