Hadoop Common
  1. Hadoop Common
  2. HADOOP-1668

add INCOMPATIBLE CHANGES section to CHANGES.txt for Hadoop 0.14

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.14.0
    • Fix Version/s: 0.14.0
    • Component/s: documentation
    • Labels:
      None

      Description

      HADOOP-1134 and some other Jira's have introduced incompatible changes into Hadoop 0.14. As per HADOOP-1667 the CHANGES.txt file will include sections for these kind of changes for Hadoop 0.15 and beyond. As a stop gap for 0.14, the CHANGES.txt file needs an INCOMPATIBLE CHANGES section.

      1. 1668.patch
        1 kB
        Nigel Daley

        Activity

        Hide
        Raghu Angadi added a comment -

        Incompatible changes in HADOOP-1134 :

        • dfs.block.size should be a multiple of io.byte.per.checksum. Otherwise new files can not be written. No changes to default config.
        • DFS layout version changed from -6 to -7. As with any layout change, existing cluster need to be finalized before upgrading the software and cluster should be started with upgrade option after software upgrade.
        • Datanode RPC protocol version changed from 7 to 8 (this may not be considered incompatible).

        I will add a link to uprade guide for this upgrade.

        Show
        Raghu Angadi added a comment - Incompatible changes in HADOOP-1134 : dfs.block.size should be a multiple of io.byte.per.checksum. Otherwise new files can not be written. No changes to default config. DFS layout version changed from -6 to -7. As with any layout change, existing cluster need to be finalized before upgrading the software and cluster should be started with upgrade option after software upgrade. Datanode RPC protocol version changed from 7 to 8 (this may not be considered incompatible). I will add a link to uprade guide for this upgrade.
        Hide
        dhruba borthakur added a comment -

        These following are dfs API changes fro the 0.14 release:

        HADOOP-1551 libhdfs API enhancements
        HADOOP-1283 file locking API deprecated
        HADOOP-894 change in ClientProtocol to fetch parts of block locations.

        Show
        dhruba borthakur added a comment - These following are dfs API changes fro the 0.14 release: HADOOP-1551 libhdfs API enhancements HADOOP-1283 file locking API deprecated HADOOP-894 change in ClientProtocol to fetch parts of block locations.
        Hide
        Owen O'Malley added a comment -

        HADOOP-1197
        API - deprecated method for Configuration.getObject, because Configrations should only contain strings
        HADOOP-1343
        API - deprecate Configuration.set(String,Object) so that only strings are put in Configrations
        HADOOP-1344
        API - Add RunningJob.getJobName() to get the name of the job.
        HADOOP-1336
        Config - Enable speculative execution by default.
        HADOOP-1207
        CLI - Fix FsShell to not stop 'rm' command when a file does not exist
        HADOOP-1484
        webui - Allow killing jobs from webui. Disabled by default.
        HADOOP-1473
        CLI/API - Job/TIP/Task ids now unique across job tracker restarts.

        Show
        Owen O'Malley added a comment - HADOOP-1197 API - deprecated method for Configuration.getObject, because Configrations should only contain strings HADOOP-1343 API - deprecate Configuration.set(String,Object) so that only strings are put in Configrations HADOOP-1344 API - Add RunningJob.getJobName() to get the name of the job. HADOOP-1336 Config - Enable speculative execution by default. HADOOP-1207 CLI - Fix FsShell to not stop 'rm' command when a file does not exist HADOOP-1484 webui - Allow killing jobs from webui. Disabled by default. HADOOP-1473 CLI/API - Job/TIP/Task ids now unique across job tracker restarts.
        Hide
        Nigel Daley added a comment -

        A patch for CHANGES.txt that contains a new INCOMPATIBILE section

        Show
        Nigel Daley added a comment - A patch for CHANGES.txt that contains a new INCOMPATIBILE section
        Hide
        Nigel Daley added a comment -

        I committed this.

        Show
        Nigel Daley added a comment - I committed this.

          People

          • Assignee:
            Nigel Daley
            Reporter:
            Nigel Daley
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development