Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: fs
    • Labels:
      None
    • Hadoop Flags:
      Incompatible change
    • Release Note:
      Removed deprecated FileSystem methods .

      Description

      Deprecated FileSystem methods like getReplication(Path src), delete(Path f), etc. should be removed.

      1. hadoop-4779-remaining_v1.patch
        23 kB
        Enis Soztutar
      2. 4779_20081218.patch
        22 kB
        Tsz Wo Nicholas Sze
      3. 4779_20081204.patch
        17 kB
        Tsz Wo Nicholas Sze

        Issue Links

        There are no Sub-Tasks for this issue.

          Activity

          Transition Time In Source Status Execution Times Last Executer Last Execution Date
          Patch Available Patch Available Resolved Resolved
          3h 29m 1 Tsz Wo Nicholas Sze 23/Dec/08 22:15
          Resolved Resolved Reopened Reopened
          16h 58m 1 Enis Soztutar 24/Dec/08 15:14
          Reopened Reopened Patch Available Patch Available
          7m 52s 1 Enis Soztutar 24/Dec/08 15:22
          Open Open Patch Available Patch Available
          19d 12h 49m 2 Enis Soztutar 25/Dec/08 14:55
          Patch Available Patch Available Open Open
          3h 27m 2 Enis Soztutar 25/Dec/08 14:56
          Open Open Resolved Resolved
          48d 6h 33m 1 Tsz Wo Nicholas Sze 11/Feb/09 21:30
          Resolved Resolved Closed Closed
          558d 23h 4m 1 Tom White 24/Aug/10 21:34
          Hide
          Eli Collins added a comment -

          Linking in the jira where these were added back.

          Show
          Eli Collins added a comment - Linking in the jira where these were added back.
          Eli Collins made changes -
          Link This issue relates to HADOOP-6709 [ HADOOP-6709 ]
          Tom White made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Robert Chansler made changes -
          Release Note Removed deprecated FileSystem methods .
          Hide
          Robert Chansler added a comment -

          Editorial pass over all release notes prior to publication of 0.21.

          Show
          Robert Chansler added a comment - Editorial pass over all release notes prior to publication of 0.21.
          Tsz Wo Nicholas Sze made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Hide
          Tsz Wo Nicholas Sze added a comment -

          All deprecated methods are removed except getStatistics(Class<? extends FileSystem> cls) which was deprecated in 0.20 and cannot be removed it in 0.21. Closing this.

          Show
          Tsz Wo Nicholas Sze added a comment - All deprecated methods are removed except getStatistics(Class<? extends FileSystem> cls) which was deprecated in 0.20 and cannot be removed it in 0.21. Closing this.
          Enis Soztutar made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Enis Soztutar made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Tsz Wo Nicholas Sze made changes -
          Hadoop Flags [Reviewed, Incompatible change] [Incompatible change]
          Release Note  Remove the following deprecated FileSystem methods:
              * public short getReplication(Path src) throws IOException
              * public abstract boolean delete(Path f) throws IOException;
              * public long getLength(Path f) throws IOException
              * public long getBlockSize(Path f) throws IOException
          Hide
          Tsz Wo Nicholas Sze added a comment -

          Since there are quite a few deprecated FileSystem methods and some of them are quite involved, let's create sub-issues for removing them.

          Show
          Tsz Wo Nicholas Sze added a comment - Since there are quite a few deprecated FileSystem methods and some of them are quite involved, let's create sub-issues for removing them.
          Tsz Wo Nicholas Sze made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Hide
          Tsz Wo Nicholas Sze added a comment -

          I have reverted 4779_20081218.patch.

          Show
          Tsz Wo Nicholas Sze added a comment - I have reverted 4779_20081218.patch.
          Enis Soztutar made changes -
          Status Reopened [ 4 ] Patch Available [ 10002 ]
          Hadoop Flags [Reviewed, Incompatible change] [Incompatible change, Reviewed]
          Enis Soztutar made changes -
          Attachment hadoop-4779-remaining_v1.patch [ 12396737 ]
          Hide
          Enis Soztutar added a comment -

          Attached patch

          • fixes contrib usages of fs.delete(Path)
          • deprecates ClientProtocol#delete(Path)
          • removes InMemoryFileSystem#delete(Path)
          • adds int recursive argument to delete() in libhdfs
          Show
          Enis Soztutar added a comment - Attached patch fixes contrib usages of fs.delete(Path) deprecates ClientProtocol#delete(Path) removes InMemoryFileSystem#delete(Path) adds int recursive argument to delete() in libhdfs
          Enis Soztutar made changes -
          Attachment hadoop-4779_datajoin.patch [ 12396731 ]
          Enis Soztutar made changes -
          Resolution Fixed [ 1 ]
          Status Resolved [ 5 ] Reopened [ 4 ]
          Hide
          Enis Soztutar added a comment -

          Right, should have run ant clean first. I'm working on the patch.

          Show
          Enis Soztutar added a comment - Right, should have run ant clean first. I'm working on the patch.
          Hide
          Amareshwari Sriramadasu added a comment -

          Not just data_join, compilation for many more contrib projects is failing, like failmon, index, streaming etc.

          Show
          Amareshwari Sriramadasu added a comment - Not just data_join, compilation for many more contrib projects is failing, like failmon, index, streaming etc.
          Enis Soztutar made changes -
          Attachment hadoop-4779_datajoin.patch [ 12396731 ]
          Hide
          Enis Soztutar added a comment -

          Usage of the fs.delete(Path) method in datajoin causes compile error. Attaching one liner patch to fix it.

          Show
          Enis Soztutar added a comment - Usage of the fs.delete(Path) method in datajoin causes compile error. Attaching one liner patch to fix it.
          Tsz Wo Nicholas Sze made changes -
          Release Note  Remove the following deprecated FileSystem methods:
              * public short getReplication(Path src) throws IOException
              * public abstract boolean delete(Path f) throws IOException;
              * public long getLength(Path f) throws IOException
              * public long getBlockSize(Path f) throws IOException

          [ Show » ]
          Tsz Wo (Nicholas), SZE - 04/Dec/08 06:10 PM 4779_20081204.patch: removed the following methods:

              * public short getReplication(Path src) throws IOException

              * public abstract boolean delete(Path f) throws IOException;

              * public long getLength(Path f) throws IOException

              * public long getBlockSize(Path f) throws IOException
           Remove the following deprecated FileSystem methods:
              * public short getReplication(Path src) throws IOException
              * public abstract boolean delete(Path f) throws IOException;
              * public long getLength(Path f) throws IOException
              * public long getBlockSize(Path f) throws IOException
          Hadoop Flags [Reviewed, Incompatible change] [Incompatible change, Reviewed]
          Tsz Wo Nicholas Sze made changes -
          Release Note  Remove the following deprecated FileSystem methods:
              * public short getReplication(Path src) throws IOException
              * public abstract boolean delete(Path f) throws IOException;
              * public long getLength(Path f) throws IOException
              * public long getBlockSize(Path f) throws IOException

          [ Show » ]
          Tsz Wo (Nicholas), SZE - 04/Dec/08 06:10 PM 4779_20081204.patch: removed the following methods:

              * public short getReplication(Path src) throws IOException

              * public abstract boolean delete(Path f) throws IOException;

              * public long getLength(Path f) throws IOException

              * public long getBlockSize(Path f) throws IOException
          Resolution Fixed [ 1 ]
          Fix Version/s 0.21.0 [ 12313563 ]
          Hadoop Flags [Reviewed, Incompatible change] [Incompatible change, Reviewed]
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hide
          Tsz Wo Nicholas Sze added a comment -

          I just committed this.

          Show
          Tsz Wo Nicholas Sze added a comment - I just committed this.
          Hide
          Tsz Wo Nicholas Sze added a comment -

          Tested locally, only TestMapReduceLocal failed but it is not related, see HADOOP-4907.

          Show
          Tsz Wo Nicholas Sze added a comment - Tested locally, only TestMapReduceLocal failed but it is not related, see HADOOP-4907 .
          Hide
          Tsz Wo Nicholas Sze added a comment -
               [exec] -1 overall.  
               [exec] 
               [exec]     +1 @author.  The patch does not contain any @author tags.
               [exec] 
               [exec]     +1 tests included.  The patch appears to include 18 new or modified tests.
               [exec] 
               [exec]     +1 javadoc.  The javadoc tool did not generate any warning messages.
               [exec] 
               [exec]     +1 javac.  The applied patch does not increase the total number of javac compiler warnings.
               [exec] 
               [exec]     -1 findbugs.  The patch appears to cause Findbugs to fail.
               [exec] 
               [exec]     +1 Eclipse classpath. The patch retains Eclipse classpath integrity.
          

          The detail findbugs report (newPatchFindbugsWarnings.html) does not contain any warning. I suspect the test-patch script does not work correctly in this patch.

          Show
          Tsz Wo Nicholas Sze added a comment - [exec] -1 overall. [exec] [exec] +1 @author. The patch does not contain any @author tags. [exec] [exec] +1 tests included. The patch appears to include 18 new or modified tests. [exec] [exec] +1 javadoc. The javadoc tool did not generate any warning messages. [exec] [exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings. [exec] [exec] -1 findbugs. The patch appears to cause Findbugs to fail. [exec] [exec] +1 Eclipse classpath. The patch retains Eclipse classpath integrity. The detail findbugs report (newPatchFindbugsWarnings.html) does not contain any warning. I suspect the test-patch script does not work correctly in this patch.
          Tsz Wo Nicholas Sze made changes -
          Hadoop Flags [Incompatible change] [Incompatible change, Reviewed]
          Status Open [ 1 ] Patch Available [ 10002 ]
          Assignee Tsz Wo (Nicholas), SZE [ szetszwo ]
          Tsz Wo Nicholas Sze made changes -
          Attachment 4779_20081218.patch [ 12396453 ]
          Hide
          Tsz Wo Nicholas Sze added a comment -

          4779_20081218.patch: removed unused imports and updated with trunk.

          Show
          Tsz Wo Nicholas Sze added a comment - 4779_20081218.patch: removed unused imports and updated with trunk.
          Nigel Daley made changes -
          Hadoop Flags [Incompatible change]
          Hide
          Konstantin Shvachko added a comment -

          +1.
          There are some redundant imports in files you modify. Would be good to remove them as well.
          Should be marked as incompatible change.

          Show
          Konstantin Shvachko added a comment - +1. There are some redundant imports in files you modify. Would be good to remove them as well. Should be marked as incompatible change.
          Tsz Wo Nicholas Sze made changes -
          Field Original Value New Value
          Attachment 4779_20081204.patch [ 12395357 ]
          Hide
          Tsz Wo Nicholas Sze added a comment -

          4779_20081204.patch: removed the following methods:

          • public short getReplication(Path src) throws IOException
          • public abstract boolean delete(Path f) throws IOException;
          • public long getLength(Path f) throws IOException
          • public long getBlockSize(Path f) throws IOException
          Show
          Tsz Wo Nicholas Sze added a comment - 4779_20081204.patch: removed the following methods: public short getReplication(Path src) throws IOException public abstract boolean delete(Path f) throws IOException; public long getLength(Path f) throws IOException public long getBlockSize(Path f) throws IOException
          Tsz Wo Nicholas Sze created issue -

            People

            • Assignee:
              Tsz Wo Nicholas Sze
              Reporter:
              Tsz Wo Nicholas Sze
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development