Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-702

Add Hdfs Impl for the new file system interface

    Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.22.0
    • Fix Version/s: 0.21.0
    • Component/s: namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Add HDFS implementation of AbstractFileSystem.

      Description

      HADOOP-6223 adds a new file system interface (potentially called AbstractFileSystem).
      Add an implementation for it for the HDFS file system.

      1. AFS11-hdfs.patch
        18 kB
        Sanjay Radia
      2. AFS15-hdfs.patch
        18 kB
        Sanjay Radia
      3. AFS16-hdfs.patch
        18 kB
        Suresh Srinivas
      4. AFS17-hdfs.patch
        18 kB
        Sanjay Radia
      5. AFS18-hdfs.patch
        17 kB
        Sanjay Radia

        Issue Links

          Activity

          Sanjay Radia created issue -
          Sanjay Radia made changes -
          Field Original Value New Value
          Link This issue depends on HADOOP-6223 [ HADOOP-6223 ]
          Sanjay Radia made changes -
          Attachment AFS11-hdfs.patch [ 12421929 ]
          Hide
          Suresh Srinivas added a comment -
          1. MiniDFSCluster.java - catching and ignoring URISyntaxException should not be done. Also I think changes to this class is not necessary.
          2. TestHDFSFileContextMainOperations - remove commented line // fc = FileContext.getFileContext(cluster.getURI(), conf);
          3. DFSClient - add deprecated comments with @deprecated for DFSClient.open()
          Show
          Suresh Srinivas added a comment - MiniDFSCluster.java - catching and ignoring URISyntaxException should not be done. Also I think changes to this class is not necessary. TestHDFSFileContextMainOperations - remove commented line // fc = FileContext.getFileContext(cluster.getURI(), conf); DFSClient - add deprecated comments with @deprecated for DFSClient.open()
          Sanjay Radia made changes -
          Attachment AFS15-hdfs.patch [ 12422523 ]
          Hide
          Suresh Srinivas added a comment -

          Fix for warnings reported in test-patch

          Show
          Suresh Srinivas added a comment - Fix for warnings reported in test-patch
          Suresh Srinivas made changes -
          Attachment AFS16-hdfs.patch [ 12422658 ]
          Hide
          Sanjay Radia added a comment -

          Have addressed Suresh's feedback and have fixed the hudson/test-patch warnings.

          Show
          Sanjay Radia added a comment - Have addressed Suresh's feedback and have fixed the hudson/test-patch warnings.
          Sanjay Radia made changes -
          Attachment AFS17-hdfs.patch [ 12423832 ]
          Sanjay Radia made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Sanjay Radia made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Sanjay Radia made changes -
          Attachment AFS18-hdfs.patch [ 12423852 ]
          Hide
          Sanjay Radia added a comment -

          Updates for recent rename changes.
          This patch requires common jar changes. Currently HDFS build fails without this patch and with new common jar. Without the baseline build, test-patch validation is not done for this patch. All the unit tests passed, except TestBackupNode and TestDiskError.

          Show
          Sanjay Radia added a comment - Updates for recent rename changes. This patch requires common jar changes. Currently HDFS build fails without this patch and with new common jar. Without the baseline build, test-patch validation is not done for this patch. All the unit tests passed, except TestBackupNode and TestDiskError.
          Hide
          Suresh Srinivas added a comment -

          +1 for the patch.

          Show
          Suresh Srinivas added a comment - +1 for the patch.
          Hide
          Suresh Srinivas added a comment -

          Committed the patch to trunk. Thank you Sanjay.

          Show
          Suresh Srinivas added a comment - Committed the patch to trunk. Thank you Sanjay.
          Suresh Srinivas made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Hadoop Flags [Reviewed]
          Release Note Add HDFS implementation of AbstractFileSystem.
          Resolution Fixed [ 1 ]
          Suresh Srinivas made changes -
          Component/s name-node [ 12312926 ]
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk-Commit #96 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/96/)

          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #96 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/96/ )
          Hide
          Hudson added a comment -

          Integrated in Hdfs-Patch-h5.grid.sp2.yahoo.net #100 (See http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h5.grid.sp2.yahoo.net/100/)

          Show
          Hudson added a comment - Integrated in Hdfs-Patch-h5.grid.sp2.yahoo.net #100 (See http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h5.grid.sp2.yahoo.net/100/ )
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk #136 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk/136/)

          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #136 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk/136/ )
          Hide
          Hudson added a comment -

          Integrated in Hdfs-Patch-h2.grid.sp2.yahoo.net #72 (See http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/72/)

          Show
          Hudson added a comment - Integrated in Hdfs-Patch-h2.grid.sp2.yahoo.net #72 (See http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/72/ )
          Tom White made changes -
          Fix Version/s 0.21.0 [ 12314046 ]
          Fix Version/s 0.22.0 [ 12314241 ]
          Tom White made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Gavin made changes -
          Link This issue depends on HADOOP-6223 [ HADOOP-6223 ]
          Gavin made changes -
          Link This issue depends upon HADOOP-6223 [ HADOOP-6223 ]

            People

            • Assignee:
              Sanjay Radia
              Reporter:
              Sanjay Radia
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development