Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-11490

Expose truncate API via FileSystem and shell command

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0-alpha1
    • Fix Version/s: 2.7.0
    • Component/s: fs
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      Add truncate operation to FileSystem and expose it to users via shell command.

      1. HDFS-7057.patch
        22 kB
        Milan Desai
      2. HDFS-7057-2.patch
        12 kB
        Milan Desai
      3. HDFS-7057-3.patch
        13 kB
        Milan Desai
      4. HDFS-7057-4.patch
        17 kB
        Milan Desai
      5. HDFS-7057-5.patch
        17 kB
        Milan Desai

        Issue Links

          Activity

          Hide
          shv Konstantin Shvachko added a comment -

          Merged to branch-2.

          Show
          shv Konstantin Shvachko added a comment - Merged to branch-2.
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk #2032 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2032/)
          HADOOP-11490. Expose truncate API via FileSystem and shell command. Contributed by Milan Desai. (shv: rev a0521bc83a168a06f21314a9aff78630a576fc75)

          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/FsCommand.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Truncate.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/HarFileSystem.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FilterFileSystem.java
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/ChecksumFileSystem.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/RawLocalFileSystem.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/ViewFileSystem.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2032 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2032/ ) HADOOP-11490 . Expose truncate API via FileSystem and shell command. Contributed by Milan Desai. (shv: rev a0521bc83a168a06f21314a9aff78630a576fc75) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/FsCommand.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Truncate.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/HarFileSystem.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FilterFileSystem.java hadoop-common-project/hadoop-common/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/ChecksumFileSystem.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/RawLocalFileSystem.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/ViewFileSystem.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #82 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/82/)
          HADOOP-11490. Expose truncate API via FileSystem and shell command. Contributed by Milan Desai. (shv: rev a0521bc83a168a06f21314a9aff78630a576fc75)

          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/FsCommand.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/ViewFileSystem.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/ChecksumFileSystem.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FilterFileSystem.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/HarFileSystem.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/RawLocalFileSystem.java
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Truncate.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #82 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/82/ ) HADOOP-11490 . Expose truncate API via FileSystem and shell command. Contributed by Milan Desai. (shv: rev a0521bc83a168a06f21314a9aff78630a576fc75) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/FsCommand.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/ViewFileSystem.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/ChecksumFileSystem.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FilterFileSystem.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/HarFileSystem.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/RawLocalFileSystem.java hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Truncate.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #78 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/78/)
          HADOOP-11490. Expose truncate API via FileSystem and shell command. Contributed by Milan Desai. (shv: rev a0521bc83a168a06f21314a9aff78630a576fc75)

          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Truncate.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/ChecksumFileSystem.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FilterFileSystem.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/FsCommand.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/RawLocalFileSystem.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/ViewFileSystem.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/HarFileSystem.java
          • hadoop-common-project/hadoop-common/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #78 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/78/ ) HADOOP-11490 . Expose truncate API via FileSystem and shell command. Contributed by Milan Desai. (shv: rev a0521bc83a168a06f21314a9aff78630a576fc75) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Truncate.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/ChecksumFileSystem.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FilterFileSystem.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/FsCommand.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/RawLocalFileSystem.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/ViewFileSystem.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/HarFileSystem.java hadoop-common-project/hadoop-common/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk #2013 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2013/)
          HADOOP-11490. Expose truncate API via FileSystem and shell command. Contributed by Milan Desai. (shv: rev a0521bc83a168a06f21314a9aff78630a576fc75)

          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/HarFileSystem.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/ViewFileSystem.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Truncate.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/ChecksumFileSystem.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FilterFileSystem.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/FsCommand.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/RawLocalFileSystem.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2013 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2013/ ) HADOOP-11490 . Expose truncate API via FileSystem and shell command. Contributed by Milan Desai. (shv: rev a0521bc83a168a06f21314a9aff78630a576fc75) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/HarFileSystem.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/ViewFileSystem.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Truncate.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/ChecksumFileSystem.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FilterFileSystem.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/FsCommand.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/RawLocalFileSystem.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk #815 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/815/)
          HADOOP-11490. Expose truncate API via FileSystem and shell command. Contributed by Milan Desai. (shv: rev a0521bc83a168a06f21314a9aff78630a576fc75)

          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/ViewFileSystem.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Truncate.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/ChecksumFileSystem.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/RawLocalFileSystem.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/HarFileSystem.java
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FilterFileSystem.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/FsCommand.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #815 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/815/ ) HADOOP-11490 . Expose truncate API via FileSystem and shell command. Contributed by Milan Desai. (shv: rev a0521bc83a168a06f21314a9aff78630a576fc75) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/ViewFileSystem.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Truncate.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/ChecksumFileSystem.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/RawLocalFileSystem.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/HarFileSystem.java hadoop-common-project/hadoop-common/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FilterFileSystem.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/FsCommand.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #81 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/81/)
          HADOOP-11490. Expose truncate API via FileSystem and shell command. Contributed by Milan Desai. (shv: rev a0521bc83a168a06f21314a9aff78630a576fc75)

          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/ViewFileSystem.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/HarFileSystem.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/ChecksumFileSystem.java
          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/FsCommand.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/RawLocalFileSystem.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FilterFileSystem.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Truncate.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #81 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/81/ ) HADOOP-11490 . Expose truncate API via FileSystem and shell command. Contributed by Milan Desai. (shv: rev a0521bc83a168a06f21314a9aff78630a576fc75) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/ViewFileSystem.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/HarFileSystem.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/ChecksumFileSystem.java hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/FsCommand.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/RawLocalFileSystem.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FilterFileSystem.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Truncate.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #6908 (See https://builds.apache.org/job/Hadoop-trunk-Commit/6908/)
          HADOOP-11490. Expose truncate API via FileSystem and shell command. Contributed by Milan Desai. (shv: rev a0521bc83a168a06f21314a9aff78630a576fc75)

          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Truncate.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/ViewFileSystem.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/RawLocalFileSystem.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/ChecksumFileSystem.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/FsCommand.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/HarFileSystem.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FilterFileSystem.java
          • hadoop-common-project/hadoop-common/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #6908 (See https://builds.apache.org/job/Hadoop-trunk-Commit/6908/ ) HADOOP-11490 . Expose truncate API via FileSystem and shell command. Contributed by Milan Desai. (shv: rev a0521bc83a168a06f21314a9aff78630a576fc75) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Truncate.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/ViewFileSystem.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/RawLocalFileSystem.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/ChecksumFileSystem.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/FsCommand.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/HarFileSystem.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FilterFileSystem.java hadoop-common-project/hadoop-common/CHANGES.txt
          Hide
          shv Konstantin Shvachko added a comment -
          • TestZKFailoverController fails once in while, which is tracked in HADOOP-11149.
          • TestFileTruncate is investigated in HDFS-7611.
          Show
          shv Konstantin Shvachko added a comment - TestZKFailoverController fails once in while, which is tracked in HADOOP-11149 . TestFileTruncate is investigated in HDFS-7611 .
          Hide
          shv Konstantin Shvachko added a comment -

          I just committed this to trunk. Thank you Milan.

          Linking it back to HDFS-3107 to make sure it aslo merged to branch-2 when the parent does.

          Show
          shv Konstantin Shvachko added a comment - I just committed this to trunk. Thank you Milan. Linking it back to HDFS-3107 to make sure it aslo merged to branch-2 when the parent does.
          Hide
          hadoopqa Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12693143/HDFS-7057-5.patch
          against trunk revision 7fc1f2f.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 1 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          -1 core tests. The patch failed these unit tests in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs:

          org.apache.hadoop.ha.TestZKFailoverController
          org.apache.hadoop.hdfs.server.namenode.TestFileTruncate

          Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/5431//testReport/
          Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/5431//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12693143/HDFS-7057-5.patch against trunk revision 7fc1f2f. +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs: org.apache.hadoop.ha.TestZKFailoverController org.apache.hadoop.hdfs.server.namenode.TestFileTruncate Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/5431//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/5431//console This message is automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12693143/HDFS-7057-5.patch
          against trunk revision 7fc1f2f.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 1 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          -1 core tests. The patch failed these unit tests in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs:

          org.apache.hadoop.ha.TestZKFailoverController
          org.apache.hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA

          Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/5430//testReport/
          Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/5430//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12693143/HDFS-7057-5.patch against trunk revision 7fc1f2f. +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs: org.apache.hadoop.ha.TestZKFailoverController org.apache.hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/5430//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/5430//console This message is automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12693143/HDFS-7057-5.patch
          against trunk revision 7fc1f2f.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 1 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          -1 core tests. The patch failed these unit tests in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs:

          org.apache.hadoop.ha.TestZKFailoverController
          org.apache.hadoop.hdfs.server.mover.TestStorageMover

          Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/9269//testReport/
          Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9269//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12693143/HDFS-7057-5.patch against trunk revision 7fc1f2f. +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs: org.apache.hadoop.ha.TestZKFailoverController org.apache.hadoop.hdfs.server.mover.TestStorageMover Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/9269//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9269//console This message is automatically generated.
          Hide
          shv Konstantin Shvachko added a comment -

          +1.
          Will convert this into HADOOP jira as most changes are in common and commit as such.

          Show
          shv Konstantin Shvachko added a comment - +1. Will convert this into HADOOP jira as most changes are in common and commit as such.
          Hide
          milandesai Milan Desai added a comment -

          Fixed above nits.

          Show
          milandesai Milan Desai added a comment - Fixed above nits.
          Hide
          shv Konstantin Shvachko added a comment -

          Two nits:

          1. It is better to use String.valueOf(newLnegth) instead of ""+newLength.
          2. testTruncateShellHelper() could have more informative name, like runTruncateShellCommand().
          Show
          shv Konstantin Shvachko added a comment - Two nits: It is better to use String.valueOf(newLnegth) instead of ""+newLength . testTruncateShellHelper() could have more informative name, like runTruncateShellCommand() .
          Hide
          hadoopqa Hadoop QA added a comment -

          +1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12692873/HDFS-7057-4.patch
          against trunk revision 8419856.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 1 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs.

          Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/9258//testReport/
          Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9258//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - +1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12692873/HDFS-7057-4.patch against trunk revision 8419856. +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/9258//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9258//console This message is automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12692834/HDFS-7057-3.patch
          against trunk revision ec4389c.

          +1 @author. The patch does not contain any @author tags.

          -1 tests included. The patch doesn't appear to include any new or modified tests.
          Please justify why no new tests are needed for this patch.
          Also please list what manual steps were performed to verify this patch.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          -1 core tests. The patch failed these unit tests in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs:

          org.apache.hadoop.hdfs.server.namenode.TestFileTruncate

          Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/9255//testReport/
          Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9255//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12692834/HDFS-7057-3.patch against trunk revision ec4389c. +1 @author . The patch does not contain any @author tags. -1 tests included . The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs: org.apache.hadoop.hdfs.server.namenode.TestFileTruncate Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/9255//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9255//console This message is automatically generated.
          Hide
          milandesai Milan Desai added a comment -

          Added three tests to TestFileTruncate (as opposed to TestDFSShell since we need to use TestFileTruncate's checkBlockRecovery() method). They test the shell command without the wait option, with the option, and without the wait option but on the block boundary (thus no need to wait for recovery).

          Show
          milandesai Milan Desai added a comment - Added three tests to TestFileTruncate (as opposed to TestDFSShell since we need to use TestFileTruncate's checkBlockRecovery() method). They test the shell command without the wait option, with the option, and without the wait option but on the block boundary (thus no need to wait for recovery).
          Hide
          shv Konstantin Shvachko added a comment -

          Looks good to me.
          Could you also add a unit test, which tests the Truncate command with and without -w option.
          I think we can either add such test into TestFileTruncate or TestDFSShell.

          Show
          shv Konstantin Shvachko added a comment - Looks good to me. Could you also add a unit test, which tests the Truncate command with and without -w option. I think we can either add such test into TestFileTruncate or TestDFSShell.
          Hide
          milandesai Milan Desai added a comment -

          1. Changed RawLocalFileSystem.truncate() to check that the path exists, the path is not a directory, and the new length is <= old length (emulated append() for the Exception messages). I added the length check to the client-side Truncate.class command as well.

          2. Made the JavaDoc for FileSystem.truncate() match the specification in the design doc, borrowing from ClientProtocol.

          3. Updated the command line messages for truncate, including telling the user to wait for block recovery to complete when necessary.

          Show
          milandesai Milan Desai added a comment - 1. Changed RawLocalFileSystem.truncate() to check that the path exists, the path is not a directory, and the new length is <= old length (emulated append() for the Exception messages). I added the length check to the client-side Truncate.class command as well. 2. Made the JavaDoc for FileSystem.truncate() match the specification in the design doc, borrowing from ClientProtocol. 3. Updated the command line messages for truncate, including telling the user to wait for block recovery to complete when necessary.
          Hide
          hadoopqa Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12692625/HDFS-7057-2.patch
          against trunk revision 780a6bf.

          +1 @author. The patch does not contain any @author tags.

          -1 tests included. The patch doesn't appear to include any new or modified tests.
          Please justify why no new tests are needed for this patch.
          Also please list what manual steps were performed to verify this patch.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          -1 core tests. The patch failed these unit tests in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs:

          org.apache.hadoop.ha.TestZKFailoverControllerStress

          Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/9230//testReport/
          Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9230//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12692625/HDFS-7057-2.patch against trunk revision 780a6bf. +1 @author . The patch does not contain any @author tags. -1 tests included . The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs: org.apache.hadoop.ha.TestZKFailoverControllerStress Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/9230//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9230//console This message is automatically generated.
          Hide
          shv Konstantin Shvachko added a comment -

          Looks so much better. Few more comments:

          • In RawLocalFileSystem impl you probably want to check if the file exists and if it is not a directory, even if only to throw the right exceptions. We should also check that newLength is not greater that the current file length.
          • In JavaDoc for FileSystem.truncate() we should borrow some text from ClientProtocol.truncate() to explain the truncate contract better. In particular that truncate is not to be used to increase file size as per the design doc.
            For the return value I suggest that we use a more generic phrasing from the Synopsys section of the design doc.

          Looking that all the changes are in common it seems better to convert this jira to a HADOOP issue rather than HDFS. But let's wait for Jenkins first.

          Show
          shv Konstantin Shvachko added a comment - Looks so much better. Few more comments: In RawLocalFileSystem impl you probably want to check if the file exists and if it is not a directory, even if only to throw the right exceptions. We should also check that newLength is not greater that the current file length. In JavaDoc for FileSystem.truncate() we should borrow some text from ClientProtocol.truncate() to explain the truncate contract better. In particular that truncate is not to be used to increase file size as per the design doc. For the return value I suggest that we use a more generic phrasing from the Synopsys section of the design doc. Looking that all the changes are in common it seems better to convert this jira to a HADOOP issue rather than HDFS. But let's wait for Jenkins first.
          Hide
          milandesai Milan Desai added a comment -

          ^RawLocalFileSystem also has a working truncate implementation. HarFileSystem throws the unsupported error.

          Show
          milandesai Milan Desai added a comment - ^RawLocalFileSystem also has a working truncate implementation. HarFileSystem throws the unsupported error.
          Hide
          milandesai Milan Desai added a comment -

          1. Made FileSystem.truncate throw an UnsupportedOperationException
          2. The following FileSystems now have working implementations: DistributedFileSystem, ViewFileSystem, and FilterFileSystem. ChecksumFileSystem throws an Exception similar to what append does. As a result, LocalFileSystem does not support truncate, even though it uses RawLocalFileSystem, since it extends ChecksumFileSystem. I am emulating append() here.
          3. Removed JavaDoc from DistributedFileSystem to FileSystem.

          Show
          milandesai Milan Desai added a comment - 1. Made FileSystem.truncate throw an UnsupportedOperationException 2. The following FileSystems now have working implementations: DistributedFileSystem, ViewFileSystem, and FilterFileSystem. ChecksumFileSystem throws an Exception similar to what append does. As a result, LocalFileSystem does not support truncate, even though it uses RawLocalFileSystem, since it extends ChecksumFileSystem. I am emulating append() here. 3. Removed JavaDoc from DistributedFileSystem to FileSystem.
          Hide
          shv Konstantin Shvachko added a comment -

          Milan, the shell command usage looks good to me.

          1. For FileSystem it is good that you first made truncate() method abstract. That way you know all the subclasses. But we don't want to implement them all at once, and we do not want to break third party systems, which may or may not choose to use truncate. So it would be better to implement truncate inside FileSystem as throwing UnsupportedOperationException same as concat(). This should address Alan's comment.
          2. I think in this patch we should only provide implementation of truncate for the following file systems: LocalFileSystem through FilterFileSystem, ViewFileSystem, and HarFileSystem. Just as you did.
          3. FileSystem.truncate() should have a comprehensive JavaDoc, explaining parameters and the return value. I think you can move JavaDoc from DistributedFileSystem to FileSystem and remove it from DFS.
          Show
          shv Konstantin Shvachko added a comment - Milan, the shell command usage looks good to me. For FileSystem it is good that you first made truncate() method abstract. That way you know all the subclasses. But we don't want to implement them all at once, and we do not want to break third party systems, which may or may not choose to use truncate. So it would be better to implement truncate inside FileSystem as throwing UnsupportedOperationException same as concat() . This should address Alan's comment. I think in this patch we should only provide implementation of truncate for the following file systems: LocalFileSystem through FilterFileSystem, ViewFileSystem, and HarFileSystem. Just as you did. FileSystem.truncate() should have a comprehensive JavaDoc, explaining parameters and the return value. I think you can move JavaDoc from DistributedFileSystem to FileSystem and remove it from DFS.
          Hide
          hadoopqa Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12692416/HDFS-7057.patch
          against trunk revision 5805dc0.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 5 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          -1 findbugs. The patch appears to introduce 5 new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          -1 core tests. The patch failed these unit tests in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-httpfs hadoop-tools/hadoop-aws hadoop-tools/hadoop-azure hadoop-tools/hadoop-distcp hadoop-tools/hadoop-gridmix hadoop-tools/hadoop-openstack:

          org.apache.hadoop.hdfs.server.balancer.TestBalancer

          Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/9220//testReport/
          Findbugs warnings: https://builds.apache.org/job/PreCommit-HDFS-Build/9220//artifact/patchprocess/newPatchFindbugsWarningshadoop-hdfs-httpfs.html
          Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9220//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12692416/HDFS-7057.patch against trunk revision 5805dc0. +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 5 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. -1 findbugs . The patch appears to introduce 5 new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-httpfs hadoop-tools/hadoop-aws hadoop-tools/hadoop-azure hadoop-tools/hadoop-distcp hadoop-tools/hadoop-gridmix hadoop-tools/hadoop-openstack: org.apache.hadoop.hdfs.server.balancer.TestBalancer Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/9220//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HDFS-Build/9220//artifact/patchprocess/newPatchFindbugsWarningshadoop-hdfs-httpfs.html Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9220//console This message is automatically generated.
          Hide
          aw Allen Wittenauer added a comment -

          It seems like the API has a huge problem if all of these other file systems require overrides to throw an unsupported exception. It also makes me very concerned that we've broken 3rd party file systems.

          Show
          aw Allen Wittenauer added a comment - It seems like the API has a huge problem if all of these other file systems require overrides to throw an unsupported exception. It also makes me very concerned that we've broken 3rd party file systems.
          Hide
          milandesai Milan Desai added a comment -

          Attaching a patch that exposes truncate to FileSystem and adds a shell command. The following FileSystem implementations support truncate: DistributedFileSystem, RawLocalFileSystem, and FilterFileSystem. HttpFSFileSystem and WebHdfsFileSystem have TODO comments for their implementation.

          The shell command usage for truncate is "truncate [-w] <length> <path> ..." where the -w option requests the command to wait for block recovery, if necessary. I tested the shell command on a standalone cluster.

          Show
          milandesai Milan Desai added a comment - Attaching a patch that exposes truncate to FileSystem and adds a shell command. The following FileSystem implementations support truncate: DistributedFileSystem, RawLocalFileSystem, and FilterFileSystem. HttpFSFileSystem and WebHdfsFileSystem have TODO comments for their implementation. The shell command usage for truncate is "truncate [-w] <length> <path> ..." where the -w option requests the command to wait for block recovery, if necessary. I tested the shell command on a standalone cluster.

            People

            • Assignee:
              milandesai Milan Desai
              Reporter:
              shv Konstantin Shvachko
            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development