Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-40

bufferSize argument is ignored in FileSystem.create(File, boolean, int)

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 0.1.0
    • fs
    • None

    Description

      org.apache.hadoop.fs.FileSystem.create(File f, boolean overwrite, int bufferSize)

      ignores the input parameter bufferSize.
      It passes further down the internal configuration, which includes the buffer size, but not the parameter value.
      This works fine within the file system, since everything that calls create extracts buffer size from the same config.
      MapReduce although is probably affected by that, see

      org.apache.hadoop.io.SequenceFile.Sorter.MergeQueue.MergeQueue(int size, String outName, boolean done)

      The attached patch would fix it.

      Attachments

        1. bufferSize.patch
          2 kB
          Doug Cutting
        2. BufferSize.patch
          2 kB
          Konstantin Shvachko

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            shv Konstantin Shvachko
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Issue deployment