Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-40

bufferSize argument is ignored in FileSystem.create(File, boolean, int)

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 0.1.0
    • fs
    • None

    Description

      org.apache.hadoop.fs.FileSystem.create(File f, boolean overwrite, int bufferSize)

      ignores the input parameter bufferSize.
      It passes further down the internal configuration, which includes the buffer size, but not the parameter value.
      This works fine within the file system, since everything that calls create extracts buffer size from the same config.
      MapReduce although is probably affected by that, see

      org.apache.hadoop.io.SequenceFile.Sorter.MergeQueue.MergeQueue(int size, String outName, boolean done)

      The attached patch would fix it.

      Attachments

        1. BufferSize.patch
          2 kB
          Konstantin Shvachko
        2. bufferSize.patch
          2 kB
          Doug Cutting

        Activity

          People

            Unassigned Unassigned
            shv Konstantin Shvachko
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: