Hadoop Common
  1. Hadoop Common
  2. HADOOP-40

bufferSize argument is ignored in FileSystem.create(File, boolean, int)

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.1.0
    • Component/s: fs
    • Labels:
      None

      Description

      org.apache.hadoop.fs.FileSystem.create(File f, boolean overwrite, int bufferSize)

      ignores the input parameter bufferSize.
      It passes further down the internal configuration, which includes the buffer size, but not the parameter value.
      This works fine within the file system, since everything that calls create extracts buffer size from the same config.
      MapReduce although is probably affected by that, see

      org.apache.hadoop.io.SequenceFile.Sorter.MergeQueue.MergeQueue(int size, String outName, boolean done)

      The attached patch would fix it.

      1. BufferSize.patch
        2 kB
        Konstantin Shvachko
      2. bufferSize.patch
        2 kB
        Doug Cutting

        Activity

        Doug Cutting made changes -
        Workflow no-reopen-closed [ 12373346 ] no-reopen-closed, patch-avail [ 12377653 ]
        Doug Cutting made changes -
        Workflow no reopen closed [ 12373010 ] no-reopen-closed [ 12373346 ]
        Doug Cutting made changes -
        Workflow jira [ 12347224 ] no reopen closed [ 12373010 ]
        Doug Cutting made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Doug Cutting made changes -
        Fix Version/s 0.1 [ 12310812 ]
        Resolution Fixed [ 1 ]
        Status Open [ 1 ] Resolved [ 5 ]
        Doug Cutting made changes -
        Attachment bufferSize.patch [ 12323333 ]
        Doug Cutting made changes -
        Attachment bufferSize.patch [ 12323332 ]
        Doug Cutting made changes -
        Attachment bufferSize.patch [ 12323332 ]
        Konstantin Shvachko made changes -
        Field Original Value New Value
        Attachment BufferSize.patch [ 12323130 ]
        Konstantin Shvachko created issue -

          People

          • Assignee:
            Unassigned
            Reporter:
            Konstantin Shvachko
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development