Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-12983

Remove/deprecate s3 properties from S3FileSystemConfigKeys and core-default.xml

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • tools
    • None

    Description

      Similar to HADOOP-12981, there are a few S3 defunct properties, except for s3.stream-buffer-size.

      <!-- s3 File System -->
      
      <property>
        <name>s3.stream-buffer-size</name>
        <value>4096</value>
        <description>The size of buffer to stream files.
        The size of this buffer should probably be a multiple of hardware
        page size (4096 on Intel x86), and it determines how much data is
        buffered during read and write operations.</description>
      </property>
      
      <property>
        <name>s3.bytes-per-checksum</name>
        <value>512</value>
        <description>The number of bytes per checksum.  Must not be larger than
        s3.stream-buffer-size</description>
      </property>
      
      <property>
        <name>s3.client-write-packet-size</name>
        <value>65536</value>
        <description>Packet size for clients to write</description>
      </property>
      
      <property>
        <name>s3.blocksize</name>
        <value>67108864</value>
        <description>Block size</description>
      </property>
      
      <property>
        <name>s3.replication</name>
        <value>3</value>
        <description>Replication factor</description>
      </property>
      

      Attachments

        Activity

          People

            Unassigned Unassigned
            weichiu Wei-Chiu Chuang
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: