Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-12983

Remove/deprecate s3 properties from S3FileSystemConfigKeys and core-default.xml

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: tools
    • Labels:
      None

      Description

      Similar to HADOOP-12981, there are a few S3 defunct properties, except for s3.stream-buffer-size.

      <!-- s3 File System -->
      
      <property>
        <name>s3.stream-buffer-size</name>
        <value>4096</value>
        <description>The size of buffer to stream files.
        The size of this buffer should probably be a multiple of hardware
        page size (4096 on Intel x86), and it determines how much data is
        buffered during read and write operations.</description>
      </property>
      
      <property>
        <name>s3.bytes-per-checksum</name>
        <value>512</value>
        <description>The number of bytes per checksum.  Must not be larger than
        s3.stream-buffer-size</description>
      </property>
      
      <property>
        <name>s3.client-write-packet-size</name>
        <value>65536</value>
        <description>Packet size for clients to write</description>
      </property>
      
      <property>
        <name>s3.blocksize</name>
        <value>67108864</value>
        <description>Block size</description>
      </property>
      
      <property>
        <name>s3.replication</name>
        <value>3</value>
        <description>Replication factor</description>
      </property>
      

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              weichiu Wei-Chiu Chuang
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: