Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-16829 Über-jira: S3A Hadoop 3.4 features
  3. HADOOP-16923

mkdir on s3a should not be sensitive to trailing '/'

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: fs/s3
    • Labels:
      None

      Description

      I would have expected to create the directory for both calls:

      [hive@hiveserver2-0 lib]$ hdfs dfs -mkdir s3a://qe-s3-bucket-mst-xfpn-dwx-external/custom-jars2/
      /usr/bin/hdfs: line 4: /usr/lib/bigtop-utils/bigtop-detect-javahome: No such file or directory
      log4j:WARN No appenders could be found for logger (org.apache.hadoop.util.Shell).
      log4j:WARN Please initialize the log4j system properly.
      log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
      mkdir: get on s3a://qe-s3-bucket-mst-xfpn-dwx-external/custom-jars2/: com.amazonaws.services.dynamodbv2.model.AmazonDynamoDBException: One or more parameter values were invalid: An AttributeValue may not contain an empty string (Service: AmazonDynamoDBv2; Status Code: 400; Error Code: ValidationException; Request ID: 1AE0KA2Q5ADI47R75N8BDJE973VV4KQNSO5AEMVJF66Q9ASUAAJG): One or more parameter values were invalid: An AttributeValue may not contain an empty string (Service: AmazonDynamoDBv2; Status Code: 400; Error Code: ValidationException; Request ID: 1AE0KA2Q5ADI47R75N8BDJE973VV4KQNSO5AEMVJF66Q9ASUAAJG)
      [hive@hiveserver2-0 lib]$ hdfs dfs -mkdir s3a://qe-s3-bucket-mst-xfpn-dwx-external/custom-jars2
      /usr/bin/hdfs: line 4: /usr/lib/bigtop-utils/bigtop-detect-javahome: No such file or directory
      log4j:WARN No appenders could be found for logger (org.apache.hadoop.util.Shell).
      log4j:WARN Please initialize the log4j system properly.
      log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
      [hive@hiveserver2-0 lib]$ 
      

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              kgyrtkirk Zoltan Haindrich
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: