Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6851

Terasort does not work with S3 FileSystem

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.0.0-alpha2
    • None
    • examples
    • None

    Description

      Terasort currently writes a partition list file in the output directory and add it to distributed cache. If a S3 bucket is used as the output directory, the job may fail because the partition list file will be localized by NMs which may not have the s3 credentials.

      Attachments

        Activity

          People

            Unassigned Unassigned
            haibochen Haibo Chen
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: