Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-4565

PutParquet doesn't support S3

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • 1.4.0
    • None
    • Core Framework
    • None

    Description

      PutParquet doesn't support S3 targets due to the lack of the hadoop-aws dependency.

      To recreate it:
      1) Modify core-site.xml to change fs.defaultName to one starting with s3://
      2) Add a PutParquet
      3) It will fail to run. The logs will show the missing hadoop-aws dependency.

      Simple fix is just to add hadoop-aws.

      Attachments

        Issue Links

          Activity

            People

              jfrazee Joey Frazee
              nadenf Franco
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: