Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-8486

Support more options for PutBigQueryBatch Load File Type

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Extensions
    • None

    Description

      The BigQuery API supports the following file type formats:

      • Avro
      • CSV
      • JSON
      • ORC
      • Parquet
      • Datastore exports
      • Firestore exports

      The GCP PutBigQueryBatch processor only supports the first three. 

      It would be great to support others, particularly Parquet.

      https://cloud.google.com/bigquery/docs/reference/rest/v2/Job 

      Attachments

        Issue Links

          Activity

            People

              harjitdotsingh Harjit Singh
              ReeseAnn Reese Ann
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 40m
                  40m