Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-7773

Allow Users to extend S3/GCS HoodieIncrSource to bring in additional columns from upstream

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • deltastreamer
    • None

    Description

      Current S3/GCS HoodieIncrSource reads file-paths from upstream tables and ingests to downstream tables. We need ability to extend this functionality by joining additional columns in the upstream table before writing to the downstream table.

      Attachments

        Activity

          People

            vbalaji Balaji Varadarajan
            vbalaji Balaji Varadarajan
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: