Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-4929

Refactor code that is common to all ingestions from cloud sources

    XMLWordPrintableJSON

Details

    • Task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • deltastreamer
    • None

    Description

      Currently, there are features to ingest incrementally from S3 (HUDI-1897) and GCS (HUDI-4850). Refactor common logic used across both. This will help in easier implementation of future cloud based ingestion sources.

      Attachments

        Issue Links

          is a child of

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. HUDI-1896 HudiStreamer Source for cloud object stores

          • Critical - Crashes, loss of data, severe memory leak.
          • Open

          Activity

            People

              Unassigned Unassigned
              pramodbiligiri Pramod Biligiri
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: