Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-1297

[Umbrella] Spark Datasource Support

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Critical
    • Resolution: Unresolved
    • 0.9.0
    • None
    • Spark Integration

    Description

      Yet to be fully scoped out

      But high level, we want to 

      • First class support for streaming reads/writes via structured streaming
      • Row based reader/writers all the way
      • Support for File/Partition pruning using Hudi metadata tables

      Attachments

        Issue Links

          Activity

            People

              vinoth Vinoth Chandar
              vinoth Vinoth Chandar
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:

                Time Tracking

                  Estimated:
                  Original Estimate - 24h
                  24h
                  Remaining:
                  Remaining Estimate - 24h
                  24h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified