Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-5549

LOGFILE_DATA_BLOCK_FORMAT Should not need to be set to parquet when using SparkRecordManager

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • spark

    Description

      HoodieStorageConfig.LOGFILE_DATA_BLOCK_FORMAT needs to be set to "parquet" whenever we use SparkRecordManager.

      This should not be required.

      Attachments

        Issue Links

          Activity

            People

              wzx Frank Wong
              jonvex Jonathan Vexler
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: