Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-5549

LOGFILE_DATA_BLOCK_FORMAT Should not need to be set to parquet when using SparkRecordManager

Attach filesAttach ScreenshotAdd voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • spark

    Description

      HoodieStorageConfig.LOGFILE_DATA_BLOCK_FORMAT needs to be set to "parquet" whenever we use SparkRecordManager.

      This should not be required.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            wzx Frank Wong
            jonvex Jonathan Vexler

            Dates

              Created:
              Updated:

              Slack

                Issue deployment