Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-3891

Investigate Hudi vs Raw Parquet table discrepancy

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Task
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • None
    • 0.11.0
    • None

    Description

      While benchmarking querying raw Parquet tables against Hudi tables, i've run the test against the same (Hudi) table:

      1. In one query path i'm reading it as just a raw Parquet table
      2. In another, i'm reading it as Hudi RO (read_optimized) table

      Surprisingly enough, those 2 diverge in the # of files being read:

       
      Raw Parquet

       
      Hudi

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            alexey.kudinkin Alexey Kudinkin
            alexey.kudinkin Alexey Kudinkin
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Agile

                Completed Sprint:
                Hudi-Sprint-Apr-12 ended 19/Apr/22
                View on Board

                Slack

                  Issue deployment