Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-3180

Include only files belonging to completed commits while bootstrapping metadata table

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      metadata table bootstrap does not filter for completed commit files, but all files based on fs.list call. We should filter out files that are part of an ongoing commit while doing bootstrap. 

      Attachments

        Issue Links

        is a parent of

        Bug - A problem which impairs or prevents the functions of the product. HUDI-3343 Metadata Table includes Uncommitted Log Files during Bootstrap

        • Blocker - Blocks development and/or testing work, production could not run
        • Closed
        links to

        Web Link GitHub Pull Request #4519

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            shivnarayan sivabalan narayanan Assign to me
            shivnarayan sivabalan narayanan
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Agile

                Completed Sprint:
                Hudi 0.10.1 - 2021/01/03 ended 12/Jan/22
                View on Board

                Slack

                  Issue deployment