Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-170

Updating hoodie record before inserting it into ExternalSpillableMap

    XMLWordPrintableJSON

Details

    Description

      Problem - If ExternalSpillableMap has reached its size limit then we start writing newly inserted records onto disk. Any future updates we make into the in memory copy of it will not be reflected on to on disk copy.

      Fix - In HoodieMergeHandle we are ensuring that we update the record before inserting it into ExternalSpillableMap so that we don't loose any updates done to it.

       

      related to this - https://github.com/apache/incubator-hudi/issues/773

      Attachments

        Issue Links

          Activity

            People

              ovjforu omkar vinit joshi
              ovjforu omkar vinit joshi
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 0.5h
                  0.5h