Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-9373

Fix potential data losing for RocksDBBackend

    XMLWordPrintableJSON

    Details

      Description

      Currently, when using RocksIterator we only use the iterator.isValid() to check whether we have reached the end of the iterator. But that is not enough, if we refer to RocksDB's wiki https://github.com/facebook/rocksdb/wiki/Iterator#error-handling we should find that even if iterator.isValid()=true, there may also exist some internal error. A safer way to use the RocksIterator is to always call the iterator.status() to check the internal error of RocksDB. There is a case from user email seems to lost data because of this http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Missing-MapState-when-Timer-fires-after-restored-state-td20134.html

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                sihuazhou Sihua Zhou
                Reporter:
                sihuazhou Sihua Zhou
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: