Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-4192

HoodieHFileReader scan top cells after bottom cells throw NullPointerException

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • None
    • 0.11.1
    • None

    Description

      Assume we index N columns in the MetaTable, such as col_1, col_2... col_n

      When executing a query that "selects * from table where col_n = 'xx' and col1 = 'xx'"".
      In the process of scanning the hfiles of MetaTable, there are acually 2 steps:

      Firstly, the col_n cells will be scanned in the hfile (mainly to obtain the minmax), once the scan is completed, the scanner is already at the end of the file.

      Secondly, at this time when the cell of the col_1 is scanned, because the seekTo is not called in time to back to the file header, it will encounter the scanner.getCell to report the NullPointerException exception.

       

      Attachments

        Activity

          People

            Unassigned Unassigned
            Xingjun Hao
            Bo Cui, Forward Xu, Tao Meng
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: