Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-2258

Storing toString fields in FilterPredicate instances can lead to memory pressure

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.13.0
    • None
    • None

    Description

      It happens with Hive (HiveServer2), a certain amount of predicate instances can make HiveServer2 OOM. According to the heapdump and background information, the predicates must have been simplified a bit, but still, storing toString in the objects looks very weird.

      Attachments

        1. Parquet_Predicate_toString_memory.png
          1.16 MB
          László Bodor
        2. image-2023-03-14-13-27-54-008.png
          1014 kB
          László Bodor

        Activity

          People

            abstractdog László Bodor
            abstractdog László Bodor
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: