Uploaded image for project: 'ORC'
  1. ORC
  2. ORC-137

Disable bloomfilter PPD for timestamps for files created before ORC-135

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Done
    • 1.2.0, 1.3.0
    • 1.3.2, 1.4.0
    • None
    • None

    Description

      Bloomfilter created for timestamp columns before ORC-135 can return wrong results because of missing timezone adjustments. We need to disable PPD for old files.

      Attachments

        Issue Links

          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. ORC-135 PPD for timestamp is wrong when reader and writer timezones are different

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-12417 Orc bloom filter options are not propagated during file write in spark

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          links to

          Web Link GitHub Pull Request #111

          Activity

            People

              prasanth_j Prasanth Jayachandran
              prasanth_j Prasanth Jayachandran
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: