Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-22589

Add storage support for ProlepticCalendar in ORC, Parquet, and Avro

    XMLWordPrintableJSON

    Details

      Description

      Hive recently moved its processing to the proleptic calendar, which has created some issues for users who have dates before 1580 AD.

      HIVE-22405 extended the column vectors for times & dates to encode which calendar they are using.

      This issue is to support proleptic calendar in ORC, Parquet, and Avro, when files are written/read by Hive. To preserve compatibility with other engines until they upgrade their readers, files will be written using hybrid calendar by default. Default behavior when files do not contain calendar information in their metadata is configurable.

        Attachments

        1. HIVE-22589.01.patch
          133 kB
          David Lavati
        2. HIVE-22589.02.patch
          163 kB
          Jesus Camacho Rodriguez
        3. HIVE-22589.03.patch
          223 kB
          Jesus Camacho Rodriguez
        4. HIVE-22589.04.patch
          224 kB
          Jesus Camacho Rodriguez
        5. HIVE-22589.05.patch
          223 kB
          Jesus Camacho Rodriguez
        6. HIVE-22589.06.patch
          225 kB
          Jesus Camacho Rodriguez
        7. HIVE-22589.07.patch
          510 kB
          Jesus Camacho Rodriguez
        8. HIVE-22589.07.patch
          510 kB
          Jesus Camacho Rodriguez
        9. HIVE-22589.07.patch
          510 kB
          Jesus Camacho Rodriguez
        10. HIVE-22589.07.patch
          510 kB
          Jesus Camacho Rodriguez
        11. HIVE-22589.08.patch
          510 kB
          Jesus Camacho Rodriguez
        12. HIVE-22589.08.patch
          510 kB
          Jesus Camacho Rodriguez
        13. HIVE-22589.patch
          133 kB
          David Lavati
        14. HIVE-22589.patch
          133 kB
          Jesus Camacho Rodriguez

          Issue Links

            Activity

              People

              • Assignee:
                jcamachorodriguez Jesus Camacho Rodriguez
                Reporter:
                jcamachorodriguez Jesus Camacho Rodriguez
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: