Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-26233

Problems reading back PARQUET timestamps above 10000 years

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      Timestamp values above year 10000 are not supported, but during the migration from Hive2 to Hive3 some might appear because of TZ issues. We should be able to at least read these tables before rewriting the data.

      For this we need to change the Timestamp.PRINT_FORMATTER, so no + sign is appended to the timestamp if the year exceeds 4 digits.

      Attachments

        Issue Links

        depends upon

        Bug - A problem which impairs or prevents the functions of the product. HIVE-24074 Incorrect handling of timestamp in Parquet/Avro when written in certain time zones in versions before Hive 3.x

        • Major - Major loss of function.
        • Closed
        is caused by

        Sub-task - The sub-task of the issue HIVE-20007 Hive should carry out timestamp computations in UTC

        • Blocker - Blocks development and/or testing work, production could not run
        • Closed
        links to

        Web Link GitHub Pull Request #3295

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            pvary Peter Vary Assign to me
            pvary Peter Vary
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

              Estimated:
              Original Estimate - Not Specified
              Not Specified
              Remaining:
              Remaining Estimate - 0h
              0h
              Logged:
              Time Spent - 2h 20m
              2h 20m

              Slack

                Issue deployment