Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-12080

Support auto type widening (int->bigint & float->double) for Parquet table

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.0.0
    • File Formats
    • None

    Description

      Currently Hive+Parquet doesn't support it. It should include at least basic type promotions short->int->bigint, float->double etc, that are already supported for other file formats.

      There were similar effort (Hive-6784) but was not committed. This JIRA is to address the same in different way with little (no) performance impact.

      Attachments

        1. HIVE-12080.1.patch
          34 kB
          Mohammad Islam
        2. HIVE-12080.2.patch
          40 kB
          Mohammad Islam
        3. HIVE-12080.3.patch
          40 kB
          Mohammad Islam
        4. HIVE-12080.6.patch
          46 kB
          Mohammad Islam
        5. HIVE-12080.7.patch
          46 kB
          Mohammad Islam

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-6784 parquet-hive should allow column type change

          • Major - Major loss of function.
          • Closed

          Activity

            People

              kamrul Mohammad Islam
              kamrul Mohammad Islam
              Votes:
              1 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: