Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-17103

HIVE-14251 severely impacts backward compatibility of UNION ALL queries

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.2.0
    • Fix Version/s: None
    • Component/s: Types
    • Labels:
      None

      Description

      HIVE-14251 looks like it changed behavior of type conversion during UNION ALL queries, where types that are of different primitive groups (date, string, numeric, binary, boolean) cannot be unioned together with implicit conversions, and requires an explicit type cast to the desired type.

      That HIVE-14251 breaks backward compatibility is spelled out in the release notes. However I'm wondering if this was the right fix - this has quite a big impact on the usability of UNION ALL.

      Some alternative suggestions:
      1. Should we have simply not fixed HIVE-14251? While almost all DBMSs recommend users to use explicit casts, a lot of people just rely on implicit casting (if supported), and then do explicit casting if they want something other than the default behavior. This might have been one of the times the user would want to use explicit casts to override the default Hive behavior.
      2. Try to specifically fix the case for HIVE-14251 (union behavior of date, numeric). I was actually surprised union of date and numeric values worked, because when I originally did DATE type I tried to make sure DATE was not convertible to anything except string/timestamp. For example I don't think you can actually explicitly cast DATE to INT. We could try to make this particular implicit union conversion invalid (as well as any others we feel may not ).

      cc Aihua Xu Mohit Sabharwal [~ctang.ma] Ashutosh Chauhan Aravind Gopal Sergey Shelukhin as these are the names I've seen on HIVE-14251, as well as related Jira HIVE-16050

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              jdere Jason Dere
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated: