Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-1364

Increase the maximum length of various metastore fields, and remove TYPE_NAME from COLUMNS primary key

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.5.0
    • Fix Version/s: 0.6.0
    • Component/s: Metastore
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Tags:
      mysql serdeproperties jpox length

      Description

      The value component of a SERDEPROPERTIES key/value pair is currently limited
      to a maximum length of 767 characters. I believe that the motivation for limiting the length to
      767 characters is that this value is the maximum allowed length of an index in
      a MySQL database running on the InnoDB engine: http://bugs.mysql.com/bug.php?id=13315

      • The Metastore OR mapping currently limits many fields (including SERDEPROPERTIES.PARAM_VALUE) to a maximum length of 767 characters despite the fact that these fields are not indexed.
      • The maximum length of a VARCHAR value in MySQL 5.0.3 and later is 65,535.
      • We can expect many users to hit the 767 character limit on SERDEPROPERTIES.PARAM_VALUE when using the hbase.columns.mapping serdeproperty to map a table that has many columns.

      I propose increasing the maximum allowed length of SERDEPROPERTIES.PARAM_VALUE to 8192.

        Attachments

        1. HIVE-1364.4.backport-060.patch.txt
          6 kB
          Carl Steinbach
        2. HIVE-1364.4.patch.txt
          7 kB
          Carl Steinbach
        3. HIVE-1364.3.backport-060.patch.txt
          9 kB
          Carl Steinbach
        4. HIVE-1364.3.patch.txt
          10 kB
          Carl Steinbach
        5. HIVE-1364.2.patch.txt
          4 kB
          Carl Steinbach
        6. HIVE-1364.patch
          5 kB
          Carl Steinbach

          Issue Links

            Activity

              People

              • Assignee:
                cwsteinbach Carl Steinbach
                Reporter:
                cwsteinbach Carl Steinbach
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: