Uploaded image for project: 'Ambari'
  1. Ambari
  2. AMBARI-13987

Set hive.metastore.schema.verification=true in hive-site.xml

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.2.0
    • 2.2.0
    • ambari-server
    • None

    Description

      We would like to have the following settings in hive-site.xml for installs of 2.1 onwards -

      hive.metastore.schema.verification=true

      In addition, I think we may already have the following as the case, but just in case they aren't, I'd like to list the following two as well:

      datanucleus.autoCreateSchema=false
      datanucleus.fixedDatastore=true

      Background:

      The Hive metastore has an issue wherein it tries to be non-strict about the schema version of the metastore db, and it can try to update the schema version if it finds that it is itself a newer version.

      This pairs well with things like autoCreateSchema, but since we're using SchemaTool to set up our schema, and at no point should we be allowing the metastore to update the schema itself, we would like to make sure that the schema validation step is a "strict" one, leading to metastore failure if the version number does not match, instead of the metastore simply updating the version.

      In addition, there seems to be a bug when the database access is slow or unreliable where the metastore winds up creating multiple rows of entries in the schema table in some cases. (This seems to happen rarely, but with more occurrences on AzureDB than others)

      Attachments

        1. AMBARI-13987.patch
          0.8 kB
          Dmitry Lysnichenko

        Issue Links

          Activity

            People

              dmitriusan Dmitry Lysnichenko
              dmitriusan Dmitry Lysnichenko
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: