Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-15206

Add a validation functionality to hiveSchemaTool

Log workAgile BoardRank to TopRank to BottomAdd voteVotersWatch issueWatchersCreate sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.2.0
    • Fix Version/s: None
    • Component/s: Metastore
    • Labels:
      None

      Description

      We have seen issues that the metastore get corrupted and cause the whole hiveserver not running.

      Add the support to detect such corruption to hiveSchemaTool. Fixing the issue automatically could be risky, so may still defer to the admin.

        Attachments

        1.
        Schematool should detect malformed URIs Sub-task Resolved Yongzhi Chen Actions
        2.
        Schematool should recognize missing tables in metastore Sub-task Resolved Naveen Gangam Actions
        3.
        Schematool provides a way to detect invalid entries in VERSION table Sub-task Resolved Chaoyu Tang Actions
        4.
        Remove unused 'COLUMNS' table from derby schema Sub-task Patch Available Aihua Xu Actions
        5.
        Keep Schema in consistent state where schemaTool fails or succeeds. Sub-task Resolved Unassigned Actions
        6.
        Implement a capability to detect incorrect sequence numbers Sub-task Resolved Aihua Xu Actions
        7.
        Detect the values for incorrect NULL values Sub-task Resolved Aihua Xu Actions
        8.
        Refactoring the validate function of HiveSchemaTool to make the output consistent Sub-task Resolved Aihua Xu Actions
        9.
        Location validation for table should ignore the values for view. Sub-task Resolved Yongzhi Chen Actions
        10.
        Eliminate conflicting output from schematool's table validator. Sub-task Resolved Naveen Gangam Actions
        11.
        Change SchemaTool table validator to test based on the dbType Sub-task Resolved Naveen Gangam Actions
        12.
        Some minor improvement on the validation tool Sub-task Resolved Aihua Xu Actions
        13.
        SchemaTool should exit with non-zero exit code when one or more validator's fail. Sub-task Resolved Naveen Gangam Actions
        14.
        Improve the validation output to make the output to stderr and stdout more consistent Sub-task Closed Aihua Xu Actions
        15.
        Check if the console message from the hive schema tool needs to print to logging file Sub-task Open Unassigned Actions
        16.
        Schema table validator should return a sorted list of missing tables Sub-task Closed Naveen Gangam Actions
        17.
        Improve location validator to check for blank paths. Sub-task Closed Naveen Gangam Actions
        18.
        Improve table validator's performance against Oracle Sub-task Closed Naveen Gangam Actions
        19.
        Change the sort key for the schema tool validator to be <ID> Sub-task Closed Naveen Gangam Actions

          Activity

          $i18n.getText('security.level.explanation', $currentSelection) Viewable by All Users
          Cancel

            People

              Dates

              • Created:
                Updated:

                Issue deployment