Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-11994

SHOW COMPACTIONS should include meta info about the job

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.0.0
    • None
    • Metastore, Transactions
    • None

    Description

      Currently output of SHOW COMPACTIONS only has current information.
      it would very useful if it could retain the data for a configurable period of time after the Cleaner handles the entry. Perhaps the entry can go into 'h' state for 'historical'.

      Such historical data can be used to drive alert generating logic.
      We can add a column with a JSON doc which can include various stats about the job: number of delta files, size in MB, time taken. Also can be useful to collect job properties from Hadoop, such as RAM used for example.
      All of this can enhance the type/quality of alerts.

      Attachments

        Issue Links

          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. HIVE-12353 When Compactor fails it calls CompactionTxnHandler.markedCleaned(). it should not.

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed
          requires

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-13353 SHOW COMPACTIONS should support filtering options

          • Major - Major loss of function.
          • Closed

          Activity

            People

              Unassigned Unassigned
              ekoifman Eugene Koifman
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: