Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-25060

Hive Compactor doesn´t launch cleaner

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.1.1
    • Fix Version/s: None
    • Component/s: Hive
    • Labels:
      None
    • Environment:

      Hive 3.1.0

      Hadoop 3.1.1

      Description

      Hello,

      there are problems with Hive Compactor. We can see in hivemetastore.log this message "Max block location exceeded for split" and it´s appearing more and more times.
      After that, the "compactor.Cleaner" is not launched.

      We observed that after a Hive Metastore restart, the "compactor.Cleaner" has not been launched nevermore, but logs doesn´t display any message about it.

      Could be a degradation of the Hive Compactor when delta files are growing in the partitions?

      Regards.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              FranTCS Fran Gonzalez
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: