Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-3750

JDBCStatsPublisher fails when ID length exceeds length of ID column

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.11.0
    • 0.11.0
    • Statistics
    • None
    • Reviewed

    Description

      When the length of the ID field passed to JDBCStatsPublisher exceeds the length of the column in the table (currently 255 characters) stats collection fails. This causes the entire query to fail when hive.stats.reliable is set to true.

      One way to prevent this would be to calculate a deterministic, very low collision hash of the ID prefix used for aggregation and use that when the length of the ID is too long.

      Attachments

        1. HIVE-3750.1.patch.txt
          100 kB
          Kevin Wilfong

        Issue Links

          Activity

            People

              kevinwilfong Kevin Wilfong
              kevinwilfong Kevin Wilfong
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: