Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-13057

Remove duplicate copies of TableDesc property values in PartitionDesc

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.1.0
    • None
    • None

    Description

      For a partitioned table, each PartitionDesc has a copy of corresponding TableDesc.

      While TableDesc is mutable and hence cannot be interned, it's property values can be.

      For a simple select on a table with 100K partitions, this cut total number of String instances by ~65%.

      Most replicated strings were location, serde, input/output format, column, types, table name, etc.

      Attachments

        1. HIVE-13057.patch
          2 kB
          Mohit Sabharwal

        Issue Links

          links to

          Web Link review board

          Activity

            People

              mohitsabharwal Mohit Sabharwal
              mohitsabharwal Mohit Sabharwal
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: