HBase
  1. HBase
  2. HBASE-68

[hbase] HStoreFiles needlessly store the column family name in every entry

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Not a Problem
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: regionserver
    • Labels:
      None

      Description

      Today, HStoreFiles keep the entire serialized HStoreKey objects around for every cell in the HStore. Since HStores are 1-1 with column families, this is really unnecessary - you can always surmise the column family by looking at the HStore it belongs to. (This information would ostensibly come from the file name or a header section.) This means that we could remove the column family part of the HStoreKeys we put into the HStoreFile, reducing the size of data stored. This would be a space-saving benefit, removing redundant data, and could be a speed benefit, as you have to scan over less data in memory and transfer less data over the network.

        Issue Links

          Activity

          Bryan Duxbury created issue -
          Owen O'Malley made changes -
          Field Original Value New Value
          Project Hadoop Core [ 12310240 ] Hadoop HBase [ 12310753 ]
          Key HADOOP-2521 HBASE-68
          Component/s contrib/hbase [ 12311752 ]
          Bryan Duxbury made changes -
          Link This issue relates to HBASE-61 [ HBASE-61 ]
          Bryan Duxbury made changes -
          Component/s regionserver [ 12312139 ]
          Jim Kellerman made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Fix Version/s 0.20.0 [ 12313474 ]
          Resolution Fixed [ 1 ]
          stack made changes -
          Resolution Fixed [ 1 ]
          Status Resolved [ 5 ] Reopened [ 4 ]
          Jonathan Gray made changes -
          Fix Version/s 0.21.0 [ 12313607 ]
          Fix Version/s 0.20.0 [ 12313474 ]
          stack made changes -
          Fix Version/s 0.22.0 [ 12314223 ]
          Fix Version/s 0.21.0 [ 12313607 ]
          stack made changes -
          Fix Version/s 0.92.0 [ 12314223 ]
          Andrew Purtell made changes -
          Status Reopened [ 4 ] Resolved [ 5 ]
          Resolution Not a Problem [ 8 ]

            People

            • Assignee:
              Unassigned
              Reporter:
              Bryan Duxbury
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development