Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-21263

Mention compression algorithm along with other storefile details

    XMLWordPrintableJSON

    Details

    • Hadoop Flags:
      Reviewed

      Description

      Where we log storefile details we should also log the compression algorithm used to compress blocks on disk, if any.

      For example, here's a log line out of compaction:

      2018-10-02 21:59:47,594 DEBUG [regionserver/host/1.1.1.1:8120-longCompactions-1538517461152] compactions.Compactor: Compacting hdfs://namenode:8020/hbase/data/default/TestTable/86037c19117a46b5b8148439ea55753b/i/3d04a7c28d6343ceb773737dbb192533, keycount=3335873, bloomtype=ROW, size=107.5 M, encoding=ROW_INDEX_V1, seqNum=154199, earliestPutTs=1538516084915

      Aside from bloom type, block encoding, and filename, it would be good to know compression type in this type of DEBUG or INFO level logging. A minor omission of information that could be helpful during debugging.

        Attachments

        1. HBASE-21263.master.001.patch
          2 kB
          Subrat Mishra
        2. HBASE-21263.master.002.patch
          2 kB
          Subrat Mishra
        3. HBASE-21263.master.003.patch
          9 kB
          Subrat Mishra
        4. HBASE-21263-branch-1.patch
          7 kB
          Andrew Kyle Purtell
        5. HBASE-21263-branch-2.0.patch
          7 kB
          Andrew Kyle Purtell
        6. HBASE-21263.patch
          8 kB
          Andrew Kyle Purtell

          Activity

            People

            • Assignee:
              subrat.mishra Subrat Mishra
              Reporter:
              apurtell Andrew Kyle Purtell
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: