Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-1591

enabling different block size setting for small column families

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • v1.5.2
    • None
    • None

    Description

      the current setting for hbase block size (kylin.hbase.default.block.size) is by default set to a quite large value because cubes can be quite big value(4M) because cubes with memory hungry measures like hll can be quite large. However if a column family does not contain memory hungry measures it does not make sense to be that large.

      the revised setting will be:

      public int getHbaseDefaultBlockSize()

      { return Integer.valueOf(getOptional("kylin.hbase.default.block.size", "1048576")); }

      public int getHbaseSmallFamilyBlockSize()

      { return Integer.valueOf(getOptional("kylin.hbase.small.family.block.size", "65536")); }

      Attachments

        Activity

          People

            mahongbin Hongbin Ma
            mahongbin Hongbin Ma
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: