Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-1591

enabling different block size setting for small column families

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: v1.5.2
    • Component/s: None
    • Labels:
      None

      Description

      the current setting for hbase block size (kylin.hbase.default.block.size) is by default set to a quite large value because cubes can be quite big value(4M) because cubes with memory hungry measures like hll can be quite large. However if a column family does not contain memory hungry measures it does not make sense to be that large.

      the revised setting will be:

      public int getHbaseDefaultBlockSize()

      { return Integer.valueOf(getOptional("kylin.hbase.default.block.size", "1048576")); }

      public int getHbaseSmallFamilyBlockSize()

      { return Integer.valueOf(getOptional("kylin.hbase.small.family.block.size", "65536")); }

        Attachments

          Activity

            People

            • Assignee:
              mahongbin Hongbin Ma
              Reporter:
              mahongbin Hongbin Ma
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: