HBase
  1. HBase
  2. HBASE-4542

add filter info to slow query logging

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.89.20100924
    • Fix Version/s: 0.94.0, 0.95.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Slow query log doesn't report filters in effect.

      For example:

      (operationTooSlow): \
      {"processingtimems":3468,"client":"10.138.43.206:40035","timeRange": [0,9223372036854775807],\
      "starttimems":1317772005821,"responsesize":42411, \
      "class":"HRegionServer","table":"myTable","families":{"CF1":"ALL"]},\
      "row":"6c3b8efa132f0219b7621ed1e5c8c70b","queuetimems":0,\
      "method":"get","totalColumns":1,"maxVersions":1,"storeLimit":-1}
      

      the above would suggest that all columns of myTable:CF1 are being requested for the given row. But in reality there could be filters in effect (such as ColumnPrefixFilter, ColumnRangeFilter, TimestampsFilter() etc.). We should enhance the slow query log to capture & report this information.

        Activity

        Lars Hofhansl made changes -
        Fix Version/s 0.94.0 [ 12316419 ]
        stack made changes -
        Fix Version/s 0.95.0 [ 12324094 ]
        Fix Version/s 0.94.0 [ 12316419 ]
        Fix Version/s 0.96.0 [ 12320040 ]
        Lars Hofhansl made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Lars Hofhansl made changes -
        Status Reopened [ 4 ] Resolved [ 5 ]
        Hadoop Flags Reviewed [ 10343 ]
        Resolution Fixed [ 1 ]
        Lars Hofhansl made changes -
        Resolution Fixed [ 1 ]
        Status Resolved [ 5 ] Reopened [ 4 ]
        Lars Hofhansl made changes -
        Fix Version/s 0.96.0 [ 12320040 ]
        Mikhail Bautin made changes -
        Fix Version/s 0.94.0 [ 12316419 ]
        Mikhail Bautin made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Mikhail Bautin made changes -
        Zhiqiu Kong made changes -
        Zhiqiu Kong made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Affects Version/s 0.89.20100924 [ 12315366 ]
        Phabricator made changes -
        Attachment D1539.1.patch [ 12512660 ]
        Phabricator made changes -
        Attachment D1263.2.patch [ 12511018 ]
        Kannan Muthukkaruppan made changes -
        Description Slow query log doesn't report filter in effect.

        For example:
        {code}
        (operationTooSlow): \
        {"processingtimems":3468,"client":"10.138.43.206:40035","timeRange": [0,9223372036854775807],\
        "starttimems":1317772005821,"responsesize":42411, \
        "class":"HRegionServer","table":"myTable","families":{"CF1":"ALL"]},\
        "row":"6c3b8efa132f0219b7621ed1e5c8c70b","queuetimems":0,\
        "method":"get","totalColumns":1,"maxVersions":1,"storeLimit":-1}
        {code}

        the above would suggest that all columns of myTable:CF1 are being requested for the given row. But in reality there could be filters in effect (such as ColumnPrefixFilter, ColumnRangeFilter, TimestampsFilter() etc.). We should enhance the slow query log to capture & report this information.

        Slow query log doesn't report filters in effect.

        For example:
        {code}
        (operationTooSlow): \
        {"processingtimems":3468,"client":"10.138.43.206:40035","timeRange": [0,9223372036854775807],\
        "starttimems":1317772005821,"responsesize":42411, \
        "class":"HRegionServer","table":"myTable","families":{"CF1":"ALL"]},\
        "row":"6c3b8efa132f0219b7621ed1e5c8c70b","queuetimems":0,\
        "method":"get","totalColumns":1,"maxVersions":1,"storeLimit":-1}
        {code}

        the above would suggest that all columns of myTable:CF1 are being requested for the given row. But in reality there could be filters in effect (such as ColumnPrefixFilter, ColumnRangeFilter, TimestampsFilter() etc.). We should enhance the slow query log to capture & report this information.

        Kannan Muthukkaruppan made changes -
        Field Original Value New Value
        Assignee Madhuwanti Vaidya [ madhuvaidya ]
        Kannan Muthukkaruppan created issue -

          People

          • Assignee:
            Madhuwanti Vaidya
            Reporter:
            Kannan Muthukkaruppan
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development