HBase
  1. HBase
  2. HBASE-4702

Allow override of scan cache value for rowcounter

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Won't Fix
    • Affects Version/s: 0.90.2
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Environment:

      Operating System: Linux

      Description

      Doing a row count for a large table via Mapreduce may take long time.
      Trying to set the default cache size but there is no knob to tune it.

      See here for more details, http://search-hadoop.com/m/ECEs6237AIX&subj=Re+speeding+up+rowcount

        Activity

        Rita M created issue -
        Ted Yu made changes -
        Field Original Value New Value
        Summary Allow override of scan cache value -- currently hard coded Allow override of scan cache value for rowcounter
        Description Doing a row count for a large table via Mapreduce. Trying to set the default cache size but no knobs to tune it.

        See here for more details, http://search-hadoop.com/m/ECEs6237AIX&subj=Re+speeding+up+rowcount



        Doing a row count for a large table via Mapreduce may take long time.
        Trying to set the default cache size but there is no knob to tune it.

        See here for more details, http://search-hadoop.com/m/ECEs6237AIX&subj=Re+speeding+up+rowcount



        Ted Yu made changes -
        Assignee Ted Yu [ yuzhihong@gmail.com ]
        Ted Yu made changes -
        Attachment 4702.txt [ 12501473 ]
        Hide
        Ted Yu added a comment -

        Please comment on the initial attempt.
        I allow mixing the specification of Scan attributes with column names.
        Separator is semicolon for Scan attributes.

        Show
        Ted Yu added a comment - Please comment on the initial attempt. I allow mixing the specification of Scan attributes with column names. Separator is semicolon for Scan attributes.
        Hide
        Jean-Daniel Cryans added a comment -

        Trying to set the default cache size but there is no knob to tune it.

        Use -Dhbase.client.scanner.caching=x on the command line or set it in your hbase-site.xml

        Show
        Jean-Daniel Cryans added a comment - Trying to set the default cache size but there is no knob to tune it. Use -Dhbase.client.scanner.caching=x on the command line or set it in your hbase-site.xml
        Hide
        Jesse Yates added a comment -

        Closing as won't fix as it looks like this isn't an issue.

        Show
        Jesse Yates added a comment - Closing as won't fix as it looks like this isn't an issue.
        Jesse Yates made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Won't Fix [ 2 ]
        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Resolved Resolved
        304d 3h 25m 1 Jesse Yates 28/Aug/12 18:55

          People

          • Assignee:
            Ted Yu
            Reporter:
            Rita M
          • Votes:
            1 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development