Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-2886

Add Scan TimeRange to HBaseStorage

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 0.9.0, 0.9.1, 0.9.2
    • Fix Version/s: 0.11
    • Component/s: None
    • Labels:
    • Release Note:
      Added the ability to set HBase Scan's maxTimestamp, minTimestamp and timestamp in HBaseStorage. I also added unit tests.
    • Tags:
      HBaseStorage timeRange timeStamp

      Description

      I have a client that wants to use pig. They are using MR now. They can't use PIG right now because they only want to fetch the last day's worth of data in HBase. A filter with time range would require reading all the HStore files. If we hold major compaction until after the fetch and use Scan Time Range we only need to read very little in compression.

        Attachments

        1. PIG-2886-0.patch
          6 kB
          Theodore michael Malaska
        2. PIG-2886-1.patch
          13 kB
          Theodore michael Malaska
        3. PIG-2886-2.patch
          10 kB
          Theodore michael Malaska
        4. PIG-2886-3.patch
          11 kB
          Theodore michael Malaska

          Issue Links

            Activity

              People

              • Assignee:
                malaskat Ted Malaska
                Reporter:
                ted.m Theodore michael Malaska
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: