Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-2886

Add Scan TimeRange to HBaseStorage

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 0.9.0, 0.9.1, 0.9.2
    • 0.11
    • None
    • Added the ability to set HBase Scan's maxTimestamp, minTimestamp and timestamp in HBaseStorage. I also added unit tests.
    • HBaseStorage timeRange timeStamp

    Description

      I have a client that wants to use pig. They are using MR now. They can't use PIG right now because they only want to fetch the last day's worth of data in HBase. A filter with time range would require reading all the HStore files. If we hold major compaction until after the fetch and use Scan Time Range we only need to read very little in compression.

      Attachments

        1. PIG-2886-0.patch
          6 kB
          Theodore michael Malaska
        2. PIG-2886-1.patch
          13 kB
          Theodore michael Malaska
        3. PIG-2886-2.patch
          10 kB
          Theodore michael Malaska
        4. PIG-2886-3.patch
          11 kB
          Theodore michael Malaska

        Issue Links

          Activity

            People

              malaskat Ted Malaska
              ted.m Theodore michael Malaska
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: