Uploaded image for project: 'Phoenix'
  1. Phoenix
  2. PHOENIX-3744

Support snapshot scanners for MR-based queries

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.11.0
    • Labels:
      None

      Description

      HBase support scanning over snapshots, with a SnapshotScanner that accesses the region directly in HDFS. We should make sure that Phoenix can support that.

      Not sure how we'd want to decide when to run a query over a snapshot. Some ideas:

      • if there's an SCN set (i.e. the query is running at a point in time in the past)
      • if the memstore is empty
      • if the query is being run at a timestamp earlier than any memstore data
      • as a config option on the table
      • as a query hint
      • based on some kind of optimizer rule (i.e. based on estimated # of bytes that will be scanned)

      Phoenix typically runs a query at the timestamp at which it was compiled. Any data committed after this time should not be seen while a query is running.

        Attachments

        1. PHOENIX-3744.patch
          107 kB
          Akshita Malhotra
        2. PHOENIX-3744.patch
          107 kB
          Akshita Malhotra
        3. PHOENIX-3744.patch
          120 kB
          Akshita Malhotra
        4. PHOENIX-3744-4.x-HBase-0.98.patch
          113 kB
          Akshita Malhotra
        5. PHOENIX-3744-4.x-HBase-1.1.patch
          108 kB
          Akshita Malhotra

          Issue Links

            Activity

              People

              • Assignee:
                akshita.malhotra Akshita Malhotra
                Reporter:
                jamestaylor James Taylor
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: