Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.3.0
    • fs/s3
    • None

    Description

      Expect a PoC patch for this in a couple of days;

      • it'll depend on an SDK update to work, plus a couple of of other minor changes
      • Adds command line option too
        hadoop s3guard select -header use -compression gzip -limit 100 s3a://landsat-pds/scene_list.gz" \
        "SELECT s.entityId FROM S3OBJECT s WHERE s.cloudCover = '0.0' "
        

      For wider use we'll need to implement the HADOOP-15229 so that callers can pass down the expression along with any other parameters

      Attachments

        1. HADOOP-15364-001.patch
          90 kB
          Steve Loughran
        2. HADOOP-15364-002.patch
          91 kB
          Steve Loughran
        3. HADOOP-15364-004.patch
          88 kB
          Steve Loughran

        Issue Links

          Activity

            People

              stevel@apache.org Steve Loughran
              stevel@apache.org Steve Loughran
              Votes:
              0 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: