VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.3.0
    • fs/s3
    • None

    Description

      Expect a PoC patch for this in a couple of days;

      • it'll depend on an SDK update to work, plus a couple of of other minor changes
      • Adds command line option too
        hadoop s3guard select -header use -compression gzip -limit 100 s3a://landsat-pds/scene_list.gz" \
        "SELECT s.entityId FROM S3OBJECT s WHERE s.cloudCover = '0.0' "
        

      For wider use we'll need to implement the HADOOP-15229 so that callers can pass down the expression along with any other parameters

      Attachments

        1. HADOOP-15364-004.patch
          88 kB
          Steve Loughran
        2. HADOOP-15364-002.patch
          91 kB
          Steve Loughran
        3. HADOOP-15364-001.patch
          90 kB
          Steve Loughran

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            stevel@apache.org Steve Loughran
            stevel@apache.org Steve Loughran
            Votes:
            0 Vote for this issue
            Watchers:
            16 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment