Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersConvert to IssueMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.13.0
    • None
    • New transactional APIs to support Streaming data directly into Hive.
    • Streaming ACID

    Description

      Implement support for Streaming data into HIVE.

      • Provide a client streaming API
      • Transaction support: Clients should be able to periodically commit a batch of records atomically
      • Immediate visibility: Records should be immediately visible to queries on commit
      • Should not overload HDFS with too many small files

      Use Cases:

      • Streaming logs `into HIVE via Flume
      • Streaming results of computations from Storm

      Attachments

        1. 5687-draft-api-spec.pdf
          37 kB
          Roshan Naik
        2. 5687-draft-api-spec2.pdf
          30 kB
          Roshan Naik
        3. HIVE-5687.patch
          39 kB
          Roshan Naik
        4. 5687-draft-api-spec3.pdf
          30 kB
          Roshan Naik
        5. 5687-api-spec4.pdf
          136 kB
          Roshan Naik
        6. HIVE-5687.v2.patch
          54 kB
          Roshan Naik
        7. HIVE-5687.v3.patch
          122 kB
          Roshan Naik
        8. Hive Streaming Ingest API for v3 patch.pdf
          161 kB
          Roshan Naik
        9. HIVE-5687.v4.patch
          126 kB
          Roshan Naik
        10. HIVE-5687-unit-test-fix.patch
          5 kB
          Owen O'Malley
        11. HIVE-5687.v5.patch
          129 kB
          Roshan Naik
        12. HIVE-5687.v6.patch
          250 kB
          Roshan Naik
        13. package.html
          7 kB
          Owen O'Malley
        14. HIVE-5687.v7.patch
          139 kB
          Roshan Naik
        15. Hive Streaming Ingest API for v4 patch.pdf
          172 kB
          Roshan Naik

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            roshan_naik Roshan Naik Assign to me
            roshan_naik Roshan Naik
            Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment