Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.13.0
    • Component/s: None
    • Labels:
    • Release Note:
      New transactional APIs to support Streaming data directly into Hive.
    • Tags:
      Streaming ACID

      Description

      Implement support for Streaming data into HIVE.

      • Provide a client streaming API
      • Transaction support: Clients should be able to periodically commit a batch of records atomically
      • Immediate visibility: Records should be immediately visible to queries on commit
      • Should not overload HDFS with too many small files

      Use Cases:

      • Streaming logs into HIVE via Flume
      • Streaming results of computations from Storm

        Attachments

        1. 5687-api-spec4.pdf
          136 kB
          Roshan Naik
        2. 5687-draft-api-spec.pdf
          37 kB
          Roshan Naik
        3. 5687-draft-api-spec2.pdf
          30 kB
          Roshan Naik
        4. 5687-draft-api-spec3.pdf
          30 kB
          Roshan Naik
        5. HIVE-5687.patch
          39 kB
          Roshan Naik
        6. HIVE-5687.v2.patch
          54 kB
          Roshan Naik
        7. HIVE-5687.v3.patch
          122 kB
          Roshan Naik
        8. HIVE-5687.v4.patch
          126 kB
          Roshan Naik
        9. HIVE-5687.v5.patch
          129 kB
          Roshan Naik
        10. HIVE-5687.v6.patch
          250 kB
          Roshan Naik
        11. HIVE-5687.v7.patch
          139 kB
          Roshan Naik
        12. HIVE-5687-unit-test-fix.patch
          5 kB
          Owen O'Malley
        13. Hive Streaming Ingest API for v3 patch.pdf
          161 kB
          Roshan Naik
        14. Hive Streaming Ingest API for v4 patch.pdf
          172 kB
          Roshan Naik
        15. package.html
          7 kB
          Owen O'Malley

          Issue Links

            Activity

              People

              • Assignee:
                roshan_naik Roshan Naik
                Reporter:
                roshan_naik Roshan Naik
              • Votes:
                0 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: