Uploaded image for project: 'Apache Storm'
  1. Apache Storm
  2. STORM-1074

Storm should include a bolt that writes Avro data to HDFS

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.0.0
    • Component/s: storm-hdfs
    • Labels:
      None

      Description

      Storm should include a bolt that writes Avro GenericRecords to HDFS files

        Issue Links

          Activity

          Hide
          dossett@gmail.com Aaron Dossett added a comment -

          I have implemented this and am ready to contribute it one STORM-969 is resolved since my code depends on that change.

          Show
          dossett@gmail.com Aaron Dossett added a comment - I have implemented this and am ready to contribute it one STORM-969 is resolved since my code depends on that change.
          Hide
          githubbot ASF GitHub Bot added a comment -

          GitHub user dossett opened a pull request:

          https://github.com/apache/storm/pull/819

          STORM-1074: Add Avro HDFS bolt

          This creates a new concrete subtype of AbstractHdfsBolt that can write avro Generic Records directly to HDFS.

          You can merge this pull request into a Git repository by running:

          $ git pull https://github.com/dossett/storm STORM-1074

          Alternatively you can review and apply these changes as the patch at:

          https://github.com/apache/storm/pull/819.patch

          To close this pull request, make a commit to your master/trunk branch
          with (at least) the following in the commit message:

          This closes #819


          commit de579bec841ad86b35d4490a4988c41509f775f5
          Author: Aaron Dossett <aaron.dossett@target.com>
          Date: 2015-10-26T13:08:44Z

          STORM-1074: Add Avro HDFS bolt


          Show
          githubbot ASF GitHub Bot added a comment - GitHub user dossett opened a pull request: https://github.com/apache/storm/pull/819 STORM-1074 : Add Avro HDFS bolt This creates a new concrete subtype of AbstractHdfsBolt that can write avro Generic Records directly to HDFS. You can merge this pull request into a Git repository by running: $ git pull https://github.com/dossett/storm STORM-1074 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/storm/pull/819.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #819 commit de579bec841ad86b35d4490a4988c41509f775f5 Author: Aaron Dossett <aaron.dossett@target.com> Date: 2015-10-26T13:08:44Z STORM-1074 : Add Avro HDFS bolt
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user harshach commented on the pull request:

          https://github.com/apache/storm/pull/819#issuecomment-151176796

          +1

          Show
          githubbot ASF GitHub Bot added a comment - Github user harshach commented on the pull request: https://github.com/apache/storm/pull/819#issuecomment-151176796 +1
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user harshach commented on the pull request:

          https://github.com/apache/storm/pull/819#issuecomment-151729267

          Thanks @dossett, merged into master.

          Show
          githubbot ASF GitHub Bot added a comment - Github user harshach commented on the pull request: https://github.com/apache/storm/pull/819#issuecomment-151729267 Thanks @dossett, merged into master.
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user asfgit closed the pull request at:

          https://github.com/apache/storm/pull/819

          Show
          githubbot ASF GitHub Bot added a comment - Github user asfgit closed the pull request at: https://github.com/apache/storm/pull/819
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user dossett commented on the pull request:

          https://github.com/apache/storm/pull/819#issuecomment-151841639

          Thank you @harshach, this was a fun one to develop.

          Show
          githubbot ASF GitHub Bot added a comment - Github user dossett commented on the pull request: https://github.com/apache/storm/pull/819#issuecomment-151841639 Thank you @harshach, this was a fun one to develop.

            People

            • Assignee:
              dossett@gmail.com Aaron Dossett
              Reporter:
              dossett@gmail.com Aaron Dossett
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development