Uploaded image for project: 'Apache Storm'
  1. Apache Storm
  2. STORM-1074

Storm should include a bolt that writes Avro data to HDFS

        Details

        • Type: Improvement
        • Status: Resolved
        • Priority: Minor
        • Resolution: Fixed
        • Affects Version/s: None
        • Fix Version/s: 1.0.0
        • Component/s: storm-hdfs
        • Labels:
          None

          Description

          Storm should include a bolt that writes Avro GenericRecords to HDFS files

            Issue Links

            requires

            Bug - A problem which impairs or prevents the functions of the product. STORM-1073 SequenceFileBolt can end up in an unrecoverable state

            • Major - Major loss of function.
            • Resolved

              Activity

              Ascending order - Click to sort in descending order
              Hide
              Permalink
              dossett@gmail.com Aaron Dossett added a comment -

              I have implemented this and am ready to contribute it one STORM-969 is resolved since my code depends on that change.

              Show
              dossett@gmail.com Aaron Dossett added a comment - I have implemented this and am ready to contribute it one STORM-969 is resolved since my code depends on that change.
              Hide
              Permalink
              githubbot ASF GitHub Bot added a comment -

              GitHub user dossett opened a pull request:

              https://github.com/apache/storm/pull/819

              STORM-1074: Add Avro HDFS bolt

              This creates a new concrete subtype of AbstractHdfsBolt that can write avro Generic Records directly to HDFS.

              You can merge this pull request into a Git repository by running:

              $ git pull https://github.com/dossett/storm STORM-1074

              Alternatively you can review and apply these changes as the patch at:

              https://github.com/apache/storm/pull/819.patch

              To close this pull request, make a commit to your master/trunk branch
              with (at least) the following in the commit message:

              This closes #819

              commit de579bec841ad86b35d4490a4988c41509f775f5
              Author: Aaron Dossett <aaron.dossett@target.com>
              Date: 2015-10-26T13:08:44Z

              STORM-1074: Add Avro HDFS bolt

              Show
              githubbot ASF GitHub Bot added a comment - GitHub user dossett opened a pull request: https://github.com/apache/storm/pull/819 STORM-1074 : Add Avro HDFS bolt This creates a new concrete subtype of AbstractHdfsBolt that can write avro Generic Records directly to HDFS. You can merge this pull request into a Git repository by running: $ git pull https://github.com/dossett/storm STORM-1074 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/storm/pull/819.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #819 commit de579bec841ad86b35d4490a4988c41509f775f5 Author: Aaron Dossett <aaron.dossett@target.com> Date: 2015-10-26T13:08:44Z STORM-1074 : Add Avro HDFS bolt
              Hide
              Permalink
              githubbot ASF GitHub Bot added a comment -

              Github user harshach commented on the pull request:

              https://github.com/apache/storm/pull/819#issuecomment-151176796

              +1

              Show
              githubbot ASF GitHub Bot added a comment - Github user harshach commented on the pull request: https://github.com/apache/storm/pull/819#issuecomment-151176796 +1
              Hide
              Permalink
              githubbot ASF GitHub Bot added a comment -

              Github user harshach commented on the pull request:

              https://github.com/apache/storm/pull/819#issuecomment-151729267

              Thanks @dossett, merged into master.

              Show
              githubbot ASF GitHub Bot added a comment - Github user harshach commented on the pull request: https://github.com/apache/storm/pull/819#issuecomment-151729267 Thanks @dossett, merged into master.
              Hide
              Permalink
              githubbot ASF GitHub Bot added a comment -

              Github user asfgit closed the pull request at:

              https://github.com/apache/storm/pull/819

              Show
              githubbot ASF GitHub Bot added a comment - Github user asfgit closed the pull request at: https://github.com/apache/storm/pull/819
              Hide
              Permalink
              githubbot ASF GitHub Bot added a comment -

              Github user dossett commented on the pull request:

              https://github.com/apache/storm/pull/819#issuecomment-151841639

              Thank you @harshach, this was a fun one to develop.

              Show
              githubbot ASF GitHub Bot added a comment - Github user dossett commented on the pull request: https://github.com/apache/storm/pull/819#issuecomment-151841639 Thank you @harshach, this was a fun one to develop.

                People

                • Assignee:
                  dossett@gmail.com Aaron Dossett
                  Reporter:
                  dossett@gmail.com Aaron Dossett
                • Votes:
                  0 Vote for this issue
                  Watchers:
                  2 Start watching this issue

                  Dates

                  • Created:
                    Updated:
                    Resolved:

                    Development