Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2010

Support Avro records in Log4jAppender and the HDFS Sink

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.4.0
    • Client SDK, Sinks+Sources
    • None

    Description

      It would be nice to support logging arbitrary Avro records via the Log4j Flume logger, and have them written to HDFS in Avro data files (using an appropriately configured HDFS sink).

      Attachments

        1. FLUME-2010.patch
          8 kB
          Thomas White
        2. FLUME-2010.patch
          11 kB
          Thomas White
        3. FLUME-2010.patch
          28 kB
          Thomas White
        4. FLUME-2010.patch
          37 kB
          Thomas White
        5. FLUME-2010.patch
          37 kB
          Thomas White

        Issue Links

        blocks

        Documentation - Documentation or Website FLUME-2097 Add docs for Avro Serializer and describe how to make the Avro Deserializer work with the Avro Serializer

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Open
        is depended upon by

        New Feature - A new feature of the product, which has yet to be developed. FLUME-2091 Use Avro schema hashes in Log4jAppender and the HDFS Sink

        • Major - Major loss of function.
        • Open

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            tomwhite Thomas White
            tomwhite Thomas White
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment