Flume
  1. Flume
  2. FLUME-265

FanOut Collector does not support multiple collectorSink attributes

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Cannot Reproduce
    • Affects Version/s: v0.9.1
    • Fix Version/s: v0.9.4
    • Component/s: Sinks+Sources
    • Labels:
      None
    • Environment:

      CentOS 5.3

      Description

      If a Fan Out collector is configured to write to multiple collectorSink's it will fail with

      Event already had an event with attribute rolltag

        Issue Links

          Activity

          Hide
          Jonathan Hsieh added a comment -

          There is a workaround described in the previous comments.

          Show
          Jonathan Hsieh added a comment - There is a workaround described in the previous comments.
          Hide
          Jonathan Hsieh added a comment - - edited

          I believe this is no longer an issue with the new syntax that gives essentially the same functionality (write two copies to different places).

          collector(3000) { [ escapedCustomDfs("hdfs://nn/path/", "file%{rolltag}") , escapedCustomDfs("hdfs://nn2/path2/", "logs%{rolltag}") ] } 
          

          I will close this in a week or so unless I hear any concerns.

          Show
          Jonathan Hsieh added a comment - - edited I believe this is no longer an issue with the new syntax that gives essentially the same functionality (write two copies to different places). collector(3000) { [ escapedCustomDfs( "hdfs: //nn/path/" , "file%{rolltag}" ) , escapedCustomDfs( "hdfs://nn2/path2/" , "logs%{rolltag}" ) ] } I will close this in a week or so unless I hear any concerns.

            People

            • Assignee:
              Jonathan Hsieh
              Reporter:
              Disabled imported user
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development