Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-845

Flume User Guide is inconsistent about how collectorSink is translated into low level decorator/sinks.

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Won't Fix
    • Affects Version/s: 0.9.4
    • Fix Version/s: 0.9.5
    • Component/s: Docs
    • Labels:

      Description

      In User Guide 8.2.2, it states:
      As of v0.9.3, a new more generic collector sink that better encapsulates the "collectorMagic" functionality. This allows you to specify arbitrary sinks (or mulitple sinks) using the flume specification language. So the equivalent of
      collectorSink("xxx","yyy-%

      {rolltag}", 15000)
      is now:
      collector(15000) { escapedCustomDfs("xxx","yyy-%{rolltag}

      ") }
      while in section 8.2.3, it states:
      collectorSink("xxx","yyy",15000) is also a bit complicated with some custom decorators to handle acks. Under the covers however, it depends on a roller with a escapedCustomDfsSink inside of it.
      roll(15000) { collectorMagic escapedCustomDfs("xxx", "yyy-%

      {rolltag}") }

      There are two problems here:
      - make it clear which statement describes the current behavior (0.9.4), and remove the other one.
      - the first statement is wrong in that it includes %{rolltag}

      in the collectorSink configuration, actually, %

      {rolltag}

      is added by Flume automatically.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              shuang Shuang Wu
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: