Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-845

Flume User Guide is inconsistent about how collectorSink is translated into low level decorator/sinks.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Won't Fix
    • 0.9.4
    • 0.9.5
    • Docs

    Description

      In User Guide 8.2.2, it states:
      As of v0.9.3, a new more generic collector sink that better encapsulates the "collectorMagic" functionality. This allows you to specify arbitrary sinks (or mulitple sinks) using the flume specification language. So the equivalent of
      collectorSink("xxx","yyy-%

      {rolltag}", 15000)
      is now:
      collector(15000) { escapedCustomDfs("xxx","yyy-%{rolltag}

      ") }
      while in section 8.2.3, it states:
      collectorSink("xxx","yyy",15000) is also a bit complicated with some custom decorators to handle acks. Under the covers however, it depends on a roller with a escapedCustomDfsSink inside of it.
      roll(15000) { collectorMagic escapedCustomDfs("xxx", "yyy-%

      {rolltag}") }

      There are two problems here:
      - make it clear which statement describes the current behavior (0.9.4), and remove the other one.
      - the first statement is wrong in that it includes %{rolltag}

      in the collectorSink configuration, actually, %

      {rolltag}

      is added by Flume automatically.

      Attachments

        Activity

          People

            Unassigned Unassigned
            shuang Shuang Wu
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: