Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-763

mapping physical node to logic node will lead to all nodes refresh

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Won't Fix
    • 0.9.4
    • 0.9.5
    • Master
    • None

    Description

      master node's hostname: hbase1
      other normal nodes: hbase2, hbase3, hbase6

      Steps:
      1.hbase6:text("/home/hadoop/open_file")|text("/home/hadoop/output_open_file");
      wait 20 minutes

      the version is "11/09/15 10:50:55"

      2.
      multiconfig [dataProduce:text("/home/hadoop/open_file")|agentDFOChain("hbase3:39998", "hbase6:39998"); dataConsumer1:collectorSource(39998)|text("/home/hadoop/output_dfochain_open_file"); dataConsumer2:collectorSource(39998)|text("/home/hadoop/output_dfochain_open_file");]
      map hbase2 dataProduce
      map hbase3 dataConsumer1
      map hbase6 dataConsumer2

      3. all node's configuration version update to the latest time, resend old data
      it will lead to the data in /home/hadoop/open_file has been sent again.

      the log is

      11/09/15 10:50:55 INFO debug.TextFileSource: File /home/hadoop/open_file opened
      11/09/15 11:25:12 INFO debug.TextFileSource: File /home/hadoop/open_file closed
      11/09/15 11:25:12 INFO agent.LogicalNode: Node config successfully set to com.cloudera.flume.conf.FlumeConfigData@1bc58a7
      11/09/15 11:25:12 INFO debug.TextFileSource: File /home/hadoop/open_file opened

      Attachments

        Activity

          People

            Unassigned Unassigned
            longda Longda Feng
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: