Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Cannot Reproduce
    • Affects Version/s: None
    • Fix Version/s: 1.7.0
    • Component/s: Sinks+Sources
    • Labels:
      None
    • Environment:

      Centos

      Description

      With HDFS Sink with following config , files are rolling after every 510 bytes

      Hadoop Environment : 1.0.0

      Flume-Ng - 1.2.0

      Config below

      yum.sinks.ad-error-sink.type=hdfs
      yum.sinks.ad-erorr-sink.hdfs.timeZone=UTC
      yum.sinks.ad-error-sink.hdfs.path=hdfs://10.16.1.156:9000/home/data/flume-data/ad-error
      yum.sinks.ad-error-sink.hdfs.filePrefix=aderror
      yum.sinks.ad-error-sink.hdfs.fileType=DataStream
      yum.sinks.ad-error-sink.hdfs.writeFormat=Text
      yum.sinks.ad-error.sink.hdfs.rollInterval=0
      yum.sinks.ad-error.sink.hdfs.rollSize=134217728
      yum.sinks.ad-error.sink.hdfs.rollCount=0

        Activity

        Hide
        liorze Lior Zeno added a comment -

        I failed to reproduce this problem on flume 1.6.0 and hadoop 1.2.1.

        Show
        liorze Lior Zeno added a comment - I failed to reproduce this problem on flume 1.6.0 and hadoop 1.2.1.

          People

          • Assignee:
            Unassigned
            Reporter:
            sachingp Sachin Gupta
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development