Details

    • Type: Improvement Improvement
    • Status: Open
    • Priority: Minor Minor
    • Resolution: Unresolved
    • Affects Version/s: v0.9.4, v1.0.0
    • Fix Version/s: None
    • Component/s: Sinks+Sources
    • Labels:
      None

      Description

      There's no section in the official AVRO spec, but the general consensus
      seems to be to use the ".avro" extension for writing avro data files. See
      AVRO-153 <https://issues.apache.org/jira/browse/AVRO-153> and Cloudera on
      AVRO Usage <https://ccp.cloudera.com/display/CDHDOC/Avro+Usage>

        Issue Links

          Activity

          Hide
          Brock Noland added a comment -

          This looks fairly straightforward. I think we should add an option to HDFSEventSink called "filePostfix" or something similar. Then when writing out avro files you could set this parameter.

          I don't see a good way of automatically adding this extension if the source is avro.

          Show
          Brock Noland added a comment - This looks fairly straightforward. I think we should add an option to HDFSEventSink called "filePostfix" or something similar. Then when writing out avro files you could set this parameter. I don't see a good way of automatically adding this extension if the source is avro.
          Hide
          Mingjie Lai added a comment -

          +1 to have a fileSuffix config for hdfs sink.

          Show
          Mingjie Lai added a comment - +1 to have a fileSuffix config for hdfs sink.
          Hide
          Mingjie Lai added a comment -

          Will be fixed at FLUME-1209.

          Show
          Mingjie Lai added a comment - Will be fixed at FLUME-1209 .

            People

            • Assignee:
              Unassigned
              Reporter:
              Rob Verkuylen
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:

                Development