Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-3023

{variable} substitution doesn't work for property 'fileSuffix'

Agile BoardAttach filesAttach ScreenshotAdd voteVotersStop watchingWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 1.6.0
    • None
    • Configuration
    • None
    • CDH5.5.1

      So, using Flume 1.6.0-cdh5.5.1

    Description

      In my sink configuration, setting the value of fileSuffix as follows :

      IngestAgent.sinks.HDFS1.hdfs.fileSuffix=_%Y%m%d.avro
      

      is giving me files with names as follows :

      /data/../../MyFileName.1479204507148_%Y%m%d.avro
      

      So the variables %Y%m%d didn't get resolved.

      Works fine if I add the variables to filePrefix instead.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            umesh9794@gmail.com Umesh Chaudhary
            karishmag9 Karishma Gulati

            Dates

              Created:
              Updated:

              Slack

                Issue deployment