Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-7329

Unable to use FileInputStream with StreamExecutionEnvironment.readFile with interval

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Not A Problem
    • None
    • None
    • API / DataStream
    • None
    • redhat 6, flink 1.3.1

    Description

      		FileInputFormat<String> fileInputFormat = new TextInputFormat(new Path(args[0]));
      		fileInputFormat.setNestedFileEnumeration(true);
      
      		streamEnv.readFile(fileInputFormat, args[0],
      				FileProcessingMode.PROCESS_CONTINUOUSLY, 10000L).print();
      
      

      When trying to run this code I get following error. It's not clear what the problem is here and why it fails with this message.

      [main] INFO org.apache.flink.api.java.typeutils.TypeExtractor - class org.apache.flink.streaming.api.functions.source.TimestampedFileInputSplit does not contain a setter for field modificationTime
      [main] INFO org.apache.flink.api.java.typeutils.TypeExtractor - class org.apache.flink.streaming.api.functions.source.TimestampedFileInputSplit is not a valid POJO type because not all fields are valid POJO fields.

      Attachments

        Activity

          People

            Unassigned Unassigned
            mohitanchlia Mohit Anchlia
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: