[FLINK-5907] RowCsvInputFormat bug on parsing tsv

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.2.0
• Fix Version/s: 1.2.1, 1.3.0
• Labels: csv parsing
• Assignee: Kurt Young
• Reporter: Flavio Pompermaier
• Created: 24/Feb/17 10:43
• Updated: 28/Feb/19 14:29
• Resolved: 27/Feb/17 23:51

Description

The following snippet reproduce the problem (using the attached file as input):

char fieldDelim = '\t';
    TypeInformation<?>[] fieldTypes = new TypeInformation<?>[51];
    for (int i = 0; i < fieldTypes.length; i++) {
      fieldTypes[i] = BasicTypeInfo.STRING_TYPE_INFO;
    }
    int[] fieldMask = new int[fieldTypes.length];
    for (int i = 0; i < fieldMask.length; i++) {
      fieldMask[i] = i;
    }
    RowCsvInputFormat csvIF = new RowCsvInputFormat(new Path(testCsv), fieldTypes, "\n", fieldDelim +"", 
       fieldMask, true);
    csvIF.setNestedFileEnumeration(true);
    DataSet<Row> csv = env.createInput(csvIF);
   csv.print()

Issue Links

• links to: GitHub Pull Request #3417