Description
Noticed a failure rerunning some ITs against a real cluster complaining that a file already existed. This shouldn't have happened because we delete the directory before we remake the files.
for (int i = 0; i < COUNT; i++) { opts.outputFile = new Path(files, String.format(fileFormat, i)).toString(); opts.startRow = N * i; TestIngest.ingest(c, fs, opts, BWOPTS); } opts.outputFile = base + String.format(fileFormat, N); opts.startRow = N; opts.rows = 1; // create an rfile with one entry, there was a bug with this: TestIngest.ingest(c, fs, opts, BWOPTS);
Turns out that special file with one entry (which we had a bug with) isn't put into the directory or files we import. Oops.