[DRILL-4492] TestMergeJoinWithSchemaChanges depends on order files in a directory are read to pass, should be refactored

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: amit hadke
• Reporter: Jason Altekruse
• Created: 09/Mar/16 04:03
• Updated: 09/Mar/16 04:03

Description

I was running unit tests and saw a failure that seemed unrelated to the changes I was making. The test runs fine in isolation both from IntelliJ and the maven command line (with -Dtest=TestMergeJoinWithSchemaChanges in the java-exec module).

Not sure what about the particular test run made it change the order the files were read, but we cannot rely on any particular system to read the files in a given order. The test should be updated to remove this assumption.

This is the error I received on one run of the full unit tests:

testMissingAndNewColumns(TestMergeJoinWithSchemaChanges.java:265)
Caused by: org.apache.drill.common.exceptions.UserRemoteException: UNSUPPORTED_OPERATION ERROR: Sort doesn't currently support    sorts with changing schemas

Fragment 0:0

[Error Id: bf84bffb-f643-493b-9ed5-720eb18d55f2 on 10.1.10.225:31010]

  (org.apache.drill.exec.exception.SchemaChangeException) Sort currently only supports a single schema.
    org.apache.drill.exec.physical.impl.sort.SortRecordBatchBuilder.build():146
    org.apache.drill.exec.physical.impl.xsort.ExternalSortBatch.innerNext():442
    org.apache.drill.exec.record.AbstractRecordBatch.next():162
    org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():215
    org.apache.drill.exec.record.AbstractRecordBatch.next():119
    org.apache.drill.exec.record.AbstractRecordBatch.next():109
    org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext():51
    org.apache.drill.exec.physical.impl.svremover.RemovingRecordBatch.innerNext():94
    org.apache.drill.exec.record.AbstractRecordBatch.next():162
    org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():215
    org.apache.drill.exec.record.AbstractRecordBatch.next():119
    org.apache.drill.exec.record.RecordIterator.nextBatch():97
    org.apache.drill.exec.record.RecordIterator.next():183
    org.apache.drill.exec.record.RecordIterator.prepare():167
    org.apache.drill.exec.physical.impl.join.JoinStatus.prepare():87
    org.apache.drill.exec.physical.impl.join.MergeJoinBatch.innerNext():162
    org.apache.drill.exec.record.AbstractRecordBatch.next():162
    org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():215
    org.apache.drill.exec.record.AbstractRecordBatch.next():119
    org.apache.drill.exec.record.AbstractRecordBatch.next():109
    org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext():51
    org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():129
    org.apache.drill.exec.record.AbstractRecordBatch.next():162