Uploaded image for project: 'Crunch'
  1. Crunch
  2. CRUNCH-553

From.formattedFile may cause records to be dropped.

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.11.0, 0.12.0
    • Fix Version/s: 0.13.0
    • Component/s: IO
    • Labels:
      None

      Description

      From the mailing list, a user reported a bug in which they were using multiple instances of From.formattedFile TableSources and were seeing records getting dropped at random from different runs of their jobs. I created a simple test that replicated the behavior and found the source of the problem in the planner: a confusion between a BaseInputTable and the BaseInputCollection objects that does most of the work to actually configure the input table data that resulted from BaseInputTable's equals() method not checking to see if an object was of its same class before performing the comparison on the underlying BaseInputCollection instance.

        Attachments

          Activity

            People

            • Assignee:
              jwills Josh Wills
              Reporter:
              jwills Josh Wills
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: