Uploaded image for project: 'Crunch (Retired)'
  1. Crunch (Retired)
  2. CRUNCH-553

From.formattedFile may cause records to be dropped.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.11.0, 0.12.0
    • 0.13.0
    • IO
    • None

    Description

      From the mailing list, a user reported a bug in which they were using multiple instances of From.formattedFile TableSources and were seeing records getting dropped at random from different runs of their jobs. I created a simple test that replicated the behavior and found the source of the problem in the planner: a confusion between a BaseInputTable and the BaseInputCollection objects that does most of the work to actually configure the input table data that resulted from BaseInputTable's equals() method not checking to see if an object was of its same class before performing the comparison on the underlying BaseInputCollection instance.

      Attachments

        1. CRUNCH-553.patch
          4 kB
          Josh Wills

        Activity

          People

            jwills Josh Wills
            jwills Josh Wills
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: