Uploaded image for project: 'Crunch'
  1. Crunch
  2. CRUNCH-668

From.avroFile do not support globbing patterns (GenericData based overloads)

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.15.0
    • Fix Version/s: 1.0.0
    • Component/s: Core
    • Labels:
      None
    • Flags:
      Patch

      Description

      GenericData based overloads of From.avroFile throws a RuntimeException when a globbing pattern is provided. I see no reason to not support globbing patterns here as it works fine with textFile and SpecificData based overloads.

      The issue is that the code extracting Avro schema from the first file use listStatus rather than globStatus.

        Attachments

          Activity

            People

            • Assignee:
              jwills Josh Wills
              Reporter:
              clement@unportant.info Clément MATHIEU
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: