Crunch
  1. Crunch
  2. CRUNCH-293

Injection of reader into AvroRecordReader

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.7.0, 0.8.0
    • Fix Version/s: 0.9.0, 0.8.2
    • Component/s: Core
    • Labels:
      None

      Description

      With CRUNCH-243, I wanted to support injecting custom readers to handle the cases like passivity between Avro Schema. The changes made however were not complete as we also need to be able to inject a reader into the AvroRecordReader which constructs its own SpecificDatumReader.

      We could create a SpecificDataFactory which emulates the ReflectDataFactory. Or simplify to a single DataFactory which will create either Reflect/Specific/Generic. Thoughts?

      1. CRUNCH-293.patch
        9 kB
        Micah Whitacre
      2. CRUNCH-293_v2.patch
        27 kB
        Micah Whitacre
      3. 0001-CRUNCH-293-Add-AvroMode-to-inject-avro-readers.patch
        27 kB
        Ryan Blue

        Activity

          People

          • Assignee:
            Micah Whitacre
            Reporter:
            Micah Whitacre
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development