Uploaded image for project: 'Crunch'
  1. Crunch
  2. CRUNCH-293

Injection of reader into AvroRecordReader

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.7.0, 0.8.0
    • Fix Version/s: 0.9.0, 0.8.2
    • Component/s: Core
    • Labels:
      None

      Description

      With CRUNCH-243, I wanted to support injecting custom readers to handle the cases like passivity between Avro Schema. The changes made however were not complete as we also need to be able to inject a reader into the AvroRecordReader which constructs its own SpecificDatumReader.

      We could create a SpecificDataFactory which emulates the ReflectDataFactory. Or simplify to a single DataFactory which will create either Reflect/Specific/Generic. Thoughts?

        Attachments

        1. 0001-CRUNCH-293-Add-AvroMode-to-inject-avro-readers.patch
          27 kB
          Ryan Blue
        2. CRUNCH-293_v2.patch
          27 kB
          Micah Whitacre
        3. CRUNCH-293.patch
          9 kB
          Micah Whitacre

          Activity

            People

            • Assignee:
              mkwhitacre Micah Whitacre
              Reporter:
              mkwhitacre Micah Whitacre
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: