Uploaded image for project: 'Crunch (Retired)'
  1. Crunch (Retired)
  2. CRUNCH-293

Injection of reader into AvroRecordReader

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.7.0, 0.8.0
    • 0.9.0, 0.8.2
    • Core
    • None

    Description

      With CRUNCH-243, I wanted to support injecting custom readers to handle the cases like passivity between Avro Schema. The changes made however were not complete as we also need to be able to inject a reader into the AvroRecordReader which constructs its own SpecificDatumReader.

      We could create a SpecificDataFactory which emulates the ReflectDataFactory. Or simplify to a single DataFactory which will create either Reflect/Specific/Generic. Thoughts?

      Attachments

        1. CRUNCH-293.patch
          9 kB
          Micah Whitacre
        2. CRUNCH-293_v2.patch
          27 kB
          Micah Whitacre
        3. 0001-CRUNCH-293-Add-AvroMode-to-inject-avro-readers.patch
          27 kB
          Ryan Blue

        Activity

          People

            mkwhitacre Micah Whitacre
            mkwhitacre Micah Whitacre
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: