Uploaded image for project: 'Crunch (Retired)'
  1. Crunch (Retired)
  2. CRUNCH-243

Support easily extensibility for custom reading of Avro Datum

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 0.7.0
    • Core
    • None

    Description

      Through some discussions on the Avro mailing lists[1], there are use cases that need the ability to inject a custom SpecificDatumReader. Crunch does not make it easy to inject the custom reader as it is currently implemented causing consumers to copy three classes (e.g. AvroFileSource, AvroFileSourceTarget, AvroFileReaderFactory) to gain this functionality. With a few minor changes to AvroFileSource and AvroFileReaderFactory, consumers can inject their custom reader fairly easily.

      [1] - http://search-hadoop.com/m/98HA2DitiF/avro+enum+passivity&subj=Avro+enum+and+passivity+

      Attachments

        1. CRUNCH-243_v2.patch
          5 kB
          Micah Whitacre
        2. CRUNCH-243.patch
          2 kB
          Micah Whitacre

        Activity

          People

            mkwhitacre Micah Whitacre
            mkwhitacre Micah Whitacre
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: