Uploaded image for project: 'Avro'
  1. Avro
  2. AVRO-692

permit 1.2-format files to be read

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.5.0
    • Component/s: java
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      It might be useful to have the ability to read 1.2 format data files.

      1. AVRO-692.patch
        12 kB
        Doug Cutting
      2. AVRO-692.patch
        8 kB
        Doug Cutting
      3. test.avro12
        3 kB
        Doug Cutting

        Activity

        Hide
        cutting Doug Cutting added a comment -

        I committed this.

        Show
        cutting Doug Cutting added a comment - I committed this.
        Hide
        scott_carey Scott Carey added a comment -

        +1 I did not review DataFileReader12.java in detail. I looked at the rest of the patch closely and it looks good. Related tests pass.

        Show
        scott_carey Scott Carey added a comment - +1 I did not review DataFileReader12.java in detail. I looked at the rest of the patch closely and it looks good. Related tests pass.
        Hide
        cutting Doug Cutting added a comment -

        Unless there are objections, I'll commit this soon.

        Show
        cutting Doug Cutting added a comment - Unless there are objections, I'll commit this soon.
        Hide
        cutting Doug Cutting added a comment -

        A 1.2 format file, for tests.

        Show
        cutting Doug Cutting added a comment - A 1.2 format file, for tests.
        Hide
        cutting Doug Cutting added a comment -

        Here's a new version of the patch that adds a static factory method, DataFileReader.openReader(), which looks at the file's version number and uses either the current implementation or the 1.2 implementation. The "tojson" tool and the MapReduce task are also updated to use this factory.

        Show
        cutting Doug Cutting added a comment - Here's a new version of the patch that adds a static factory method, DataFileReader.openReader(), which looks at the file's version number and uses either the current implementation or the 1.2 implementation. The "tojson" tool and the MapReduce task are also updated to use this factory.
        Hide
        cutting Doug Cutting added a comment -

        Here's the 1.2 file reader updated slightly so that it compiles in the current trunk.

        This still needs tests. Perhaps we should add a small sample data file into subversion that we can read in a test?

        Show
        cutting Doug Cutting added a comment - Here's the 1.2 file reader updated slightly so that it compiles in the current trunk. This still needs tests. Perhaps we should add a small sample data file into subversion that we can read in a test?

          People

          • Assignee:
            cutting Doug Cutting
            Reporter:
            cutting Doug Cutting
          • Votes:
            1 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development