Uploaded image for project: 'Avro'
  1. Avro
  2. AVRO-867

Allow tools to read files via hadoop FileSystem class

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.7.5
    • Fix Version/s: 1.7.5
    • Component/s: java
    • Labels:
      None
    • Release Note:
      avro-tools can now access Hadoop supported filesystem when started via hadoop jar.

      Description

      It would be great if I could use the various tools to read/parse files that are in HDFS, S3, etc via the FileSystem api. We could retain backwards compatibility by assuming that unqualified urls are "file://" but allow reading of files from fully qualified urls such as hdfs://. The required apis are already part of the avro-tools uber jar to support the TetherTool.

        Attachments

        1. AVRO-867.patch
          15 kB
          Doug Cutting
        2. addedHadoopFileSupport.diff
          18 kB
          Vincenz Priesnitz

          Activity

            People

            • Assignee:
              vince83 Vincenz Priesnitz
              Reporter:
              joecrobak Joe Crobak
            • Votes:
              1 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: