Uploaded image for project: 'Apache Avro'
  1. Apache Avro
  2. AVRO-867

Allow tools to read files via hadoop FileSystem class

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.7.5
    • 1.7.5
    • java
    • None
    • avro-tools can now access Hadoop supported filesystem when started via hadoop jar.

    Description

      It would be great if I could use the various tools to read/parse files that are in HDFS, S3, etc via the FileSystem api. We could retain backwards compatibility by assuming that unqualified urls are "file://" but allow reading of files from fully qualified urls such as hdfs://. The required apis are already part of the avro-tools uber jar to support the TetherTool.

      Attachments

        1. addedHadoopFileSupport.diff
          18 kB
          Vincenz Priesnitz
        2. AVRO-867.patch
          15 kB
          Doug Cutting

        Activity

          People

            vince83 Vincenz Priesnitz
            joecrobak Joe Crobak
            Votes:
            1 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: