Uploaded image for project: 'Tajo (Retired)'
  1. Tajo (Retired)
  2. TAJO-1181

Avro schema URL should support various protocols.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.8.1
    • 0.10.0
    • Storage

    Description

      See the following source code:

      org.apache.tajo.storage.avro.AvroUtil.java
      String schemaURL = meta.getOption(StorageConstants.AVRO_SCHEMA_URL);
          Path schemaPath = new Path(schemaURL);
          FileSystem fs = schemaPath.getFileSystem(conf);
          FSDataInputStream inputStream = fs.open(schemaPath);
      

      Currently, Avro schema URL only support HDFS and S3. But, it does not support HTTP and others. HTTP-based schema is very usual in this field. We need to improve it to support HTTP.

      Attachments

        Activity

          People

            jhkim Jinho Kim
            hyunsik Hyunsik Choi
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: