Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-2730

TFileStorage getStatistics incorrectly throws an exception instead of returning null

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.11, 0.10.1
    • None
    • None
    • Reviewed

    Description

      TFileStorage.java throws an exception in getStatistics:

      @Override
      public ResourceStatistics getStatistics(String location, Job job) throws IOException {
        throw new UnsupportedOperationException();
      }
      

      However the interface for LoadMetadata.java states null should be returned if statistics are not available:

      /**
       * Get statistics about the data to be loaded.  If no statistics are
       * available, then null should be returned. If the implementing class also extends
       * {@link LoadFunc}, then {@link LoadFunc#setLocation(String, org.apache.hadoop.mapreduce.Job)}
       * is guaranteed to be called before this method.
       * @param location Location as returned by 
       * {@link LoadFunc#relativeToAbsolutePath(String, org.apache.hadoop.fs.Path)}
       * @param job The {@link Job} object - this should be used only to obtain 
       * cluster properties through {@link Job#getConfiguration()} and not to set/query
       * any runtime job information.  
       * @return statistics about the data to be loaded.  If no statistics are
       * available, then null should be returned.
       * @throws IOException if an exception occurs while retrieving statistics
       */
      ResourceStatistics getStatistics(String location, Job job) 
      throws IOException;
      

      Attachments

        1. PIG-2730.1.patch
          0.5 kB
          Travis Crawford

        Activity

          People

            traviscrawford Travis Crawford
            traviscrawford Travis Crawford
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: