Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-5387

Excessive logging to INFO and ERROR files when reading S3 data

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: Impala 2.9.0
    • Fix Version/s: None
    • Component/s: Backend
    • Labels:
      None
    • Epic Color:
      ghx-label-1

      Description

      While querying data in S3 the impalad.ERROR file is flooded with the messages like the one below, are those expected?

      UnsupportedOperationException: Byte-buffer read unsupported by input streamjava.lang.UnsupportedOperationException: Byte-buffer read unsupported by input stream
      	at org.apache.hadoop.fs.FSDataInputStream.read(FSDataInputStream.java:150)
      readDirect: FSDataInputStream#read error:
      UnsupportedOperationException: Byte-buffer read unsupported by input streamjava.lang.UnsupportedOperationException: Byte-buffer read unsupported by input stream
      	at org.apache.hadoop.fs.FSDataInputStream.read(FSDataInputStream.java:150)
      

      Same thing for impalad.INFO

      W0529 13:48:46.398718  9771 S3AbortableInputStream.java:163] Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use.
      W0529 13:48:46.420027  9767 S3AbortableInputStream.java:163] Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use.
      W0529 13:48:46.429368  9758 S3AbortableInputStream.java:163] Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use.
      

        Attachments

          Activity

            People

            • Assignee:
              pranay_singh Pranay Singh
              Reporter:
              mmokhtar Mostafa Mokhtar
            • Votes:
              1 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: