Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-709

streaming job with Control characters in the command causes runtime exception in the job tracker

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.9.0
    • Component/s: None
    • Labels:
      None

      Description

      I run a streaming job with a Ctrl-A character in the command line option as follows:

      $HSTREAMING -mapper "/bin/sort -t'^A'" -input "input/*" -output output

      It causes a exeception as listed below. If i run the same command without the Ctrl-A character the command completes successfully.

      Exception in thread "main" org.apache.hadoop.ipc.RemoteException: java.io.IOException: java.lang.RuntimeException: org.xml.sax.SAXParseException: Character reference "&#1" is an invalid XML character.
      at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:551)
      at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:472)
      at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:453)
      at org.apache.hadoop.conf.Configuration.get(Configuration.java:201)
      at org.apache.hadoop.mapred.JobConf.getUser(JobConf.java:175)
      at org.apache.hadoop.mapred.JobInProgress.<init>(JobInProgress.java:88)
      at org.apache.hadoop.mapred.JobTracker.submitJob(JobTracker.java:1016)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      at java.lang.reflect.Method.invoke(Method.java:585)
      at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:337)
      at org.apache.hadoop.ipc.Server$Handler.run(Server.java:514)

      at org.apache.hadoop.ipc.Client$Connection.run(Client.java:248)

        Attachments

          Activity

            People

            • Assignee:
              dhruba dhruba borthakur
              Reporter:
              dhruba dhruba borthakur
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: