Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-8056

Configuration doesn't pass empty string values to tasks

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 0.20.2, 1.0.0
    • None
    • conf
    • None

    Description

      If I assign an empty string as a value to a property in a JobConf 'job' while I'm preparing it to run, the Configuration does store that value. I can retrieve it later while in the same process and the value is maintained.

      However, if then call JobClient.runJob(job), the Configuration that is received by the Map and Reduce tasks doesn't contain the property, and calling JobConf.get with that property name returns null (instead of an empty string). Futher, if I inspect the job's configuration via Hadoop's web interface, the property isn't present.

      It seems as if whatever serialization mechanism that is used to transmit the Configuration from the job client to the tasks discards properties with "" value.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              ilveroluca Luca Pireddu
              Votes:
              1 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: