Uploaded image for project: 'Infrastructure'
  1. Infrastructure
  2. INFRA-19730

Increase entropy to improve cryptographic randomness on Linux VMs

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Invalid
    • Fix Version/s: None
    • Component/s: Docker, Jenkins, test, VM
    • Labels:
      None
    • Project:
      Hadoop

      Description

      I was investigating a JUnit test (MAPREDUCE-7079 :TestMRIntermediateDataEncryption is failing in precommit builds) that was consistently hanging on Linux VMs and failing Mapreduce pre-builds.
      I found that the test hangs slows or hangs indefinitely whenever Java reads the random file.

      I explored two different ways to get that test case to work properly on my local Linux VM running rel7:
      # To install "haveged" and "rng-tools" on the virtual machine running Rel7. Then, start rngd service {{sudo service rngd start}} . This will fix the problem for all the components on the image including java, native and any other component.
      # Change java configuration to load urandom
      {code:bash}
      sudo vim $JAVA_HOME/jre/lib/security/java.security
      ## Change the line “securerandom.source=file:/dev/random” to read: securerandom.source=file:/dev/./urandom
      {code}


      Is it possible to apply any of the above solutions (preferably first one) to the docker image that runs the Hadoop precommit builds?

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              ahussein Ahmed Hussein
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: