Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1370

TestCombineFileInputFormat.testSplitPlacement fails in trunk

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 0.22.0
    • None
    • test
    • None

    Description

      http://hudson.zones.apache.org/hudson/view/Hadoop/job/Hadoop-Mapreduce-trunk/202/

      org.apache.hadoop.mapreduce.lib.input.TestCombineFileInputFormat.testSplitPlacement (from TestCombineFileInputFormat)

      Failing for the past 1 build (Since #202 )
      Took 18 sec.
      add description

      Error Message
      port out of range:-1
      Stacktrace
      java.lang.IllegalArgumentException: port out of range:-1
      at java.net.InetSocketAddress.<init>(InetSocketAddress.java:118)
      at org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer(NameNode.java:377)
      at org.apache.hadoop.hdfs.server.namenode.NameNode.activate(NameNode.java:317)
      at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:308)
      at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:416)
      at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:410)
      at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1230)
      at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:290)
      at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:153)
      at org.apache.hadoop.mapreduce.lib.input.TestCombineFileInputFormat.testSplitPlacement(TestCombineFileInputFormat.java:95)

      raw output format:

      [junit] Running org.apache.hadoop.mapreduce.lib.input.TestCombineFileInputFormat
      [junit] 2010-01-11 15:05:29,813 INFO namenode.FSNamesystem (BlockManager.java:setConfigurationParameters(166)) - defaultReplication = 1
      [junit] 2010-01-11 15:05:29,816 INFO namenode.FSNamesystem (BlockManager.java:setConfigurationParameters(167)) - maxReplication = 512
      [junit] 2010-01-11 15:05:29,817 INFO namenode.FSNamesystem (BlockManager.java:setConfigurationParameters(168)) - minReplication = 1
      [junit] 2010-01-11 15:05:29,817 INFO namenode.FSNamesystem (BlockManager.java:setConfigurationParameters(169)) - maxReplicationStreams = 2
      [junit] 2010-01-11 15:05:29,818 INFO namenode.FSNamesystem (BlockManager.java:setConfigurationParameters(170)) - shouldCheckForEnoughRacks = false
      [junit] 2010-01-11 15:05:29,826 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(389)) - fsOwner=hudson,hudson
      [junit] 2010-01-11 15:05:29,827 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(395)) - supergroup=supergroup
      [junit] 2010-01-11 15:05:29,827 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(396)) - isPermissionEnabled=true
      [junit] 2010-01-11 15:05:29,831 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(434)) - isAccessTokenEnabled=false accessKeyUpdateInterval=0 min(s), accessTokenLifetime=0 min(s)
      [junit] 2010-01-11 15:05:29,864 INFO common.Storage (FSImage.java:saveFSImage(1218)) - Image file of size 96 saved in 0 seconds.
      [junit] 2010-01-11 15:05:29,890 INFO common.Storage (FSImage.java:format(1289)) - Storage directory /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/build/test/data/dfs/name1 has been successfully formatted.
      [junit] 2010-01-11 15:05:29,891 INFO common.Storage (FSImage.java:saveFSImage(1218)) - Image file of size 96 saved in 0 seconds.
      [junit] 2010-01-11 15:05:29,905 INFO common.Storage (FSImage.java:format(1289)) - Storage directory /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/build/test/data/dfs/name2 has been successfully formatted.
      [junit] 2010-01-11 15:05:29,933 INFO metrics.RpcMetrics (RpcMetrics.java:<init>(58)) - Initializing RPC Metrics with hostName=NameNode, port=50403
      [junit] 2010-01-11 15:05:29,983 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Initializing JVM Metrics with processName=NameNode, sessionId=null
      [junit] 2010-01-11 15:05:29,984 INFO metrics.NameNodeMetrics (NameNodeMetrics.java:<init>(103)) - Initializing NameNodeMeterics using context object:org.apache.hadoop.metrics.spi.NullContext
      [junit] 2010-01-11 15:05:29,985 INFO namenode.FSNamesystem (BlockManager.java:setConfigurationParameters(166)) - defaultReplication = 1
      [junit] 2010-01-11 15:05:29,986 INFO namenode.FSNamesystem (BlockManager.java:setConfigurationParameters(167)) - maxReplication = 512
      [junit] 2010-01-11 15:05:29,986 INFO namenode.FSNamesystem (BlockManager.java:setConfigurationParameters(168)) - minReplication = 1
      [junit] 2010-01-11 15:05:29,987 INFO namenode.FSNamesystem (BlockManager.java:setConfigurationParameters(169)) - maxReplicationStreams = 2
      [junit] 2010-01-11 15:05:29,988 INFO namenode.FSNamesystem (BlockManager.java:setConfigurationParameters(170)) - shouldCheckForEnoughRacks = false
      [junit] 2010-01-11 15:05:29,994 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(389)) - fsOwner=hudson,hudson
      [junit] 2010-01-11 15:05:29,994 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(395)) - supergroup=supergroup
      [junit] 2010-01-11 15:05:29,995 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(396)) - isPermissionEnabled=true
      [junit] 2010-01-11 15:05:29,996 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(434)) - isAccessTokenEnabled=false accessKeyUpdateInterval=0 min(s), accessTokenLifetime=0 min(s)
      [junit] 2010-01-11 15:05:29,999 INFO metrics.FSNamesystemMetrics (FSNamesystemMetrics.java:<init>(78)) - Initializing FSNamesystemMetrics using context object:org.apache.hadoop.metrics.spi.NullContext
      [junit] 2010-01-11 15:05:30,001 INFO namenode.FSNamesystem (FSNamesystem.java:registerMBean(3986)) - Registered FSNamesystemStatusMBean
      [junit] 2010-01-11 15:05:30,007 INFO common.Storage (FSImage.java:loadFSImage(1050)) - Number of files = 1
      [junit] 2010-01-11 15:05:30,008 INFO common.Storage (FSImage.java:loadFilesUnderConstruction(1393)) - Number of files under construction = 0
      [junit] 2010-01-11 15:05:30,009 INFO common.Storage (FSImage.java:loadFSImage(987)) - Image file of size 96 loaded in 0 seconds.
      [junit] 2010-01-11 15:05:30,010 INFO common.Storage (FSEditLog.java:loadFSEdits(374)) - Edits file /grid/0/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/build/test/data/dfs/name1/current/edits of size 4 edits # 0 loaded in 0 seconds.
      [junit] 2010-01-11 15:05:30,013 INFO namenode.FSNamesystem (FSNamesystem.java:initialize(265)) - Finished loading FSImage in 28 msecs
      [junit] 2010-01-11 15:05:30,016 INFO util.HostsFileReader (HostsFileReader.java:refresh(81)) - Refreshing hosts (include/exclude) list
      [junit] 2010-01-11 15:05:30,017 INFO namenode.FSNamesystem (FSNamesystem.java:getCompleteBlocksTotal(3744)) - Number of blocks under construction: 0
      [junit] 2010-01-11 15:05:30,017 INFO namenode.FSNamesystem (BlockManager.java:processMisReplicatedBlocks(1233)) - Total number of blocks = 0
      [junit] 2010-01-11 15:05:30,018 INFO namenode.FSNamesystem (BlockManager.java:processMisReplicatedBlocks(1234)) - Number of invalid blocks = 0
      [junit] 2010-01-11 15:05:30,018 INFO namenode.FSNamesystem (BlockManager.java:processMisReplicatedBlocks(1235)) - Number of under-replicated blocks = 0
      [junit] 2010-01-11 15:05:30,019 INFO namenode.FSNamesystem (BlockManager.java:processMisReplicatedBlocks(1236)) - Number of over-replicated blocks = 0
      [junit] 2010-01-11 15:05:30,019 INFO hdfs.StateChange (FSNamesystem.java:leave(3438)) - STATE* Leaving safe mode after 0 secs.
      [junit] 2010-01-11 15:05:30,020 INFO hdfs.StateChange (FSNamesystem.java:leave(3447)) - STATE* Network topology has 0 racks and 0 datanodes
      [junit] 2010-01-11 15:05:30,021 INFO hdfs.StateChange (FSNamesystem.java:leave(3450)) - STATE* UnderReplicatedBlocks has 0 blocks
      [junit] SLF4J: Class path contains multiple SLF4J bindings.
      [junit] SLF4J: Found binding in [jar:file:/homes/hudson/.ivy2/cache/org.slf4j/slf4j-simple/jars/slf4j-simple-1.5.8.jar!/org/slf4j/impl/StaticLoggerBinder.class]
      [junit] SLF4J: Found binding in [jar:file:/homes/hudson/.ivy2/cache/org.slf4j/slf4j-log4j12/jars/slf4j-log4j12-1.4.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
      [junit] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
      [junit] 1 [main] INFO org.mortbay.log - Logging to org.slf4j.impl.SimpleLogger(org.mortbay.log) via org.mortbay.log.Slf4jLog
      [junit] 2010-01-11 15:05:30,190 INFO http.HttpServer (HttpServer.java:addGlobalFilter(302)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
      [junit] 2010-01-11 15:05:30,199 INFO http.HttpServer (HttpServer.java:start(442)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
      [junit] 2010-01-11 15:05:30,200 INFO http.HttpServer (HttpServer.java:start(447)) - listener.getLocalPort() returned 57237 webServer.getConnectors()[0].getLocalPort() returned 57237
      [junit] 2010-01-11 15:05:30,200 INFO http.HttpServer (HttpServer.java:start(480)) - Jetty bound to port 57237
      [junit] 77 [main] INFO org.mortbay.log - jetty-6.1.14
      [junit] 17760 [main] INFO org.mortbay.log - Started SelectChannelConnector@localhost:57237
      [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 18.611 sec
      [junit] Test org.apache.hadoop.mapreduce.lib.input.TestCombineFileInputFormat FAILED

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-6528 Jetty returns -1 resulting in Hadoop masters / slaves to fail during startup.

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-1179 org.apache.hadoop.streaming.TestSymLink.testSymLink is failing

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              iyappans Iyappan Srinivasan
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: