[YARN-4330] MiniYARNCluster is showing multiple Failed to instantiate default resource calculator warning messages.

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 2.8.0
• Fix Version/s: 2.9.0, 3.0.0-alpha2
• Component/s: test, yarn
• Labels: oct16-hard

Environment

OSX, JUnit

• Hadoop Flags: Reviewed
• Assignee: Varun Saxena
• Reporter: Steve Loughran
• Created: 04/Nov/15 17:57
• Updated: 29/Nov/22 12:26
• Resolved: 18/Dec/16 16:14

Description

Whenever I try to start a MiniYARNCluster on Branch-2 (commit #0b61cca), I see multiple stack traces warning me that a resource calculator plugin could not be created

(ResourceCalculatorPlugin.java:getResourceCalculatorPlugin(184)) - java.lang.UnsupportedOperationException: Could not determine OS: Failed to instantiate default resource calculator.
java.lang.UnsupportedOperationException: Could not determine OS

This is a minicluster. It doesn't need resource calculation. It certainly doesn't need test logs being cluttered with even more stack traces which will only generate false alarms about tests failing.

There needs to be a way to turn this off, and the minicluster should have it that way by default.

Being ruthless and marking as a blocker, because its a fairly major regression for anyone testing with the minicluster.

Issue Links

• is broken by: YARN-3534 Collect memory/cpu usage on the node
• is duplicated by: YARN-4944 Handle lack of ResourceCalculatorPlugin gracefully