[AURORA-627] use latest psutil library for thermos in pants

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.6.0
• Component/s: Thermos
• Sprint: Aurora Q4 Sprint 1, Twitter Aurora Q4 Sprint 2
• Assignee: Joe Smith
• Reporter: Bhuvaneswaran A
• Created: 31/Jul/14 18:54
• Updated: 17/Apr/15 22:16
• Resolved: 24/Oct/14 22:07

Description

Unable to execute thermos, due to following error. It's due to this bug in psutil. issue 442. We were using v1.1.2. We should use v1.1.3 or newer.

Facing same issue with gc_executor and thermos_runner.

./dist/thermos_executor.pex                                                                   [latest] 18:30:53
Traceback (most recent call last):
  File "/Volumes/apple/quark/incubator-aurora/dist/thermos_executor.pex/.bootstrap/_twitter_common_python/pex.py", line 225, in execute
    self.execute_interpreter()
  File "/usr/lib64/python2.6/contextlib.py", line 34, in __exit__
    self.gen.throw(type, value, traceback)
  File "/Volumes/apple/quark/incubator-aurora/dist/thermos_executor.pex/.bootstrap/_twitter_common_python/pex.py", line 175, in patch_pkg_resources
    yield
  File "/Volumes/apple/quark/incubator-aurora/dist/thermos_executor.pex/.bootstrap/_twitter_common_python/pex.py", line 223, in execute
    self.execute_entry(entry_point, args)
  File "/Volumes/apple/quark/incubator-aurora/dist/thermos_executor.pex/.bootstrap/_twitter_common_python/pex.py", line 271, in execute_entry
    runner(entry_point)
  File "/Volumes/apple/quark/incubator-aurora/dist/thermos_executor.pex/.bootstrap/_twitter_common_python/pex.py", line 293, in execute_pkg_resources
    runner = entry.load(require=False)  # trust that the environment is sane
  File "/Volumes/apple/quark/incubator-aurora/dist/thermos_executor.pex/.bootstrap/pkg_resources.py", line 2048, in load
    entry = __import__(self.module_name, globals(),globals(), ['__name__'])
  File "/Volumes/apple/quark/incubator-aurora/dist/thermos_executor.pex/apache/aurora/executor/bin/thermos_executor_main.py", line 31, in <module>
  File "/Volumes/apple/quark/incubator-aurora/dist/thermos_executor.pex/apache/aurora/executor/thermos_task_runner.py", line 31, in <module>
  File "/Volumes/apple/quark/incubator-aurora/dist/thermos_executor.pex/apache/thermos/core/runner.py", line 70, in <module>
  File "/Volumes/apple/quark/incubator-aurora/dist/thermos_executor.pex/apache/thermos/core/helper.py", line 21, in <module>
  File "/home/bhuvan/.pex/install/psutil-1.1.2-cp26-none-linux_x86_64.whl.a1805e756711e817e309c89cedf92d2a070c3ee7/psutil-1.1.2-cp26-none-linux_x86_64.whl/psutil/__init__.py", line 89, in <module>
    import psutil._pslinux as _psplatform
  File "/home/bhuvan/.pex/install/psutil-1.1.2-cp26-none-linux_x86_64.whl.a1805e756711e817e309c89cedf92d2a070c3ee7/psutil-1.1.2-cp26-none-linux_x86_64.whl/psutil/_pslinux.py", line 21, in <module>
    import _psutil_linux
ImportError: /home/bhuvan/.pex/install/psutil-1.1.2-cp26-none-linux_x86_64.whl.a1805e756711e817e309c89cedf92d2a070c3ee7/psutil-1.1.2-cp26-none-linux_x86_64.whl/_psutil_linux.so: undefined symbol: prlimit

Issue Links

• blocks: AURORA-711 0.6.0 Release Candidate
• is duplicated by: AURORA-791 upgrade to psutil 2.1.3