Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-13558

Work around bad Ubuntu 20.04 python 2.7 update

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Blocker
    • Resolution: Unresolved
    • Impala 4.5.0
    • None
    • Infrastructure
    • None
    • ghx-label-5

    Description

      Ubuntu 20.04 introduced a bug in their Python 2.7's tarfile functionality with 2.7.18-1~20.04.5 (see https://bugs.launchpad.net/ubuntu/+source/python2.7/+bug/2089071 ). This breaks Impala builds with a message like this:

      Traceback (most recent call last):
        File "bin/../infra/python/bootstrap_virtualenv.py", line 521, in <module>
          setup_virtualenv_if_not_exists(venv_dir, options.python3)
        File "bin/../infra/python/bootstrap_virtualenv.py", line 482, in setup_virtualenv_if_not_exists
          create_virtualenv(venv_dir, is_py3)
        File "bin/../infra/python/bootstrap_virtualenv.py", line 138, in create_virtualenv
          file = tarfile.open(virtualenv_tarball, "r:gz")
        File "/usr/lib/python2.7/tarfile.py", line 1708, in open
          return func(name, filemode, fileobj, **kwargs)
        File "/usr/lib/python2.7/tarfile.py", line 1762, in gzopen
          t = cls.taropen(name, mode, fileobj, **kwargs)
        File "/usr/lib/python2.7/tarfile.py", line 1738, in taropen
          return cls(name, mode, fileobj, **kwargs)
        File "/usr/lib/python2.7/tarfile.py", line 1602, in __init__
          self.firstmember = self.next()
        File "/usr/lib/python2.7/tarfile.py", line 2385, in next
          raise ReadError(str(e))
      tarfile.ReadError: invalid header

      We need to work around this issue to unblock precommit. On the Ubuntu bug listed above, there is a workaround tarfile.py that could be copied into place.

      Attachments

        Activity

          People

            Unassigned Unassigned
            joemcdonnell Joe McDonnell
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: