[YETUS-419] releasedocmaker should retry when the connection fails

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.3.0
• Fix Version/s: 0.4.0
• Component/s: Release Doc Maker
• Assignee: Akira Ajisaka
• Reporter: Akira Ajisaka
• Created: 10/Jun/16 07:36
• Updated: 16/Jun/16 05:08
• Resolved: 13/Jun/16 08:03

Description

I sometimes see the following error when execute create-release in Apache Hadoop.

Traceback (most recent call last):
  File "/Users/aajisaka/git/hadoop/patchprocess/yetus-0.3.0/bin/../lib/release-doc-maker/releasedocmaker.py", line 928, in <module>
    main()
  File "/Users/aajisaka/git/hadoop/patchprocess/yetus-0.3.0/bin/../lib/release-doc-maker/releasedocmaker.py", line 777, in main
    jlist = sorted(JiraIter(vstr, projects))
  File "/Users/aajisaka/git/hadoop/patchprocess/yetus-0.3.0/bin/../lib/release-doc-maker/releasedocmaker.py", line 408, in __init__
    self.jiras = JiraIter.collect_jiras(ver, projects)
  File "/Users/aajisaka/git/hadoop/patchprocess/yetus-0.3.0/bin/../lib/release-doc-maker/releasedocmaker.py", line 387, in collect_jiras
    data = JiraIter.query_jira(ver, projects, pos)
  File "/Users/aajisaka/git/hadoop/patchprocess/yetus-0.3.0/bin/../lib/release-doc-maker/releasedocmaker.py", line 376, in query_jira
    data = json.loads(resp.read())
  File "/usr/local/Cellar/python/2.7.10/Frameworks/Python.framework/Versions/2.7/lib/python2.7/socket.py", line 355, in read
    data = self._sock.recv(rbufsize)
  File "/usr/local/Cellar/python/2.7.10/Frameworks/Python.framework/Versions/2.7/lib/python2.7/httplib.py", line 588, in read
    return self._read_chunked(amt)
  File "/usr/local/Cellar/python/2.7.10/Frameworks/Python.framework/Versions/2.7/lib/python2.7/httplib.py", line 652, in _read_chunked
    value.append(self._safe_read(amt))
  File "/usr/local/Cellar/python/2.7.10/Frameworks/Python.framework/Versions/2.7/lib/python2.7/httplib.py", line 705, in _safe_read
    raise IncompleteRead(''.join(s), amt)
httplib.IncompleteRead: IncompleteRead(777 bytes read, 7415 more expected)

I'm thinking we should retry the query when IncompleteRead is raised.