[HCATALOG-7] Ivy fetch of CDH Hadoop versions does not work properly

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.1
• Assignee: Alan Gates
• Reporter: Alan Gates
• Created: 20/Apr/11 17:17
• Updated: 09/Jan/12 21:06
• Resolved: 20/Apr/11 20:58

Description

When checking out hcatalog for the first time on a system and doing a load, the build fails with the error:

[ivy:retrieve] downloading http://mirror.facebook.net/facebook/hive-deps/hadoop/core/hadoop-0.20.3-CDH3-SNAPSHOT/hadoop-0.20.3-CDH3-SNAPSHOT.tar.gz ...
[ivy:retrieve] [SUCCESSFUL ] hadoop#core;0.20.3-CDH3-SNAPSHOT!hadoop.tar.gz(source) (160129ms)
[ivy:retrieve] :: resolution report :: resolve 6848ms :: artifacts dl 220906ms
---------------------------------------------------------------------

	modules	artifacts
conf	number	search	dwnlded	evicted	number	dwnlded

---------------------------------------------------------------------

default	2	1	0	0	2	1

---------------------------------------------------------------------
[ivy:retrieve]
[ivy:retrieve] :: problems summary ::
[ivy:retrieve] :::: WARNINGS
[ivy:retrieve] [FAILED ] hadoop#core;0.20.1!hadoop.tar.gz(source): Not in GZIP format (60771ms)
[ivy:retrieve] [FAILED ] hadoop#core;0.20.1!hadoop.tar.gz(source): (0ms)
[ivy:retrieve] ==== hadoop-source: tried
[ivy:retrieve] http://mirror.facebook.net/facebook/hive-deps/hadoop/core/hadoop-0.20.1/hadoop-0.20.1.tar.gz
[ivy:retrieve] ==== apache-snapshot: tried
[ivy:retrieve] https://repository.apache.org/content/repositories/snapshots/hadoop/core/0.20.1/hadoop-0.20.1.tar.gz
[ivy:retrieve] ==== maven2: tried
[ivy:retrieve] http://repo1.maven.org/maven2/hadoop/core/0.20.1/core-0.20.1.tar.gz
[ivy:retrieve] ==== datanucleus-repo: tried
[ivy:retrieve] http://www.datanucleus.org/downloads/maven2/hadoop/core/0.20.1/core-0.20.1.tar.gz
[ivy:retrieve] ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:retrieve] :: FAILED DOWNLOADS ::
[ivy:retrieve] :: ^ see resolution messages for details ^ ::
[ivy:retrieve] ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:retrieve] :: hadoop#core;0.20.1!hadoop.tar.gz(source)
[ivy:retrieve] ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:retrieve]
[ivy:retrieve] :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS

The download appears to be fetching the wrong file or corrupting the file in download. Once the proper version of the file is fetched and put in the ivy cache all works just fine.