[CRUNCH-518] Can't build crunch-spark due to protobuf dependency

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.12.0
• Assignee: Josh Wills
• Reporter: Gabriel Reid
• Created: 08/May/15 20:18
• Updated: 18/May/15 19:04
• Resolved: 08/May/15 21:43

Description

When trying to build clean build, I get errors like the following from crunch-spark:

[ERROR] /Users/greid/development/apache-projects/crunch/crunch-spark/src/it/scala/org/apache/crunch/scrunch/spark/PageRankTest.scala:49: error: bad symbolic reference. A signature in PTypeH.class refers to term protobuf
[ERROR] in package com.google which is not available.
[ERROR] It may be completely missing from the current classpath, or the version on
[ERROR] the classpath might be incompatible with the version used when compiling PTypeH.class.
[ERROR]     prev.cogroup(out).map((url, v) => {

It seems that this is due to protobuf being referenced from PTypeH, but since it's in provided scope in crunch-scrunch, it doesn't get pulled in when building crunch-spark.