Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-1919

sbt project with carbondata dependencies got error when compiling

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.2.0
    • None
    • build
    • None
    • sbt 0.13.15

    Description

      In my sbt project, I added carbondata-spark2 dependency like below:

      libraryDependencies += "org.apache.carbondata" % "carbondata-spark2" % "1.2.0"

      Unfortunately error occured during compilation:

      [warn] 	Note: Unresolved dependencies path:
      [warn] 		org.apache.spark:spark-sql_${scala.binary.version}:${spark.version}
      [warn] 		  +- org.apache.carbondata:carbondata-core:1.2.0
      [warn] 		  +- org.apache.carbondata:carbondata-processing:1.2.0
      [warn] 		  +- org.apache.carbondata:carbondata-hadoop:1.2.0
      [warn] 		  +- org.apache.carbondata:carbondata-spark-common:1.2.0
      [warn] 		  +- org.apache.carbondata:carbondata-spark2:1.2.0
      [warn] 		org.apache.spark:spark-hive-thriftserver_${scala.binary.version}:${spark.version}
      [warn] 		  +- org.apache.carbondata:carbondata-spark-common:1.2.0
      [warn] 		  +- org.apache.carbondata:carbondata-spark2:1.2.0
      [warn] 		org.apache.spark:spark-repl_${scala.binary.version}:${spark.version}
      [warn] 		  +- org.apache.carbondata:carbondata-spark2:1.2.0 
      
      [error] sbt.ResolveException: unresolved dependency: org.apache.spark#spark-sql_${scala.binary.version};${spark.version}: not found
      [error] unresolved dependency: org.apache.spark#spark-hive-thriftserver_${scala.binary.version};${spark.version}: not found
      [error] unresolved dependency: org.apache.spark#spark-repl_${scala.binary.version};${spark.version}: not found
      

      The project has a lot of spark dependencies, and all versions of spark-sql can be found in my .ivy2 folder and .m2 folder. Also when I remove the carbondata dependency, everything works fine. An empty sbt project with only carbondata dependency has the same problem, but maven project can successfully resolve the dependency.

      Attachments

        Activity

          People

            Unassigned Unassigned
            john.xu CHENYANG XU
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated: