Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-3740

While using BulkOutputFormat unneccessarily look for the cassandra.yaml file.

    XMLWordPrintableJSON

Details

    • Normal

    Description

      I am trying to use BulkOutputFormat to stream the data from map of Hadoop job. I have set the cassandra related configuration using ConfigHelper ,Also have looked into Cassandra code seems Cassandra has taken care that it should not look for the cassandra.yaml file.
      But still when I run the job i get the following error:

      {
      12/01/13 11:30:04 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
      12/01/13 11:30:04 INFO input.FileInputFormat: Total input paths to process : 1
      12/01/13 11:30:04 INFO mapred.JobClient: Running job: job_201201130910_0015
      12/01/13 11:30:05 INFO mapred.JobClient: map 0% reduce 0%
      12/01/13 11:30:23 INFO mapred.JobClient: Task Id : attempt_201201130910_0015_m_000000_0, Status : FAILED
      java.lang.Throwable: Child Error
      at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
      Caused by: java.io.IOException: Task process exit with nonzero status of 1.
      at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)

      attempt_201201130910_0015_m_000000_0: Cannot locate cassandra.yaml
      attempt_201201130910_0015_m_000000_0: Fatal configuration error; unable to start server.
      }

      Also let me know how can i make this cassandra.yaml file available to Hadoop mapreduce job?

      Attachments

        1. 0001-Make-DD-the-canonical-partitioner-source.txt
          6 kB
          Brandon Williams
        2. 0002-Prevent-loading-from-yaml.txt
          10 kB
          Brandon Williams
        3. 0003-use-output-partitioner.txt
          10 kB
          Brandon Williams
        4. 0005-BWR-uses-any-if.txt
          1 kB
          Brandon Williams

        Issue Links

          Activity

            People

              brandon.williams Brandon Williams
              samarthg1986 Samarth Gahire
              Brandon Williams
              Chris Goffinet
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: