Uploaded image for project: 'Apache Cassandra'
  1. Apache Cassandra
  2. CASSANDRA-3740

While using BulkOutputFormat unneccessarily look for the cassandra.yaml file.

Agile BoardAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Normal

    Description

      I am trying to use BulkOutputFormat to stream the data from map of Hadoop job. I have set the cassandra related configuration using ConfigHelper ,Also have looked into Cassandra code seems Cassandra has taken care that it should not look for the cassandra.yaml file.
      But still when I run the job i get the following error:

      {
      12/01/13 11:30:04 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
      12/01/13 11:30:04 INFO input.FileInputFormat: Total input paths to process : 1
      12/01/13 11:30:04 INFO mapred.JobClient: Running job: job_201201130910_0015
      12/01/13 11:30:05 INFO mapred.JobClient: map 0% reduce 0%
      12/01/13 11:30:23 INFO mapred.JobClient: Task Id : attempt_201201130910_0015_m_000000_0, Status : FAILED
      java.lang.Throwable: Child Error
      at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
      Caused by: java.io.IOException: Task process exit with nonzero status of 1.
      at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)

      attempt_201201130910_0015_m_000000_0: Cannot locate cassandra.yaml
      attempt_201201130910_0015_m_000000_0: Fatal configuration error; unable to start server.
      }

      Also let me know how can i make this cassandra.yaml file available to Hadoop mapreduce job?

      Attachments

        1. 0005-BWR-uses-any-if.txt
          1 kB
          Brandon Williams
        2. 0003-use-output-partitioner.txt
          10 kB
          Brandon Williams
        3. 0002-Prevent-loading-from-yaml.txt
          10 kB
          Brandon Williams
        4. 0001-Make-DD-the-canonical-partitioner-source.txt
          6 kB
          Brandon Williams

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            brandon.williams Brandon Williams Assign to me
            samarthg1986 Samarth Gahire
            Brandon Williams
            Chris Goffinet
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment