Uploaded image for project: 'Chukwa'
  1. Chukwa
  2. CHUKWA-632

Logs getting lost in hbase using TsProcessor

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.5.0
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      When collector writes to hbase using TsProcessor, it is using timestamp as the key. If there are multiple log statements with the same timestamp, which is the key, it looses them in hbase.

      As a fix, I extended AbstractProcessor and built my key using timestamp and the AbstractProcessor.startOffset. But, for that, it has to be protected or a getter on it in AbstractProcessor class to be able to use it.

      Also, the way OutputCollector.collect method works, it might need to redo the way rowKey is created.

        Attachments

        1. patch.txt
          0.9 kB
          Abhijit Dhar

          Activity

            People

            • Assignee:
              abhijitdhar Abhijit Dhar
              Reporter:
              abhijitdhar Abhijit Dhar
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: