Chukwa
  1. Chukwa
  2. CHUKWA-540

Problem while testing the new user defined adaptor

    Details

    • Type: Test Test
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 0.4.0
    • Fix Version/s: 0.4.0
    • Component/s: Build and Test Code
    • Labels:
      None
    • Environment:

      linux

      Description

      I have created the adaptor class in chukwa for log files which are in xml format. When I am testing, the data is going to the demux processing n then stops.
      No data is present in repos after 5 mins.
      I have set the interval as 5 min for data flow in this operation.

        Activity

        Hide
        Lewis John McGibbney added a comment -

        switch this issue to 0.7.0

        Show
        Lewis John McGibbney added a comment - switch this issue to 0.7.0
        Hide
        Prachi Bedekar added a comment -

        Hi,
        Thank you for your help. But I want to create my own adaptor for log file. Will you please suggest any type which is easy to implement.

        Thanks in advance.

        Regards,
        Prachi Bedekar

        Show
        Prachi Bedekar added a comment - Hi, Thank you for your help. But I want to create my own adaptor for log file. Will you please suggest any type which is easy to implement. Thanks in advance. Regards, Prachi Bedekar
        Hide
        Eric Yang added a comment -

        XML file is not good for streaming through Chukwa because the data are ordered by line, sending small bits of xml over Chukwa collectors in parallel do not guarantee the original ordering. FileAdaptor can send whole xml file as one post, hence it will keep the original data consistent, but the file needs to be less than 300k or agent buffer might overflow.

        Show
        Eric Yang added a comment - XML file is not good for streaming through Chukwa because the data are ordered by line, sending small bits of xml over Chukwa collectors in parallel do not guarantee the original ordering. FileAdaptor can send whole xml file as one post, hence it will keep the original data consistent, but the file needs to be less than 300k or agent buffer might overflow.

          People

          • Assignee:
            Unassigned
            Reporter:
            Prachi Bedekar
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:

              Time Tracking

              Estimated:
              Original Estimate - 120h
              120h
              Remaining:
              Remaining Estimate - 120h
              120h
              Logged:
              Time Spent - Not Specified
              Not Specified

                Development