Uploaded image for project: 'Metron (Retired)'
  1. Metron (Retired)
  2. METRON-934

Component and task id are missing in the indexing topology Hdfs file names

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Done
    • Major
    • Resolution: Done
    • None
    • 0.4.0
    • None

    Description

      The HdfsWriter class creates a new PathExtensionFileNameFormat object and passes it to SourceHandler class. However, the PathExtensionFileNameFormat.prepare method is never called, resulting in uninitialized DefaultFileNameFormat.componentId and DefaultFileNameFormat.taskId fields.

      This becomes a problem as soon as a BulkMessageWriterBolt with HdfsWriter configured is given more than one task because the HDFS file name is not unique among tasks (taskId defaults to 0 if not initialized).

      Attachments

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. METRON-674 Archived Telemetry Filenames in HDFS Contain 'Null'

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Done
          links to

          Web Link GitHub Pull Request #574

          Web Link GitHub Pull Request #574

          Activity

            People

              dlyle David M. Lyle
              rmerriman Ryan Merriman
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: