Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-337

Compress Samza configuration passed to Yarn

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • None
    • 0.8.0
    • None
    • None

    Description

      As a stop gap fix for SAMZA-333, we can compress the Samza specific configuration using gzip (or something similar) and extract it when the job needs them, this will reduce the size of the export variable and temporarily alleviate the situation.

      Attachments

        1. samza_337.patch
          9 kB
          Chinmay Soman
        2. samza_337_3.patch
          10 kB
          Chinmay Soman
        3. samza_337_2.patch
          10 kB
          Chinmay Soman
        4. samza_337_1.patch
          10 kB
          Chinmay Soman

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. SAMZA-333 Large samza configurations results in yarn job failure

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. SAMZA-352 Scala 2.9.2 build broken after SAMZA-337

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Activity

            People

              cpsoman Chinmay Soman
              nsomasun Naveen
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: