Uploaded image for project: 'Bigtop'
  1. Bigtop
  2. BIGTOP-4045

Enable Parallel Compilation for Multiple Modules in TEZ

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.3.0
    • None
    • None

    Description

      test on centos7 x86_64
      ./gradlew tez-clean tez-pkg -PcompileThreads=2C

      Parallel compilation for Tez requires the introduction of a Tez patch, which can be found at TEZ-4520. This patch is designed to address the issue of Tez not being able to compile in parallel.

       

      Attachments

        1. image-2023-12-15-15-08-35-127.png
          150 kB
          caijialiang
        2. image-2023-12-15-15-08-19-304.png
          150 kB
          caijialiang

        Issue Links

          depends upon

          Improvement - An improvement or enhancement to an existing feature or task. BIGTOP-4044 Enhance Bigtop with Concurrent Compilation Support for Additional Components

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub pull request #1224

          Web Link https://issues.apache.org/jira/browse/TEZ-4520

          Activity

            People

              jialiang caijialiang
              jialiang caijialiang
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h
                  1h