Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-4415

Enable HDFS based Performance Test for ParquetIO

Details

    • New Feature
    • Status: Resolved
    • P2
    • Resolution: Done
    • None
    • 2.5.0
    • io-java-parquet, testing
    • None

    Description

      There already is a running job for ParquetIO on Jenkins: https://builds.apache.org/view/A-D/view/Beam/job/beam_PerformanceTests_ParquetIOIT/ 

      There are also Jenkins' Jobs running such tests on an HDFS cluster: https://builds.apache.org/view/A-D/view/Beam/job/beam_PerformanceTests_AvroIOIT_HDFS/ 

      Therefore, we should provide a Performance Test for ParquetIO running on HDFS cluster.

      Attachments

        Issue Links

          Activity

            People

              ŁukaszG Lukasz Gajowy
              ŁukaszG Lukasz Gajowy
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 2h 10m
                  2h 10m