Uploaded image for project: 'ORC'
  1. ORC
  2. ORC-386

Add new spark file format benchmark

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.6.0
    • Component/s: None
    • Labels:
      None

      Description

      I've done a new set of benchmarks that compare the performance of the file formats as they are read from Spark.

      As part of this, I've refactored a lot of the benchmark code into different modules so that we don't need to fight quite as many dependency hell fires when trying to build an uber jar with both Spark and Hive in it.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                owen.omalley Owen O'Malley
                Reporter:
                owen.omalley Owen O'Malley
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: