Uploaded image for project: 'ORC'
  1. ORC
  2. ORC-72

Add benchmarks comparing JSON, Avro, Parquet, ORC

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.4.0
    • Component/s: None
    • Labels:
      None

      Description

      Add benchmarks using publicly available data so that we can benchmark ORC and find ways to make it better and faster.

        Issue Links

          Activity

          Hide
          githubbot ASF GitHub Bot added a comment -

          GitHub user omalley opened a pull request:

          https://github.com/apache/orc/pull/43

          ORC-72 Add benchmarking code

          You can merge this pull request into a Git repository by running:

          $ git pull https://github.com/omalley/orc orc-72

          Alternatively you can review and apply these changes as the patch at:

          https://github.com/apache/orc/pull/43.patch

          To close this pull request, make a commit to your master/trunk branch
          with (at least) the following in the commit message:

          This closes #43


          commit 348164bdc780a23932622307ec32247194274e81
          Author: Owen O'Malley <omalley@apache.org>
          Date: 2016-06-14T17:00:15Z

          ORC-72. Add benchmarks to ORC.

          commit 38e1441d8a9434235b049b7089f1fa262b2d1807
          Author: Owen O'Malley <omalley@apache.org>
          Date: 2016-06-27T00:29:08Z

          Added the starts of json support

          commit f11a67a62b8d7ad665820ceec64cc227e359bf0a
          Author: Owen O'Malley <omalley@apache.org>
          Date: 2016-06-27T07:04:45Z

          unify the compression interface

          commit 5f02f63a6d13a2670c885b3daeaa12b00d755925
          Author: Owen O'Malley <omalley@apache.org>
          Date: 2016-06-27T23:02:29Z

          full read benchmark

          commit 232efcc01a873346f6efe831817ee2bf1e6263ea
          Author: Owen O'Malley <omalley@apache.org>
          Date: 2016-06-28T20:57:36Z

          Added column projection


          Show
          githubbot ASF GitHub Bot added a comment - GitHub user omalley opened a pull request: https://github.com/apache/orc/pull/43 ORC-72 Add benchmarking code You can merge this pull request into a Git repository by running: $ git pull https://github.com/omalley/orc orc-72 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/orc/pull/43.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #43 commit 348164bdc780a23932622307ec32247194274e81 Author: Owen O'Malley <omalley@apache.org> Date: 2016-06-14T17:00:15Z ORC-72 . Add benchmarks to ORC. commit 38e1441d8a9434235b049b7089f1fa262b2d1807 Author: Owen O'Malley <omalley@apache.org> Date: 2016-06-27T00:29:08Z Added the starts of json support commit f11a67a62b8d7ad665820ceec64cc227e359bf0a Author: Owen O'Malley <omalley@apache.org> Date: 2016-06-27T07:04:45Z unify the compression interface commit 5f02f63a6d13a2670c885b3daeaa12b00d755925 Author: Owen O'Malley <omalley@apache.org> Date: 2016-06-27T23:02:29Z full read benchmark commit 232efcc01a873346f6efe831817ee2bf1e6263ea Author: Owen O'Malley <omalley@apache.org> Date: 2016-06-28T20:57:36Z Added column projection
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user asfgit closed the pull request at:

          https://github.com/apache/orc/pull/43

          Show
          githubbot ASF GitHub Bot added a comment - Github user asfgit closed the pull request at: https://github.com/apache/orc/pull/43
          Hide
          owen.omalley Owen O'Malley added a comment -

          I just committed this.

          Show
          owen.omalley Owen O'Malley added a comment - I just committed this.
          Hide
          owen.omalley Owen O'Malley added a comment -

          Released as part of ORC 1.4.0

          Show
          owen.omalley Owen O'Malley added a comment - Released as part of ORC 1.4.0

            People

            • Assignee:
              owen.omalley Owen O'Malley
              Reporter:
              owen.omalley Owen O'Malley
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development