Uploaded image for project: 'ORC'
  1. ORC
  2. ORC-72

Add benchmarks comparing JSON, Avro, Parquet, ORC

        Details

        • Type: Bug
        • Status: Closed
        • Priority: Major
        • Resolution: Fixed
        • Affects Version/s: None
        • Fix Version/s: 1.4.0
        • Component/s: None
        • Labels:
          None

          Description

          Add benchmarks using publicly available data so that we can benchmark ORC and find ways to make it better and faster.

            Issue Links

            links to

            Web Link GitHub Pull Request #43

              Activity

              Ascending order - Click to sort in descending order
              Hide
              Permalink
              githubbot ASF GitHub Bot added a comment -

              GitHub user omalley opened a pull request:

              https://github.com/apache/orc/pull/43

              ORC-72 Add benchmarking code

              You can merge this pull request into a Git repository by running:

              $ git pull https://github.com/omalley/orc orc-72

              Alternatively you can review and apply these changes as the patch at:

              https://github.com/apache/orc/pull/43.patch

              To close this pull request, make a commit to your master/trunk branch
              with (at least) the following in the commit message:

              This closes #43

              commit 348164bdc780a23932622307ec32247194274e81
              Author: Owen O'Malley <omalley@apache.org>
              Date: 2016-06-14T17:00:15Z

              ORC-72. Add benchmarks to ORC.

              commit 38e1441d8a9434235b049b7089f1fa262b2d1807
              Author: Owen O'Malley <omalley@apache.org>
              Date: 2016-06-27T00:29:08Z

              Added the starts of json support

              commit f11a67a62b8d7ad665820ceec64cc227e359bf0a
              Author: Owen O'Malley <omalley@apache.org>
              Date: 2016-06-27T07:04:45Z

              unify the compression interface

              commit 5f02f63a6d13a2670c885b3daeaa12b00d755925
              Author: Owen O'Malley <omalley@apache.org>
              Date: 2016-06-27T23:02:29Z

              full read benchmark

              commit 232efcc01a873346f6efe831817ee2bf1e6263ea
              Author: Owen O'Malley <omalley@apache.org>
              Date: 2016-06-28T20:57:36Z

              Added column projection

              Show
              githubbot ASF GitHub Bot added a comment - GitHub user omalley opened a pull request: https://github.com/apache/orc/pull/43 ORC-72 Add benchmarking code You can merge this pull request into a Git repository by running: $ git pull https://github.com/omalley/orc orc-72 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/orc/pull/43.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #43 commit 348164bdc780a23932622307ec32247194274e81 Author: Owen O'Malley <omalley@apache.org> Date: 2016-06-14T17:00:15Z ORC-72 . Add benchmarks to ORC. commit 38e1441d8a9434235b049b7089f1fa262b2d1807 Author: Owen O'Malley <omalley@apache.org> Date: 2016-06-27T00:29:08Z Added the starts of json support commit f11a67a62b8d7ad665820ceec64cc227e359bf0a Author: Owen O'Malley <omalley@apache.org> Date: 2016-06-27T07:04:45Z unify the compression interface commit 5f02f63a6d13a2670c885b3daeaa12b00d755925 Author: Owen O'Malley <omalley@apache.org> Date: 2016-06-27T23:02:29Z full read benchmark commit 232efcc01a873346f6efe831817ee2bf1e6263ea Author: Owen O'Malley <omalley@apache.org> Date: 2016-06-28T20:57:36Z Added column projection
              Hide
              Permalink
              githubbot ASF GitHub Bot added a comment -

              Github user asfgit closed the pull request at:

              https://github.com/apache/orc/pull/43

              Show
              githubbot ASF GitHub Bot added a comment - Github user asfgit closed the pull request at: https://github.com/apache/orc/pull/43
              Hide
              Permalink
              owen.omalley Owen O'Malley added a comment -

              I just committed this.

              Show
              owen.omalley Owen O'Malley added a comment - I just committed this.
              Hide
              Permalink
              owen.omalley Owen O'Malley added a comment -

              Released as part of ORC 1.4.0

              Show
              owen.omalley Owen O'Malley added a comment - Released as part of ORC 1.4.0

                People

                • Assignee:
                  owen.omalley Owen O'Malley
                  Reporter:
                  owen.omalley Owen O'Malley
                • Votes:
                  0 Vote for this issue
                  Watchers:
                  4 Start watching this issue

                  Dates

                  • Created:
                    Updated:
                    Resolved:

                    Development