Details

    • Columnar Format

    Description

      For analytical workloads, queries are usually large (scan-based) and narrow (only involve a few values).  We introduce a new columnar format in AsterixDB to accompany the current row format.

      For more details about the new columnar format, see this paper.

      Attachments

        Activity

          Commit 4b5a6a7f071d1540d913d40ff1c24d9d72cabfd8 in asterixdb's branch refs/heads/master from Wail Alkowaileet
          [ https://gitbox.apache.org/repos/asf?p=asterixdb.git;h=4b5a6a7f07 ]

          ASTERIXDB-3029[RT] Introduce LazyVisitablePointable

          • user mode changes: no
          • storage format changes: no
          • interface changes: no

          Details:

          • The lazy visitable pointable allows for traversing a record and
            processing it in a single pass compared to the IVisitablePointable,
            which requires two passes - one for calling set() and another when
            calling accept().
          • Does not require writing the nested values into temporary buffers.
          • However, it is suitable when traversing the records in DFS.
          • Traversing and processing records efficiently is crucial for
            ASTERIXDB-3002 to infer the schema and covert rows into columns.

          Change-Id: Iaf2c827d80a2a7e77f5f6eb5438cea417387e132
          Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/17412
          Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
          Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
          Reviewed-by: Wail Alkowaileet <wael.y.k@gmail.com>
          Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

          jira-bot ASF subversion and git services added a comment - Commit 4b5a6a7f071d1540d913d40ff1c24d9d72cabfd8 in asterixdb's branch refs/heads/master from Wail Alkowaileet [ https://gitbox.apache.org/repos/asf?p=asterixdb.git;h=4b5a6a7f07 ] ASTERIXDB-3029 [RT] Introduce LazyVisitablePointable user mode changes: no storage format changes: no interface changes: no Details: The lazy visitable pointable allows for traversing a record and processing it in a single pass compared to the IVisitablePointable, which requires two passes - one for calling set() and another when calling accept(). Does not require writing the nested values into temporary buffers. However, it is suitable when traversing the records in DFS. Traversing and processing records efficiently is crucial for ASTERIXDB-3002 to infer the schema and covert rows into columns. Change-Id: Iaf2c827d80a2a7e77f5f6eb5438cea417387e132 Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/17412 Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu> Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu> Reviewed-by: Wail Alkowaileet <wael.y.k@gmail.com> Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

          People

            wyk Wail Y. Alkowaileet
            wyk Wail Y. Alkowaileet
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: