Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-17372

Arrow parquet go is missing Power (ppc64le) specific utils implementations

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 8.0.0, 8.0.1
    • 10.0.0
    • Go, Parquet
    • Linux (RHEL) ppc64le

    Description

      When trying to build the feast go lib on ppc64le it fails because parquet internal seems to miss even the basic (pure go implementations for ppc64le) files. Providing e.g. `bit_packing_ppc64le.go` & `unpack_bool_ppc64le.go` should solve this issue in the first place.

      It can then be enhanced by implementing the correct vector & matrix intrinsics for the Power architecture (e.g. VSX or MMA) in a second step.

      go build -mod=mod -buildmode=c-shared -tags cgo,ccalloc -o embedded_go.so .
      cmd had error: exit status 2 output:
      github.com/apache/arrow/go/v8/parquet/internal/utils
      /root/go/pkg/mod/github.com/apache/arrow/go/v8@v8.0.0/parquet/internal/utils/bit_reader.go:230:18: undefined: unpack32
      /root/go/pkg/mod/github.com/apache/arrow/go/v8@v8.0.0/parquet/internal/utils/bit_reader.go:274:3: undefined: BytesToBools
      /root/go/pkg/mod/github.com/apache/arrow/go/v8@v8.0.0/parquet/internal/utils/bit_reader.go:318:18: undefined: unpack32 

      I tested this already locally (with success) and create an according PR.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              mgiessing Marvin Giessing
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h
                  1h