Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-13270

[JS] DataFrame Filter-Scan Count - TypeError: df.filter is not a function

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Duplicate
    • None
    • None
    • JavaScript
    • None

    Description

      The following benchmark fails with TypeError: df.filter is not a function.

          b.suite(
              `DataFrame Filter-Scan Count`,
      
              ...counts.map(({ column, test, value }: {column: string; test: 'gt' | 'eq'; value: number | string}) => b.add(
                  `dataset: ${name}, column: ${column}, length: ${formatNumber(df.length)}, type: ${df.schema.fields.find((c)=> c.name === column)!.type}, test: ${test}, value: ${value}`,
                  () => {
                      let filteredDf: Arrow.FilteredDataFrame;
                      if (test == 'gt') {
                          filteredDf = df.filter(col(column).gt(value));
                      } else if (test == 'eq') {
                          filteredDf = df.filter(col(column).eq(value));
                      } else {
                          throw new Error(`Unrecognized test "${test}"`);
                      }
      
                      return () => filteredDf.count();
                  }
              )),
      
              b.cycle(cycle)
          );
      

      Attachments

        Activity

          People

            dianaclarke Diana Clarke
            dianaclarke Diana Clarke
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: