Uploaded image for project: 'SystemML'
  1. SystemML
  2. SYSTEMML-1906

Slow codegen row operations over compressed data

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Despite previous improvements to codegen row operations over compressed data, the performance is not yet competitive. The challenge is due to row-wise access over column-wise compressed data.

      For example, recent experiments over the dense Airline78 (compressed) showed the following results, where the last column shows codegen operations:

      codegen.Experiment5: 375.922413 493.010656 4454.854838
      codegen.Experiment5: 372.49865 356.360481 4027.055731
      codegen.Experiment5: 392.70993 411.45972 4024.717366
      codegen.Experiment5: 362.232105 379.929685 4064.909038
      codegen.Experiment5: 348.231497 409.064944 4088.016386
      codegen.Experiment5: 326.48536 409.311073 4147.657623
      codegen.Experiment5: 385.63351 391.528045 4003.624347
      codegen.Experiment5: 364.701519 451.546031 4053.855223
      codegen.Experiment5: 385.613323 383.600952 4321.492514
      codegen.Experiment5: 499.032415 406.496815 4152.271301
      codegen.Experiment5: 449.385382 436.278214 4034.216778
      codegen.Experiment5: 362.208891 467.055278 4392.978871
      codegen.Experiment5: 380.12149 351.335 4259.480368
      codegen.Experiment5: 408.066566 337.801059 4268.923694
      codegen.Experiment5: 390.642335 387.889392 4178.020609
      codegen.Experiment5: 405.724009 418.096892 4226.759174
      codegen.Experiment5: 389.837952 469.873278 4208.987971
      codegen.Experiment5: 385.084077 458.136199 3971.852021
      codegen.Experiment5: 449.622388 461.645296 4128.829424
      codegen.Experiment5: 434.442843 393.385774 4350.31459
      

      Similarly, the same experiment over the sparse Mnist8m (compressed) showed the following results

      codegen.Experiment5: 2086.639353 2102.07509 66398.837701
      codegen.Experiment5: 2031.632887 1865.078801 66411.617426
      codegen.Experiment5: 1965.660671 1951.702067 67005.141958
      codegen.Experiment5: 1986.203115 1935.408375 67191.00898
      codegen.Experiment5: 1908.019522 2110.527745 66898.423384
      codegen.Experiment5: 2133.889418 1996.002736 67140.489795
      codegen.Experiment5: 2124.78694 1960.742883 66828.374397
      codegen.Experiment5: 2131.077188 2146.423403 66800.984041
      codegen.Experiment5: 2259.718694 2133.771833 66927.743748
      codegen.Experiment5: 2184.72028 1991.324151 65525.366494
      codegen.Experiment5: 1884.825264 1869.590621 65557.023881
      codegen.Experiment5: 1990.109355 2233.858887 67177.792293
      codegen.Experiment5: 2050.992504 1809.59564 66543.725909
      codegen.Experiment5: 2132.455256 2176.164228 66954.400906
      codegen.Experiment5: 2172.735023 2182.052528 66921.510286
      codegen.Experiment5: 2092.554763 2127.864808 67335.947001
      codegen.Experiment5: 2106.621765 1972.034093 66817.709411
      codegen.Experiment5: 1818.935779 1873.261603 67020.50054
      codegen.Experiment5: 2094.426711 1911.01054 66089.29852
      codegen.Experiment5: 1819.874197 2019.061886 66725.927399
      

        Activity

        There are no comments yet on this issue.

          People

          • Assignee:
            Unassigned
            Reporter:
            mboehm7 Matthias Boehm
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:

              Development