XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: spark-branch
    • Component/s: spark
    • Labels:
      None

      Description

      result are different:

      diff <(head -20 SkewedJoin_6_benchmark.out/out_sorted) <(head -20 SkewedJoin_6.out/out_sorted)
      < alice allen	19	1.930	alice allen	27	1.950
      < alice allen	19	1.930	alice allen	34	1.230
      < alice allen	19	1.930	alice allen	36	2.270
      < alice allen	19	1.930	alice allen	38	0.810
      < alice allen	19	1.930	alice allen	38	1.800
      < alice allen	19	1.930	alice allen	42	2.460
      < alice allen	19	1.930	alice allen	43	0.880
      < alice allen	19	1.930	alice allen	45	2.800
      < alice allen	19	1.930	alice allen	46	3.970
      < alice allen	19	1.930	alice allen	51	1.080
      < alice allen	19	1.930	alice allen	68	3.390
      < alice allen	19	1.930	alice allen	68	3.510
      < alice allen	19	1.930	alice allen	72	1.750
      < alice allen	19	1.930	alice allen	72	3.630
      < alice allen	19	1.930	alice allen	74	0.020
      < alice allen	19	1.930	alice allen	74	2.400
      < alice allen	19	1.930	alice allen	77	2.520
      < alice allen	20	2.470	alice allen	27	1.950
      < alice allen	20	2.470	alice allen	34	1.230
      < alice allen	20	2.470	alice allen	36	2.270
      ---
      > alice allen	27	1.950	alice allen	19	1.930
      > alice allen	27	1.950	alice allen	20	2.470
      > alice allen	27	1.950	alice allen	27	1.950
      > alice allen	27	1.950	alice allen	34	1.230
      > alice allen	27	1.950	alice allen	36	2.270
      > alice allen	27	1.950	alice allen	38	0.810
      > alice allen	27	1.950	alice allen	38	1.800
      > alice allen	27	1.950	alice allen	42	2.460
      > alice allen	27	1.950	alice allen	43	0.880
      > alice allen	27	1.950	alice allen	45	2.800
      > alice allen	27	1.950	alice allen	46	3.970
      > alice allen	27	1.950	alice allen	51	1.080
      > alice allen	27	1.950	alice allen	68	3.390
      > alice allen	27	1.950	alice allen	68	3.510
      > alice allen	27	1.950	alice allen	72	1.750
      > alice allen	27	1.950	alice allen	72	3.630
      > alice allen	27	1.950	alice allen	74	0.020
      > alice allen	27	1.950	alice allen	74	2.400
      > alice allen	27	1.950	alice allen	77	2.520
      > alice allen	34	1.230	alice allen	19	1.930
      

      It looks like the two tables are in wrong order, columns from 'a' should come first, then columns from 'b'. In spark mode this is inverted.

        Attachments

        1. PIG-5212_2.patch
          4 kB
          liyunzhang
        2. PIG-5212.patch
          4 kB
          liyunzhang

          Activity

            People

            • Assignee:
              kellyzly liyunzhang
              Reporter:
              nkollar Nándor Kollár
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: