XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • spark-branch
    • spark
    • None

    Description

      result are different:

      diff <(head -20 SkewedJoin_6_benchmark.out/out_sorted) <(head -20 SkewedJoin_6.out/out_sorted)
      < alice allen	19	1.930	alice allen	27	1.950
      < alice allen	19	1.930	alice allen	34	1.230
      < alice allen	19	1.930	alice allen	36	2.270
      < alice allen	19	1.930	alice allen	38	0.810
      < alice allen	19	1.930	alice allen	38	1.800
      < alice allen	19	1.930	alice allen	42	2.460
      < alice allen	19	1.930	alice allen	43	0.880
      < alice allen	19	1.930	alice allen	45	2.800
      < alice allen	19	1.930	alice allen	46	3.970
      < alice allen	19	1.930	alice allen	51	1.080
      < alice allen	19	1.930	alice allen	68	3.390
      < alice allen	19	1.930	alice allen	68	3.510
      < alice allen	19	1.930	alice allen	72	1.750
      < alice allen	19	1.930	alice allen	72	3.630
      < alice allen	19	1.930	alice allen	74	0.020
      < alice allen	19	1.930	alice allen	74	2.400
      < alice allen	19	1.930	alice allen	77	2.520
      < alice allen	20	2.470	alice allen	27	1.950
      < alice allen	20	2.470	alice allen	34	1.230
      < alice allen	20	2.470	alice allen	36	2.270
      ---
      > alice allen	27	1.950	alice allen	19	1.930
      > alice allen	27	1.950	alice allen	20	2.470
      > alice allen	27	1.950	alice allen	27	1.950
      > alice allen	27	1.950	alice allen	34	1.230
      > alice allen	27	1.950	alice allen	36	2.270
      > alice allen	27	1.950	alice allen	38	0.810
      > alice allen	27	1.950	alice allen	38	1.800
      > alice allen	27	1.950	alice allen	42	2.460
      > alice allen	27	1.950	alice allen	43	0.880
      > alice allen	27	1.950	alice allen	45	2.800
      > alice allen	27	1.950	alice allen	46	3.970
      > alice allen	27	1.950	alice allen	51	1.080
      > alice allen	27	1.950	alice allen	68	3.390
      > alice allen	27	1.950	alice allen	68	3.510
      > alice allen	27	1.950	alice allen	72	1.750
      > alice allen	27	1.950	alice allen	72	3.630
      > alice allen	27	1.950	alice allen	74	0.020
      > alice allen	27	1.950	alice allen	74	2.400
      > alice allen	27	1.950	alice allen	77	2.520
      > alice allen	34	1.230	alice allen	19	1.930
      

      It looks like the two tables are in wrong order, columns from 'a' should come first, then columns from 'b'. In spark mode this is inverted.

      Attachments

        1. PIG-5212.patch
          4 kB
          liyunzhang
        2. PIG-5212_2.patch
          4 kB
          liyunzhang

        Activity

          People

            kellyzly liyunzhang
            nkollar Nándor Kollár
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: