Details

    • Type: Bug Bug
    • Status: Open
    • Priority: Minor Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Why doesn't PIG support partition by on order by?

      If PIG would then PIG could be used for a mess of windowing functions.

      Is there some reason why we can't add a custom partitioner on a order by operation?

      Is there a work around to do windowing in PIG.

      I understand the I can group and then order with in a group, but what if the items with in the group are super big will I have memory issues? Because I need to order the values with in a group. i.e. stock tickers is the group and they need to be sorted on time.

        Activity

        Ted Malaska created issue -
        Ted Malaska made changes -
        Field Original Value New Value
        Description Why doesn't PIG support partition by on order by?

        If PIG would then PIG could be used for a mess of windowing functions.

        Is there some reason why we can't add a custom partitioner on a order by operation?

        Is there a work around to do windowing in PIG.

        I understand the I can group and then group with in a group, but what if the items with in the group are super big will I have memory issues? Because I need to order the values with in a group. i.e. stock tickers is the group and they need to be sorted on time.
        Why doesn't PIG support partition by on order by?

        If PIG would then PIG could be used for a mess of windowing functions.

        Is there some reason why we can't add a custom partitioner on a order by operation?

        Is there a work around to do windowing in PIG.

        I understand the I can group and then order with in a group, but what if the items with in the group are super big will I have memory issues? Because I need to order the values with in a group. i.e. stock tickers is the group and they need to be sorted on time.

          People

          • Assignee:
            Unassigned
            Reporter:
            Ted Malaska
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:

              Development