Details

      Description

      I suggest we should move to Hadoop 0.20.203.0 for the next release. (Not 0.21 or further.) It is a much more recent branch of 0.20.x and is compile-time compatible with 0.20.2 in our code already.

      However I know already that switching to it causes some failures, in the Lanczos jobs for instances. Looks like something's expecting a file somewhere that isn't where it used to be. I bet it's an easy fix, but don't know what it is yet.

        Activity

        Suneel Marthi made changes -
        Component/s Frequent Itemset/Association Rule Mining [ 12313060 ]
        Sean Owen made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Sean Owen made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Sean Owen made changes -
        Summary Update to Hadoop 0.21 Update to Hadoop 0.20.203.0
        Fix Version/s 0.6 [ 12316364 ]
        Fix Version/s 1.0 [ 12316358 ]
        Affects Version/s 0.6 [ 12316364 ]
        Description I suggest we should move to Hadoop 0.21 for the next release. It is the current release, soon to be superseded by 0.22. It matches more closely what CDH3/4 users use. It has bug fixes, and crucially some features that make joins much less painful.

        The drawback is that EMR does not yet support it. I still suggest we forge ahead as one imagines it will be supported by the time we release 0.6.
        I suggest we should move to Hadoop 0.20.203.0 for the next release. (Not 0.21 or further.) It is a much more recent branch of 0.20.x and is compile-time compatible with 0.20.2 in our code already.

        However I know already that switching to it causes some failures, in the Lanczos jobs for instances. Looks like something's expecting a file somewhere that isn't where it used to be. I bet it's an easy fix, but don't know what it is yet.
        Sean Owen made changes -
        Field Original Value New Value
        Fix Version/s 1.0 [ 12316358 ]
        Fix Version/s 0.6 [ 12316364 ]
        Affects Version/s 0.6 [ 12316364 ]
        Sean Owen created issue -

          People

          • Assignee:
            Sean Owen
            Reporter:
            Sean Owen
          • Votes:
            1 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development