HCatalog
  1. HCatalog
  2. HCATALOG-397

Removal of unused parameter hadoop.clientside.fs.operations

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 0.4
    • Fix Version/s: 0.5
    • Component/s: documentation
    • Labels:

      Description

      More misc doc fixes

      • removing hadoop.clientside.fs.operations
      • adding bit about HIVE_AUX_JARS_PATH
      1. HCATALOG-397.patch
        2 kB
        Sushanth Sowmyan
      2. HCATALOG-397.patch.2
        3 kB
        Sushanth Sowmyan
      3. HCATALOG-397.patch.3
        5 kB
        Sushanth Sowmyan
      4. HCATALOG-397.patch.4
        2 kB
        Sushanth Sowmyan

        Issue Links

          Activity

          Hide
          Sushanth Sowmyan added a comment -

          update to account for removal of hadoop.clientside.fs.operations param in a couple other hive-site.xml templates as well.

          Show
          Sushanth Sowmyan added a comment - update to account for removal of hadoop.clientside.fs.operations param in a couple other hive-site.xml templates as well.
          Hide
          Alan Gates added a comment -

          A couple of comments:

          1. The issue with the JSON SerDe being in HCat instead of Hive doesn't apply only to the command line, but also to running Hive jobs with that table. It seems like we should highlight that somewhere in addition to your comments on the command line.
          2. Removing hadoop.clientside.fs.operations has side effects, and afaik we haven't tested the system without it. Why are you recommending it? That also makes this more than just a documentation patch.
          Show
          Alan Gates added a comment - A couple of comments: The issue with the JSON SerDe being in HCat instead of Hive doesn't apply only to the command line, but also to running Hive jobs with that table. It seems like we should highlight that somewhere in addition to your comments on the command line. Removing hadoop.clientside.fs.operations has side effects, and afaik we haven't tested the system without it. Why are you recommending it? That also makes this more than just a documentation patch.
          Hide
          Sushanth Sowmyan added a comment -

          1) Agreed, will do so.

          2) hadoop.clientside.fs.operations is not used anywhere, in hive or hcat code - it was a parameter we introduced when suggesting that filesystem operations occur on the clientside, but that patch wasn't accepted in to hive in the first place. We've just had it in our hive-site.xml for ages because we didn't remove it.

          Show
          Sushanth Sowmyan added a comment - 1) Agreed, will do so. 2) hadoop.clientside.fs.operations is not used anywhere, in hive or hcat code - it was a parameter we introduced when suggesting that filesystem operations occur on the clientside, but that patch wasn't accepted in to hive in the first place. We've just had it in our hive-site.xml for ages because we didn't remove it.
          Hide
          Sushanth Sowmyan added a comment -

          Updated. Usage from hive now has its own small section to highlight it.

          Show
          Sushanth Sowmyan added a comment - Updated. Usage from hive now has its own small section to highlight it.
          Hide
          Travis Crawford added a comment -

          On the mailing list we discussed the JsonSerDe and the plan is to migrate it to Hive.

          Can you update this patch to remove the stuff about using HCat features from Hive? Then we can check this in.

          Show
          Travis Crawford added a comment - On the mailing list we discussed the JsonSerDe and the plan is to migrate it to Hive. Can you update this patch to remove the stuff about using HCat features from Hive? Then we can check this in.
          Hide
          Travis Crawford added a comment -

          Canceling patch to clear up the "patch available" report. Please change back to "patch available" and we can take a look!

          Show
          Travis Crawford added a comment - Canceling patch to clear up the "patch available" report. Please change back to "patch available" and we can take a look!
          Hide
          Sushanth Sowmyan added a comment -

          Removed the fromhive bit, Now back to only removing hadoop.clientside.fs.ops parameter, changing jira title to reflect the same.

          Show
          Sushanth Sowmyan added a comment - Removed the fromhive bit, Now back to only removing hadoop.clientside.fs.ops parameter, changing jira title to reflect the same.
          Hide
          Travis Crawford added a comment -

          Looks good! I'll patch this into trunk.

          Jira protip: at least in Safari, files with a ".patch" extension open as a regular web page, while files with a number extension trigger a file download. For that reason naming files "HCATALOG-123.1.patch" is preferable over "HCATALOG-123.patch.1"

          Show
          Travis Crawford added a comment - Looks good! I'll patch this into trunk. Jira protip: at least in Safari, files with a ".patch" extension open as a regular web page, while files with a number extension trigger a file download. For that reason naming files " HCATALOG-123 .1.patch" is preferable over " HCATALOG-123 .patch.1"
          Hide
          Travis Crawford added a comment -

          Thanks for the doc update Sushanth Sowmyan!

          Show
          Travis Crawford added a comment - Thanks for the doc update Sushanth Sowmyan !

            People

            • Assignee:
              Sushanth Sowmyan
              Reporter:
              Sushanth Sowmyan
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development