Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-118

Hudi CLI : Provide options for passing properties to Compactor, Cleaner and ParquetImporter

    XMLWordPrintableJSON

    Details

      Description

      For non-trivial CLI operations, we have a standalone script in hudi-utilities that users can call directly using spark-submit (usually). We also have commands in hudi-cli to invoke the commands directly from hudi-cli shell.

      There was an earlier effort to allow users to pass properties directly to the scripts in hudi-utilities but we still need to give the same functionality to the corresponding commands in hudi-cli.

      In hudi-cli, Compaction (schedule/compact), Cleaner and HDFSParquetImporter command does not have option to pass DFS properties file. This is a followup to PRĀ https://github.com/apache/incubator-hudi/pull/691

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Pratyaksh Pratyaksh Sharma
                Reporter:
                vbalaji Balaji Varadarajan
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m