Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-363

impala-shell: console output better turned off if output_file option is used

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • Impala 1.0
    • Impala 1.0.1
    • Clients
    • (Shell build version: Impala Shell v1.0 (d1bf0d1) built on Sun Apr 28 15:33:52 PDT 2013)

    Description

      output_file option is very useful when doing batch job.
      but now console output is always on , so it is impossible to put impala-shell in a typical pipeline .

      my workaround is a patch impala_shell.py:530
      from

      526 try:
      527 map(table.add_row, rows)
      528 # Clear the rows that have been added. The goal is is to stream the table
      529 # in batch_size quantums.
      530 print table
      531 table.clear_rows()
      532 except Exception, e:

      to
      526 try:
      527 map(table.add_row, rows)
      528 # Clear the rows that have been added. The goal is is to stream the table
      529 # in batch_size quantums.
      530 if not self.output_writer:
      531 print table
      532 table.clear_rows()
      533 except Exception, e:

      Attachments

        Activity

          People

            ishaan Ishaan Joshi
            divergence@gmail.com Gin.Li
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: