Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-518

test mode in hive

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.4.0
    • Query Processor
    • None

    Description

      It would be good to have a test mode in hive - this will help in checking the validity of a hive drop on a production cluster.

      The following would be good to have:

      Testmode --> In testmode, all input tables are sampled (if not already sampled) and all output tables are prefixed by a user supplied name.
      This way, multiple hive drops can be compared quickly for correctness

      New Options:

      // whether hive is running in test mode. If yes, it turns on sampling and prefixes the output tablename
      set hive.test.mode=true;
      // if hive is running in test mode, prefixes the output table by this string
      set hive.test.mode.prefix=;
      // if hive is running in test mode and table is not bucketed, sampling frequency
      set hive.test.mode.samplefreq=256;
      // if hive is running in test mode, dont sample the above comma seperated list of tables
      set hive.test.mode.nosamplelist=;
      
      

      Attachments

        1. hive.518.1.patch
          13 kB
          Namit Jain
        2. hive.518.2.patch
          14 kB
          Namit Jain
        3. hive.518.3.patch
          15 kB
          Namit Jain
        4. hive.518.4.patch
          18 kB
          Namit Jain
        5. hive-518.5.patch
          19 kB
          Raghotham Murthy
        6. hive.518.6.patch
          20 kB
          Namit Jain
        7. hive.518.7.patch
          20 kB
          Namit Jain

        Activity

          People

            namit Namit Jain
            namit Namit Jain
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: