diff --git CHANGES.txt CHANGES.txt deleted file mode 100644 index f849025..0000000 --- CHANGES.txt +++ /dev/null @@ -1,2886 +0,0 @@ -Hive Change Log - -Trunk - Unreleased - - INCOMPATIBLE CHANGES - - NEW FEATURES - - HIVE-1636. Implement 'SHOW TABLES {FROM | IN} db_name' (Jonathan Natkins via cws) - - HIVE-1790. Support HAVING clause in Hive (Vaibhav Aggarwal via cws) - - HIVE-1304. Add function row_sequence in contrib (John Sichi via namit) - - HIVE-1405. Add ability to run an initialization script by 'hive -i ' (John Sichi via namit) - - HIVE-1387. Add PERCENTILE_APPROX which works with double data type - (Mayank Lahiri via jvs) - - HIVE-1438. SENTENCES() UDF for natural language tokenization - (Mayank Lahiri via jvs) - - HIVE-1481. ngrams() UDAF for estimating top-k n-gram frequencies - (Mayank Lahiri via jvs) - - HIVE-1408. add option to let hive automatically run in local mode based on - tunable heuristics - (Joydeep Sen Sarma via Ning Zhang) - - HIVE-1126. Missiong some Jdbc functionality like getTables - getColumns and HiveResultSet.get* methods based on column name. - (Bennie Schut via jvs) - - HIVE-417. Implement Indexing in Hive - (He Yongqiang via jvs) - - HIVE-1414. Automatically invoke .hiverc init script - (Edward Capriolo via jvs) - - HIVE-1413. Ability to take a table offline - (Siying Dong via namit) - - HIVE-1514. API to change fileformat and location of a partition - (He Yongqiang via namit) - - HIVE-1528. JSON UDTF function - (Ning Zhang via jvs) - - HIVE-1529. Add ANSI SQL covariance aggregate functions: covar_pop - and covar_samp - (Pierre Huyn via jvs) - - HIVE-1518. context_ngrams() UDAF for estimating top-k contextual - n-grams - (Mayank Lahiri via jvs) - - HIVE-1549. Add ANSI SQL correlation function CORR(X,Y). - (Pierre Huyn via jvs) - - HIVE-1307. More generic and efficient merge - (Ning Zhang via namit) - - HIVE-1578. Add conf. variable for displaying link to task - with most failures (Paul Yang via namit) - - HIVE-1293. Concurrency Model for Hive - (Namit Jain via jvs) - - HIVE-675. Add database/schema support for Hive - (Carl Steinbach via namit) - - HIVE-471. Add a UDF for simple reflection - (Edward Capriolo via namit) - - HIVE-1598. Create an option to specify an option for the format of - intermediate results (Ning Zhang via namit) - - HIVE-1616. Add ProtocolsBufferStructObjectInspector - (Johan Oskarsson via namit) - - HIVE-1609. Support partition filtering in metastore - (Ajay Kidave via jvs) - - HIVE-1661. Default values for parameters - (Siying Dong via He Yongqiang) - - HIVE-1659. parse_url_tuple: a UDTF version of parse_url - (Xing Jin via Ning Zhang) - - HIVE-1361. table/partition level statistics - (Ning Zhang, Ahmed M Aly via He Yongqiang) - - HIVE-1624. Patch to allows scripts in S3 location - (Vaibhav Aggarwal via He Yongqiang) - - HIVE-1427. Add metastore schema migration scripts (0.5 -> 0.6) - (Carl Steinback via namit) - - HIVE-1546. Ability to plug custom Semantic Analyzers for Hive Grammar - (Ashutosh Chauhan via namit) - - HIVE-537. Hive TypeInfo/ObjectInspector to support union - (Amareshwari Sriramadasu via namit) - - HIVE-1709. Add Postgres metastore schema migration scripts (0.5 -> 0.6) - (Yuanjun Li via namit) - - HIVE-474 Support for distinct selection on two or more columns - (Amareshwari Sriramadasu via namit) - - HIVE-1779 Add udf str_to_map - (Siying Dong via namit) - - HIVE-1642 Convert join queries to map-join based on size of table/row - (Liyin Tang via namit) - - HIVE-1819 maintain lastAccessTime in the metastore - (namit via He Yongqiang) - - HIVE-1827 Add a new local mode flag in Task - (Liyin Tang via He Yongqiang) - - HIVE-1836 Extend CREATE DATABASE command with DBPROPERTIES - (Ning Zhang via namit) - - HIVE-1096 Hive variables (Edward Capriolo via namit) - - HIVE-1842 Track if a map-reduce job is running locally - (Liyin Tang via namit) - - HIVE-842 Authentication Infrastructure for Hive - (Ashutosh Chauhan via He Yongqiang) - - HIVE-1853 Downrgrade JDO (Paul Yang via namit) - - HIVE-1835 Better auto-complete for Hive - (Paul Butler via Ning Zhang) - - HIVE-1856 Implement DROP TABLE/VIEW IF EXISTS - (Marcel Kornacker via jvs) - - HIVE-1858 Implement DROP {PARTITION, INDEX, TEMPORARY FUNCTION} IF EXISTS - (Marcel Kornacker via jvs) - - HIVE-78 Authorization model for Hive - (Yongqiang He via namit) - - HIVE-1696 Add delegation token support to metastore - (Devaraj Das via namit) - - HIVE-1862 Revive partition filtering in the Hive MetaStore - (Mac Yang via pauly) - - HIVE-1923 Allow any type of stats publisher and aggregator in addition to - HBase and JDBC (Ning Zhang via namit) - - HIVE-1910 Provide config parameters to control cache object pinning - (Mac Yang via namit) - - HIVE-1820 Make Hive database data center aware - (Ning Zhang via namit) - - HIVE-1929 A way to disable owner grants - (He Yongqiang via namit) - - HIVE-1935 set hive.security.authorization.createtable.owner.grants to null - by default (He Yongqiang via namit) - - HIVE-1936 hive.semantic.analyzer.hook cannot have multiple values - (Siying Dong via namit) - - HIVE-1956 Provide DFS initialization script for Hive - (Bruno Mahe via namit) - - HIVE-1961 Make Stats gathering more flexible with timeout and atomicity - (Ning Zhang via namit) - - HIVE-1900 a mapper should be able to span multiple partitions - (namit via He Yongqiang) - - HIVE-1818 Call frequency and duration metrics for HiveMetaStore via jmx - (Sushanth Sowmyan via pauly) - - HIVE-1971 Verbose/echo mode for the Hive CLI - (Jonathan Natkins via Ning Zhang) - - HIVE-1948 Add audit logging in the metastore - (Devaraj Das via namit) - - IMPROVEMENTS - - HIVE-1962 Make a libthrift.jar and libfb303.jar in dist package for backward compatibility (Ning Zhang via cws) - - HIVE-1235 use Ivy for fetching HBase dependencies (John Sichi via cws) - - HIVE-1931 Improve the implementation of the METASTORE_CACHE_PINOBJTYPES config (Mac Yang via cws)" - - HIVE-1692. FetchOperator.getInputFormatFromCache hides causal exception (Philip Zeyliger via cws) - - HIVE-1899 Add a factory method for creating a synchronized wrapper for IMetaStoreClient (John Sichi via cws) - - HIVE-1852 Reduce unnecessary DFSClient.rename() calls (Ning Zhang via jssarma) - - HIVE-1712. Migrating metadata from derby to mysql thrown NullPointerException (Jake Farrell via pauly) - - HIVE-1394. Do not update transient_lastDdlTime if the partition is modified by a housekeeping - operation (Ning Zhang via namit) - - HIVE-1430. Dont run serialize plan by default (Ning Zhang via namit) - - HIVE-1443. Add an API to turn off bucketing (Paul Yang via namit) - - HIVE-1447. Speed up reflection method calls (Zheng via He Yongqiang) - - HIVE-1462. Report progress in FileSinkOperator works in multiple directory - case - (Siying Dong via Ning Zhang) - - HIVE-1469. replace isArray() calls and remove LOG.isInfoEnabled() in - Operator.forward() - (Yongqiang He via Ning Zhang) - - HIVE-1463. Hive output file names are unnecessarily large - (Joydeep Sen Sarma via Ning Zhang) - - HIVE-1229. Replace dependencies on HBase deprecated API. - (Basab Maulik via jvs) - - HIVE-1513. hive starter scripts should load admin/user supplied script for - configurability - (Joydeep Sen Sarma via Ning Zhang) - - HIVE-1495. supply correct information to hooks and lineage for - index rebuild - (He Yongqiang via jvs) - - HIVE-1512. Need to get hive_hbase-handler to work with hbase - versions 0.20.4 0.20.5 and cloudera CDH3 version - (Basab Maulik via jvs) - - HIVE-1581. CompactIndexInputFormat should create split only for files in the index output file - (He Yongqiang via namit) - - HIVE-1441. Extend ivy offline mode to cover metastore downloads - (John Sichi via Ning Zhang) - - HIVE-1523. Enable some tests in miniMR mode - (Joydeep Sen Sarma via namit) - - HIVE-1536. Add support for JDBC PreparedStatements - (Sean Flatley via jvs) - - HIVE-1580. Cleanup ExecDriver.progress - (Joydeep Sen Sarma via namit) - - HIVE-1614. UDTF json_tuple should return null row when input is not a valid - JSON string (Ning Zhang via namit) - - HIVE-1645. ability to specify parent directory for zookeeper lock manager - (namit via He Yongqiang) - - HIVE-1617. ScriptOperator's AutoProgressor can lead to an infinite loop - (Paul Yang via namit) - - HIVE-1226. support filter pushdown against non-native tables - (jvs via He Yongqiang) - - HIVE-558. Make describe output better - (Thiruvel Thirumoolan via namit) - - HIVE-1628. Fix Base64TextInputFormat to be compatible with commons - codec 1.4 - (Todd Lipcon via jvs) - - HIVE-1378. Return value for map, array, and struct needs to return a string - (Steven Wong via Ning Zhang) - - HIVE-1364 Increase the maximum length of various metastore fields, and - remove TYPE_NAME from COLUMNS primary key (Carl Steinbach via namit) - - HIVE-1693 Make the compile target depend on thrift.home - (Eli Collins via namit) - - HIVE-1697. Migration scripts should increase size of PARAM_VALUE in - PARTITION_PARAMS (Paul Yang via namit) - - HIVE-1264. Make Hive work with Hadoop security - (Todd Lipcon via jvs) - - HIVE-1701. drop support for pre-0.20 Hadoop versions - (jvs via Ning Zhang) - - HIVE-1704. remove Hadoop 0.17 specific test reference logs - (jvs via Ning Zhang) - - HIVE-1638. convert commonly used udfs to generic udfs - (Siying Dong via namit) - - HIVE-1660. Change get_partitions_ps to pass partition filter to - database (Paul Yang via namit) - - HIVE-1738. Optimize key comparison in groupby - (Siying Dong via namit) - - HIVE-1749. ExecMapper and ExecReducer reduce function calls to l4j.isInfoEnabled() - (Siying Dong via namit) - - HIVE-1641. add map joined table to distributed cache - (Liyin Tang via He Yongqiang) - - HIVE-1498. support IDXPROPERTIES on CREATE INDEX - (Marquis Wang via jvs) - - HIVE-1761. Support show locks for a particular table - (namit via He Yongqiang) - - HIVE-1751. Optimize ColumnarStructObjectInspector.getStructFieldData() - (Siying Dong via namit) - - HIVE-1750 Remove partition filtering conditions when possible - (Siying Dong via namit) - - HIVE-1768 Update transident_lastDdlTime only if not specified - (Paul Yang via namit) - - HIVE-1765 Add queryid while locking - (namit via He Yongqiang) - - HIVE-1743 Compare from the end for GroupBy - (Siying Dong via namit) - - HIVE-1758 Reduce memory for groupby map-side hashmap - (Siying Dong via namit) - - HIVE-1754 Remove JDBM component from Map Join - (Liyin via He Yongqiang) - - HIVE-1782 add more debug information for hive locking - (namit via He Yongqiang) - - HIVE-1786 Better documentation for udf str_to_map - (Siying Dong via namit) - - HIVE-1497 support COMMENT clause on CREATE INDEX, and add new - command for SHOW INDEXES - (Russell Melick via jvs) - - HIVE-1783 optimize join code path in the scenario where there is 1 value for a key - (Siying Dong via namit) - - HIVE-1796 dumps time at which lock was taken along with the queryid in show locks extended - (namit via He Yongqiang) - - HIVE-1746 Support for using ALTER to set IDXPROPERTIES - (Marquis Wang via jvs) - - HIVE-1787 optimize the code path when there are no outer joins - (Siying Dong via namit) - - HIVE-1801 HiveInputFormat or CombineHiveInputFormat always sync blocks of RCFile twice - (Siying Dong via He Yongqiang) - - HIVE-1785 change Pre/Post Query Hooks to take in 1 parameter: HookContext - (Liyin Tang via jvs) - - HIVE-1810 doc followup to HIVE-1785 - (Liyin Tang via jvs) - - HIVE-1797 Compressed the hashtable dump file before put into distributed cache - (Liyin Tang via He Yongqiang) - - HIVE-138 Provide option to export a HEADER - (Paul Butler via He Yongqiang) - - HIVE-1834 more debugging for locking - (namit via He Yongqiang) - - HIVE-1415: add CLI command for executing a SQL script - (Edward Capriolo via jvs) - - HIVE-1855 Include Process ID in the log4j log file name - (Ning Zhang via namit) - - HIVE-1878 Set the version of Hive trunk to '0.7.0-SNAPSHOT' to avoid - confusing it with a release - (Carl Steinbach via jvs) - - HIVE-1907 Store jobid in ExecDriver - (namit via He Yongqiang) - - HIVE-1865 redo zookeeper hive lock manager - (namit via He Yongqiang) - - HIVE-1978 Hive SymlinkTextInputFormat does not estimate input size correctly - (He Yongqiang via Ning Zhang) - - HIVE-1896 HBase and Contrib JAR names are missing version numbers - (Carl Steinbach via jvs) - - OPTIMIZATIONS - - BUG FIXES - - HIVE-1915. Authorization on database level is broken. - (He Yongqiang via cws) - - HIVE-1203. HiveInputFormat.getInputFormatFromCache "swallows" cause exception when trowing IOExcpetion - (Vladimir Klimontovich via cws) - - HIVE-1524. Parallel Execution fails if mapred.job.name is set - (Ning Zhang via jssarma) - - HIVE-1509. Hive should kill query if too many files are created by it - (Ning Zhang via jssarma) - - HIVE-1471. CTAS should unescape column names in select-clause - (Ning Zhang via jssarma) - - HIVE-1440. Bug in RCFiles with local work (map-join or sort-merge join) - (He Yongqiang via namit) - - HIVE-1454. insert overwrite and CTAS fail in hive local mode - (Joydeep Sen Sarma via He Yongqiang ) - - HIVE-1305. add progress in join and groupby - (Siying Dong via He Yongqiang) - - HIVE-1453. Make Eclipse launch tempaltes auto-adjust to Hive - version number changes. - (Arvind Prabhakar via jvs) - - HIVE-1056. Predicate push down does not work with UDTF's - (Paul Yang via He Yongqiang) - - HIVE-1385. UDF field() doesn't work - (Siying Dong via He Yongqiang) - - HIVE-1455. lateral view does not work with column pruning - (Paul Yang via He Yongqiang) - - HIVE-1470. percentile_approx() fails with more than 1 reducer - (Mayank Lahiri via jvs) - - HIVE-1425. hive.task.progress should be added to conf/hive-default.xml - (John Sichi via Ning Zhang) - - HIVE-1492. FileSinkOperator should remove duplicated files from the same task based on file sizes - (Ning Zhang via He Yongqiang) - - HIVE-1491. fix or disable loadpart_err.q - (John Sichi via He Yongqiang) - - HIVE-1411. DataNucleus throws NucleusException if core-3.1.1 JAR - appears more than once on CLASSPATH - (Carl Steinbach via jvs) - - HIVE-1494. Index followup: remove sort by clause and fix a bug in - collect_set udaf - (He Yongqiang via jvs) - - HIVE-1422 (2nd trial). skip counter update when RunningJob.getCounters() - returns null - (Joydeep Sen Sarma via Ning Zhang) - - HIVE-1535 Dont change table metadata while changing partition metadata - (He Yongqiang via namit) - - HIVE-1532 Replace globStatus with listStatus inside Hive.java's replaceFiles - (He Yongqiang via namit) - - HIVE-1543 Abort in ExecMapper when record reader's next gets a exception - (Ning Zhang via namit) - - HIVE-1547 Unarchiving operation throws NPE - (Paul Yang via namit) - - HIVE-1548 populate inputs and outputs for all statement - (namit via He Yongqiang) - - HIVE-1556. tests broken - (namit via Ning Zhang) - - HIVE-1563. tests broken - (John Sichi via namit) - - HIVE-1564. bucketizedhiveinputformat does not work in minimr mode - (He Yongqiang via namit) - - HIVE-1561. test bug: smb_mapjoin*.q should use bucketizedhiveinputformat - (He Yongqiang via namit) - - HIVE-1510. HiveCombineInputFormat should not use prefix matching to find - the partitionDesc for a given path - (He Yongqiang via Ning Zhang) - - HIVE-1584. wrong log files in contrib client positive - (namit via He Yongqiang) - - HIVE-1589. Add HBase/ZK JARs to Eclipse classpath - (Carl Steinbach via jvs) - - HIVE-741. NULL is not handled correctly in join - (Amareshwari Sriramadasu via Ning Zhang) - - HIVE-1593. Add test file udtf_explode - (Carl Steinbach via namit) - - HIVE-1594. Typo of hive.merge.size.smallfiles.avgsize prevents - change of value. (Yun Huang Yong via namit) - - HIVE-1600. Making test outputs deterministic by sorting inputs and outputs in hooks - (John Sichi via namit) - - HIVE-1605. Regression and improvements in handling NULLs in joins - (Ning Zhang via namit) - - HIVE-1607. Reinstate and deprecate IMetaStoreClient methods removed - in HIVE-675 - (Carl Steinbach via Ning Zhang) - - HIVE-1622. Use map-only task to merge if available - (Ning Zhang via namit) - - HIVE-1630. Bug in NO_DROP - (Siying Dong via namit) - - HIVE-1629. Patch to fix hashCode method in DoubleWritable class - (Vaibhav Aggarwal via Ning Zhang) - - HIVE-1622. Bug in updating log file for hadoop 17 - (Ning Zhang via namit) - - HIVE-1639 ExecDriver.addInputPaths() error if partition name contains a comma - (Ning Zhang via namit) - - HIVE-1650. TestContribNegativeCliDriver fails - (namit via He Yongqiang) - - HIVE-1656. All TestJdbcDriver test cases fail in Eclipse unless a - property is added in run config - (Steven Wong via jvs) - - HIVE-1534. Join filters do not work correctly with outer joins - (Amareshwari Sriramadasu via namit) - - HIVE-1655. Adding consistency check at jobClose() when committing dynamic - partitions (Ning Zhang via namit) - - HIVE-1664. Eclipse build broken - (Steven Wong via jvs) - - HIVE-1671 multithreading on Context.pathToCS - (Bennie Schut via namit) - - HIVE-1670 MapJoin throws an error if no column from the mapjoined table is selected - (Ning Zhang via namit) - - HIVE-1673 Create table bug causes the row format property lost when serde is specified - (He Yongqiang via namit) - - HIVE-1678 Bug in mapjoin followed by another mapjoin - (Amareshwari Sriramadasu via namit) - - HIVE-1691 Validate partition spec in analyze - (Ning Zhang via namit) - - HIVE-1674 count(*) returns wrong result when a mapper returns empty results - (Ning Zhang via He Yongqiang) - - HIVE-1376 Simple UDAFs with more than 1 parameter crash on empty row query - (Ning Zhang via He Yongqiang) - - HIVE-1699 Incorrect partition pruning ANALYZE TABLE - (Ning Zhang via namit) - - HIVE-1713 Duplicated MapRedTask in Multi-table inserts mixed with FileSinkOperator - and ReduceSinkOperator (Ning Zhang via namit) - - HIVE-307 "LOAD DATA LOCAL INPATH" fails when the table already contains a file of - the same name (Kirk True via namit) - - HIVE-1681. ObjectStore.commitTransaction() does not properly handle transactions - that have already been rolled back - (Carl Steinbach via Ning Zhang) - - HIVE-1717. ant clean should delete stats database - (Ning Zhang via namit) - - HIVE-1707. Bug when different partitions are present in different dfs - (Yongqiang He via namit) - - HIVE-1720. hbase_stats.q is failing - (Ning Zhang via jvs) - - HIVE-1711. CREATE TABLE LIKE should not set stats in the new table - (Ning Zhang via namit) - - HIVE-1633. CombineHiveInputFormat fails with "cannot find dir for emptyFile" - (Sreekanth Ramakrishnan via He Yongqiang) - - HIVE-1737. Bug in computing row size for map side hash table in group by - (Siying Dong via Namit Jain) - - HIVE-1742. Fix Eclipse templates (and use Ivy metadata to generate - Eclipse library dependencies) - (Carl Steinbach via jvs) - - HIVE-1748 Statistics broken for tables with size in excess of Integer.MAX_VALUE - (Paul Butler via namit) - - HIVE-1755 Update broken test outputs due to 1641 - (He Yongqiang via namit) - - HIVE-1757 Test cleanup for 1641 - (Liyin Tang via namit) - - HIVE-1756 Negative Test cleanup for 1641 - (Liyin Tang via namit) - - HIVE-1657 Join results are displayed wrongly for some complex joins - using select * (Amareshwari Sriramadasu via namit) - - HIVE-1760 Mismatched open/commit transaction calls in case of connection retry - (Paul Yang via namit) - - HIVE-1753 CombineHiveInputFormat bug - (Thiruvel Thirumoolan via He Yongqiang) - - HIVE-1767 Bug in merging files for dynamic partitions - (He Yongqiang via namit) - - HIVE-1769 Bug in test pcr.q - (Siying Dong via namit) - - HIVE-1774 Bug in test merge_dynamic_partition.q - (He Yongqiang via namit) - - HIVE-1777 Outdated comments for GenericUDTF.close() - (Paul Yang via jvs) - - HIVE-1771 Fix bug in UDF round - (John Sichi via namit) - - HIVE-1501 when generating reentrant INSERT for index rebuild, - quote identifiers using backticks - (Skye Berghel via jvs) - - HIVE-1780 Typo in hive-default.xml - (Youngwoo Kim via namit) - - HIVE-1776 parallel execution and auto-local mode combine to place - plan file in wrong file system (Joydeep Sen Sarma via namit) - - HIVE-1583 Hive cannot overwrite HADOOP_CLASSPATH - (Thiruvel Thirumoolan via namit) - - HIVE-1781 outputs not populated for dynamic partitions at compile time - (namit via He Yongqiang) - - HIVE-1794 Bug in AND and OR if they return boolean/string - (Siying Dong via namit) - - HIVE-1795 outputs not correctly populated for alter table - (namit via He Yongqiang) - - HIVE-1807 No Element found exception in BucketMapJoinOptimizer - (He Yongqiang via Ning Zhang) - - HIVE-1809 Hive Comparison Operators are broken for NaN values - (Paul Butler via Ning Zhang) - - HIVE-1808 Wrong parameter names in HiveConf/hive-default.xml - for joins (Liyin Tang via namit) - - HIVE-1792 Track the joins which are being converted to map-join - automatically (Liyin Tang via namit) - - HIVE-1804 Mapjoin will fail if there are no files associating with the join tables - (Liyin Tang via He Yongqiang) - - HIVE-1811 Show the time the local task takes - (Liyin Tang via He Yongqiang) - - HIVE-1824 Create a new ZooKeeper instance when retrying lock - (He Yongqiang via namit) - - HIVE-1828 No need to get Table/Partition for show locks. - (He Yongqiang via namit) - - HIVE-1823 upgrade the database thrift interface to allow parameters key-value - pairs (Ning Zhang via namit) - - HIVE-1508 Add cleanup method for HiveHistory - (Edward Capriolo via namit) - - HIVE-1830 Mappers in group by followed by map-join may die OOM - (Liyin Tang via namit) - - HIVE-1844 Hanging hive client due to OOM error - (He Yongqiang via namit) - - HIVE-1843 Add an option in dynamic partition inserts to throw an error if - 0 partitions are created (Ning Zhang via namit) - - HIVE-1846 Hive should not assume that local mode mappers run in same JVM - (rvadali via jssarma) - - HIVE-1849 add more logging to partition pruning - (namit via He Yongqiang) - - HIVE-1848 Bug in MAPJOIN with hints - (He Yongqiang via namit) - - HIVE-1845 Some attributes in eclipse template file are deprecated - (Liyin Tang via namit) - - HIVE-1854 Temporarily disable metastore tests for listPartitionsByFilter() - (Paul Yang via namit) - - HIVE-1857 mixed case tablename on lefthand side of LATERAL VIEW results in - query failing with confusing error message (John Sichi via pauly) - - HIVE-1456 No need to check for LOG as null in sort-merge join - (Alexey Diomin via namit) - - HIVE-1806 Merge per dynamic partition based on size of each dynamic partition - (Ning Zhang via namit) - - HIVE-1864 Fix test load_overwrite..q - (Carl Steinbach via namit) - - HIVE-1870 Add TestRemoveHiveMetaStore deleted accidently - (Carl Steinbach via namit) - - HIVE-1873 Fix 'tar' build target broken in HIVE-1526 - (Carl Steinbach via namit) - - HIVE-1874 fix HBase filter pushdown broken by HIVE-1638 - (John Sichi via namit) - - HIVE-1871 Bug in merging dynamic partitions introduced by HIVE-1806 - (He Yongqiag via namit) - - HIVE-1881 Add an option to use FsShell to delete dir in warehouse - (He Yongqiang via namit) - - HIVE-1840 Support ALTER DATABASE to change database properties - (Ning Zhang via namit) - - HIVE-1889 add an option (hive.index.compact.file.ignore.hdfs) - to ignore HDFS location stored in index files - (Yongqiang He via namit) - - HIVE-1903 Can't join HBase tables if one's name is the beginning of - the other (John Sichi via namit) - - HIVE-1912 Double escaping special chars when removing old partitions - in rmr (Ning Zhang via namit) - - HIVE-1913 use partition level serde properties - (Yongiang He via namit) - - HIVE-1917 CTAS (create-table-as-select) throws exception when showing - results (Ning Zhang via namit) - - HIVE-1897 Alter command execution "when HDFS is down" results in holding - stale data in MetaStore (Chinna Rao Lalam via namit) - - HIVE-1908 FileHandler leak on partial iteration of the resultset - (Chinna Rao Lalam via namit) - - HIVE-1934 Alter table rename messes the location - (Paul Yang via namit) - - HIVE-1944 Dynamic partition insert creating different directories for the - same partition during merge (Ning Zhang via namit) - - HIVE-1716 Make TestHBaseCliDriver use dynamic ports to avoid conflicts with - already-running services (John Sichi via namit) - - HIVE-1951 input16_cc.q is failing in testminimrclidriver - (He Yongqiang via namit) - - HIVE-1964 Add fully deterministic ORDER BY in test union22.q and input40.q - (John Sichi via namit) - - HIVE-1979 set hive.input.format in hbase_bulk.m - (John Sichi via namit) - - TESTS - - HIVE-1464. improve test query performance - (Joydeep Sen Sarma via Ning Zhang) - - HIVE-1475. .gitignore files being placed in test warehouse directories - causing build failure - (Joydeep Sen Sarma via Ning Zhang) - - HIVE-1489. TestCliDriver -Doverwrite=true does not put the file in - the correct directory - (Ning Zhang via jvs) - - HIVE-1601. Hadoop 0.17 ant test broken by HIVE-1523 - (Joydeep Sen Sarma via jvs) - - HIVE-1658. Fix describe [extended] column formatting - (Thiruvel Thirumoolan via Ning Zhang) - - HIVE-1829. Fix intermittent failures in TestRemoteMetaStore - (Carl Steinbach via jvs) - - HIVE-1927. Fix TestHadoop20SAuthBridge failure on Hudson - (Devaraj Das via jvs) - - HIVE-1942. change the value of hive.input.format to CombineHiveInputFormat for tests - (namit via He Yongqiang) - - HIVE-1952. fix some outputs and make some tests deterministic - (namit via He Yongqiang) - - HIVE-1970. Modify build to run all tests regardless of subproject failures. - (Carl Steinbach via jvs) - - HIVE-1969. TestMinimrCliDriver merge_dynamic_partition2 and 3 are failing - on trunk - (Ning Zhang via jvs) - - HIVE-1465. hive-site.xml ${user.name} not replaced for local-file derby - metastore connection URL - (Carl Steinbach via jvs) - - TASKS - - HIVE-1526. Hive should depend on a release version of Thrift - (Carl Steinbach via Ning Zhang) - -Release 0.6.0 - 2010-10-19 - - INCOMPATIBLE CHANGES - - NEW FEATURES - - HIVE-964. Handle skew join - (Yongqiang He via namit) - - HIVE-972. Support views. (John Sichi via zshao) - - HIVE-1172. Add UDFS to create struct (Zheng Shao via Ning Zhang) - - HIVE-894. add udaf max_n, min_n to contrib (Zheng Shao via Yongqiang He) - - HIVE-1152. Add metastore API method to drop/append partition by name. - (Paul Yang via zshao) - - HIVE-1147. Update Eclipse project configuration to match Checkstyle - (Carl Steinbach via zshao) - - HIVE-1117. Make queryPlan serializable - (Zheng Shao via namit) - - HIVE-917. Bucketed Map Join - (He Yongqiang via namit) - - HIVE-1178. enforce bucketing for a table. - (Namit Jain via He Yongqiang) - - HIVE-1188. NPE when TestJdbcDriver/TestHiveServer - (Call Steinbach via Ning Zhang) - - HIVE-1032. Better Error Messages for Execution Errors. - (Paul Yang via zshao) - - HIVE-1193. ensure sorting properties for a table. - (Namit via He Yongqiang) - - HIVE-259. Add PERCENTILE aggregate function. - (Jerome Boulon, Zheng via He Yongqiang) - - HIVE-1197. Add BucketizedHiveInputFormat - (Siying Dong via namit) - - HIVE-1194. Add sort merge join - (He Yongqiang via namit) - - HIVE-705. Read HBase tables via Hive - (John Sichi via namit) - - HIVE-1027. Create UDFs for XPath expression evaluation - (Patrick Angeles via Ning Zhang) - - HIVE-1238. Get Partitions with a partial specification - (Paul Yang via Ning Zhang) - - HIVE-1244. add backward-compatibility constructor to HiveMetaStoreClient - (John Sichi via Ning Zhang) - - HIVE-1219. Robust handling of metastore connection failures - (Paul Yang via namit) - - HIVE-1272. Add SymlinkTextInputFormat to Hive. - (Guanghao Shen via zshao) - - HIVE-1131. Add column lineage information to the pre execution hooks - (Ashish Thusoo via namit) - - HIVE-1300. alter table touch partition - (Paul Yang via namit) - - HIVE-1295. facilitate HBase bulk loads from Hive - (John Sichi via namit) - - HIVE-1002. multi-partition inserts - (Ning Zhang via namit) - - HIVE-801. Add support for row-wise IN - (Paul Yang via namit) - - HIVE-1351. rcfilecat for debugging - (Yongqiang He via namit) - - HIVE-1332. Support for archiving partitions - (Paul Yang via namit) - - HIVE-1397. histogram_numeric UDAF - (Mayank Lahiri via jvs) - - HIVE-1179. Add UDF array_contains - (Arvind Prabhakar via namit) - - HIVE-543. Add local mode execution in hive - (Joydeep Sen Sarma via namit) - - HIVE-1255. Add mathematical UDFs PI, E, degrees, radians, tan, - sign, and atan. (Edward Capriolo via jvs) - - HIVE-287. Support count(*) and count distinct on multiple columns - (Arvind Prabhakar via jvs) - - IMPROVEMENTS - HIVE-983. Function from_unixtime takes long. - (Ning Zhang via zshao) - - HIVE-990. Incorporate CheckStyle into Hive's build.xml. - (Carl Steinbach via zshao) - - HIVE-1081. Automated source code cleanup - Part 1. - (Carl Steinbach via zshao) - - HIVE-1081. Automated source code cleanup - Part 2 - serde. - (Carl Steinbach via zshao) - - HIVE-1081. Automated source code cleanup - Part 3 - ql. - (Carl Steinbach via zshao) - - HIVE-1084. Capitalize first letter of class names. - (Carl Steinbach via zshao) - - HIVE-1112. Replace instances of StringBuffer and Vector with StringBuilder - and ArrayList. (Carl Steinbach via zshao) - - HIVE-1105. Add service script for starting metastore server. - (John Sichi via zshao) - - HIVE-1109. Structured temporary directories - (Zheng Shao via Ning Zhang) - - HIVE-1068. CREATE VIEW followup: add a 'table type' enum attribute in - metastore's MTable. (John Sichi via zshao) - - HIVE-1104. Suppress Checkstyle warnings for generated files. - (Carl Steinbach via zshao) - - HIVE-1128. Let max/min handle complex types like struct - (Zheng Shao via Ning Zhang) - - HIVE-1103. Add .gitignore file. (Carl Steinbach via zshao) - - HIVE-1132. Add metastore API method to get partition by name. - (Paul Yang via zshao) - - HIVE-1120. In ivy offline mode, don't delete downloaded jars. - (John Sichi via zshao) - - HIVE-862. CommandProcessor should return DriverResponse. - (Bill Graham via zshao) - - HIVE-1123. Checkstyle fixes. (Carl Steinbach via zshao) - - HIVE-1150. Add comment to explain why we check for dir first in add_partitions(). - (Paul Yang via zshao) - - HIVE-1122. Make ql/metadata/Table and Partition serializable - (Zheng Shao via He Yongqiang) - - HIVE-1158. Introducing a new parameter for Map-side join bucket size. - (Ning Zhang via zshao) - - HIVE-1136. Add type-checking setters for HiveConf class. - (John Sichi via zshao) - - HIVE-1181. Make it optional to check file format. (Yongqiang He via zshao) - - HIVE-1182. Fix TestCliDriver too many open file error. - (Zheng Shao via Ning Zhang) - - HIVE-1190. Configure build to download Hadoop tarballs from Facebook mirror. - (John Sichi via zshao) - - HIVE-1195. Increase ObjectInspector[] length on demand - (Zheng Shao via Ning Zhang) - - HIVE-1137. Fix build.xml for references to IVY_HOME. - (Carl Steinbach via zshao) - - HIVE-1212. Explicitly say "Hive Internal Error" to ease debugging - (Zheng Shao via Ning Zhang) - - HIVE-1216. Show the row with error in mapper/reducer - (Zheng Shao via He Yongqiang) - - HIVE-1246. Map join followde by another map join runs in a single map-only job - (He Yongqiang via namit) - - HIVE-1220. accept TBLPROPERTIES on CREATE TABLE/VIEW - (John Sichi via namit) - - HIVE-1258. Disable merge files when bucketing/sorting is being enforced - (He Yongqiang via namit) - - HIVE-1270. Thread pool size in Thrift metastore server should be - configurable (Paul Yang via namit) - - HIVE-1278. Partition name to values conversion conversion method - (Paul Yang via namit) - - HIVE-1276. Remove extra reducesink if it is already followed by a reduce sink - (He Yongqiang via namit) - - HIVE-1296. CLI set and set -v commands should dump properties in - alphabetical order (John Sichi via Ning Zhang) - - HIVE-1306. cleanup the JobScratchDir - (Namit Jain via Ning Zhang) - - HIVE-1349. Do not pull counters of non initialized jobs. - (Dmytro Molkov via Ning Zhang) - - HIVE-1198. When checkstyle is activated for Hive in Eclipse environment, - it shows all checkstyle problems as errors. - (Arvind Prabhakar via Ning Zhang) - - HIVE-1355. Hive should use NullOutputFormat for hadoop jobs - (Joydeep Sen Sarma via namit) - - HIVE-1372. New algorithm for variance() UDAF - (Mayank Lahiri via jvs) - - HIVE-1228. allow HBase key column to be anywhere in Hive table - (John Sichi via Ning Zhang) - - HIVE-1410. Add TCP keepalive option for metastore server - (Paul Yang via Ning Zhang) - - HIVE-1383. Allow HBase WAL to be disabled. - (John Sichi via Ning Zhang) - - HIVE-1359. Unit test should be shim-aware - (Ning Zhang via jvs) - - HIVE-1135. Use Anakia for version controlled documentation - (Edward Capriolo via jvs) - - HIVE-1401. Web Interface can only browse default - (Edward Capriolo via jvs) - - HIVE-1531. Make Hive build work with Ivy versions < 2.1.0 - (Carl Steinbach via jvs) - - HIVE-1725. Include metastore upgrade scripts in release tarball - (Carl Steinbach via jvs) - - HIVE-1726. Update README file for 0.6.0 release - (Carl Steinbach via jvs) - - HIVE-1729. Satisfy ASF release management requirements - (Carl Steinbach via jvs) - - HIVE-1736. Remove "-dev" suffix from release package name and - generate MD5 checksum using Ant (Carl Steinbach via jvs) - - OPTIMIZATIONS - - HIVE-1348. Move inputFileChanged() from ExecMapper to where it is needed - (Ning Zhang via namit) - - BUG FIXES - - HIVE-1047. Merge tasks in GenMRUnion1 - (Ning Zhang via namit) - - HIVE-1048. Make output of TestParse determinisitc - (Paul Yang via namit) - - HIVE-1045. (bigint % int) should return bigint instead of double. - (Paul Yang via zshao) - - HIVE-1046. Pass build.dir.hive and other properties to subant - (Zheng Shao via namit) - - HIVE-1066. Fix test outputs serde_typedbytes*.q - (Zheng Shao via namit) - - HIVE-1064. Null Pointer Exception in Hive CLI in distributed mode - (Carl Steinbach via Ning Zhang) - - HIVE-1075. Make it possible for users to recover data when moveTask fails - (Zheng Shao via Ning Zhang) - - HIVE-1072. Show table extended to error out when the partition does not exist. - (Yongqiang He via zshao) - - HIVE-1085. ColumnarSerde should not be the default Serde when user - specified a fileformat using 'stored as' (Yongqiang He via Ning Zhang) - - HIVE-1086. Add "-Doffline=true" option to ant. (Zheng Shao via Ning Zhang) - - HIVE-1094. Disable streaming last table if there is a skew key in - previous tables. (He Yongqiang via namit) - - HIVE-1097. Increase memory for groupby_bigdata.q for intermittent OOM - (Paul Yang via namit) - - HIVE-763. getSchema returns invalid column names, getThriftSchema does - not return old style string schemas (John Sichi via namit) - - HIVE-1102. make number of concurrent tasks configurable - (He Yongqiang via namit) - - HIVE-1069. CREATE VIEW followup: find and document current expected - version of thrift (John Sichi via namit) - - HIVE-898. Hive ODBC build fails on OSX. - (Carl Steinbach and Ning Zhang via zshao) - - HIVE-1108. Make QueryPlan serializable - (Zheng Shao via namit) - - HIVE-1093. Add a "skew join map join size" variable to control the - input size of skew join's following map join job - (He Yongqiang via namit) - - HIVE-1110. Add a counter to denote that skewjoin got triggered - (He Yongqiang via namit) - - HIVE-1092. Add job counter for conditional tasks - (He Yongqiang via namit) - - HIVE-1119. Serialize all tasks (Zheng Shao via namit) - - HIVE-1118. Change default size of average size to 16M - (Zheng Shao via namit) - - HIVE-1121. Support CombineHiveInputFormat for hadoop 0.19 - (Roberto Congiu via namit) - - HIVE-1125. Correct console output message. - (Paul Yang via namit) - - HIVE-1124. Create view should expand the query text consistently. - (John Sichi via zshao) - - HIVE-1129. Fix assertion in ExecDriver.execute. (John Sichi via zshao) - - HIVE-1141. Remove recursive call in FetchOperator.getNextRow. - (Zheng Shao via He Yongqiang) - - HIVE-1140. Fix incorrect ambiguous column reference error message. - (Paul Yang via zshao) - - HIVE-1142. Fix datanucleus typos in conf/hive-default.xml. - (Paul Yang via zshao) - - HIVE-1164. Fix drop_partition_by_name. (Paul Yang via zshao) - - HIVE-1167. Use TreeMap instead of Property to make explain extended - deterministic - (Zheng Shao via Ning Zhang) - - HIVE-1174. Fix Job counter error if "hive.merge.mapfiles" equals true. - (Yongqiang He via zshao) - - HIVE-1163. Eclipse launchtemplate changes to enable debugging. - (Ning Zhang and Carl Steinbach via zshao) - - HIVE-1134. Bucketed Map Join bug fix - (He Yongqiang via namit) - - HIVE-1183. hive.hwi.war.file vanished from hive-default.xml - (Zheng Shao via namit) - - HIVE-1185. Fix RCFile resource leak when opening a non-RCFile. - (He Yongqiang via zshao) - - HIVE-1184. Fix Expression Not In Group By Key error. - (Paul Yang via zshao) - - HIVE-1200. Fix CombineHiveInputFormat - (Zheng Shao via namit) - - HIVE-1204. typedbytes: writing to stderr kills the mapper. - (namit via He Yongqiang) - - HIVE-1207. ScriptOperator AutoProgressor does not set the interval. - (Zheng via He Yongqiang) - - HIVE-1022. desc Table should work. - (namit via He Yongqiang) - - HIVE-1241. Drop the table at the beginning of tests - (He Yongqiang via namit) - - HIVE-1242. CombinHiveInputFormat does not work for compressed text files. - (Namit Jain via Ning Zhang) - - HIVE-1247. Transform does not work with hints - (He Yongqiang via namit) - - HIVE-1252. Column pruning buf after a filter - (He Yongqiang via namit) - - HIVE-1261. ql.metadata.Hive#close() should check for null metaStoreClient - (bc Wong via namit) - - HIVE-1268. Cannot start metastore thrift server on a specific port - (bc Wong via namit) - - HIVE-1257. join between hbase and other tables does not work - (John Sichi via namit) - - HIVE-1273 UDF_Percentile NullPointerException - (Zheng Shao via namit) - - HIVE-1274 Bug in sort-merge join in presence of empry files - (He Yongqiang via namit) - - HIVE-1279 Temporarily disable TestHBaseCliDriver - (John Sichi via namit) - - HIVE-1275 Fix TestHBaseCliDriver - (John Sichi via namit) - - HIVE-1277 Failure if the local file system directory for ${hive.user.scratchdir} - does not exist (Arvind Prabhakar via namit) - - HIVE-1281 Bucketing column names in create table should be case-insensitive - (He Yongqiang via namit) - - HIVE-1286. Remove debug message from stdout in ColumnarSerDe. - (Yongqiang He via zshao) - - HIVE-1253. Fix Date_sub and Date_add in case of daylight saving. - (Bryan Talbot via zshao) - - HIVE-1291. Fix UDAFPercentile ndexOutOfBoundsException - (Zheng Shao via namit) - - HIVE-1290. Sort merge join does not work with bucketizedhiveinputformat. - (Namit Jain via Ning Zhang) - - HIVE-1280. Add option to CombineHiveInputFormat for non-splittable inputs. - (Namit Jain via zshao) - - HIVE-1011. GenericUDTFExplode() throws NPE when given nulls - (Paul Yang via namit) - - HIVE-1298. unit test symlink_text_input_format.q needs ORDER BY for - determinism (Ning Zhang via namit) - - HIVE-1311. Bug in use of parameter hadoop supports splittable. - (Namit Jain via zshao) - - HIVE-1308. Bug in boolean datatypes comparison - (Paul Yang via namit) - - HIVE-1312. hive trunk does not compile with 0.17 any more - (John Sichi via Ning Zhang) - - HIVE-1260. from_unixtime should accept bigints - (Ning Zhang via namit) - - HIVE-1315. Bug in sort-merge join - (Ning Zhang via namit) - - HIVE-1316. Increase hive client side memory - (Ning Zhang via namit) - - HIVE-1320. NPE with lineage in a query of union all on joins - (Ashish Thusoo via Ning Zhang) - - HIVE-1321. bugs with temp directories, trailing blank fields in HBase bulk load - (John Sichi via namit) - - HIVE-1325. dynamic partition insert should throw an exception if the number of target table - columns + dynamic partition columns does not equal to the number of select columns - (Ning Zhang via namit) - - HIVE-1326. RowContainer uses hard-coded /tmp path for temporary files - (Michael Klatt via Ning Zhang) - - HIVE-1330. Fatal error check omitted for reducer-side operators - (Ning Zhang via namit) - - HIVE-1331. select * does not work if different partitions contain - differnet format - (Namit Jain via Ning Zhang) - - HIVE-1329. alter table to external does not change table_type to external - (John Sichi via namit) - - HIVE-1328. make mapred.input.dir.recursive work for select * - (John Sichi via namit) - - HIVE-1338. Fix bin/ext/jar.sh to work with hadoop 0.20 and above - (Zheng Shao via Ning Zhang) - - HIVE-1317. CombineHiveInputFormat throws exception when partition name contains special characters to URI - (Ning Zhang via namit) - - HIVE-1341. Filter Operator Column Pruning should preserve the column order - (Ning Zhang via namit) - - HIVE-1116. Bug in renames for tables created with 'create table like' - (John Sichi via namit) - - HIVE-1322. Cached FileSystem can lead to persistant IOExceptions - (Paul Yang via namit) - - HIVE-1345. TypedBytesSerDe fails to create table with multiple columns. - (Arvind Prabhakar via namit) - - HIVE-1029. Null support for TypedBytesSerDe (Arvind Prabhakar via namit) - - HIVE-1352. Bug in rcfilecat (He Yongqiang via namit) - - HIVE-1353. load_dyn_part*.q need ORDER BY for determinism - (John Sichi via Ning Zhang) - - HIVE-1354. partition level properties honored if it exists - (namit via He Yongqiang) - - HIVE-1357. optimize CombineHiveInputFormat to cache inputFormat - (Ning Zhang via namit) - - HIVE-1350. hive.query.id is not unique - (Namit Jain via Ning Zhang) - - HIVE-1335 DataNucleus should use connection pooling - (Edward Capriolo via namit) - - HIVE-1366. inputFileFormat error if the merge job takes a different input - file format than the default output file format - (Namit Jain via Ning Zhang) - - HIVE-1365. Bug in sort-merge join - (He Yongqiang via namit) - - HIVE-1371. Bug in rcfilecat - (He Yongqiang via namit) - - HIVE-1377. getPartitionDescFromPath() in CombineHiveInputFormat should - handle matching by path - (Paul Yang via Ning Zhang) - - HIVE-1388. combinehiveinputformat does not work if files are of different - types - (Namit Jain via Ning Zhang) - - HIVE-1373. Missing connection pool plugin in Eclipse classpath. - (Vinithra via athusoo) - - HIVE-1403. Report progress if many files to close - (Ning Zhang via namit) - - HIVE-1407. Add hadoop-*-tools.jar to eclipse classpath - (Carl Steinbach via Ning Zhang) - - HIVE-1409. Use the tableSpec if partitions is not present - (Paul Yang via namit) - - HIVE-1418. Bug in RCfiles with Lateral Views - (He Yongqiang via namit) - - HIVE-1412. Bug in CombineHiveInputFormat with sampling - (Ning Zhang via namit) - - HIVE-1421. problem with sequence and rcfiles are mixed for null partitions - (namit via He Yongqiang) - - HIVE-1417. Archived partitions throw error with queries calling - getContentSummary (Paul Yang via namit) - - HIVE-1422. Bug in updating progres counters (John Sichi via namit) - - HIVE-1271. Make matching of type information case insensitive. - (Arvind Prabhakar via Ashish Thusoo) - - HIVE-1176. 'create if not exists' fails for a table name with - 'select' in it. - (Arvind Prabhakar via jvs) - - HIVE-1435. Upgraded naming scheme causes JDO exceptions - (Paul Yang via jvs) - - HIVE-1411. DataNucleus throws NucleusException if core-3.1.1 JAR - appears more than once on CLASSPATH - (Carl Steinbach via jvs) - - HIVE-1294. HIVE_AUX_JARS_PATH interferes with startup of Hive Web - Interface - (Edward Capriolo via jvs) - - HIVE-1428. ALTER TABLE ADD PARTITION failes with a remote Thrift - metastore - (Pradeep Kamath via jvs) - - HIVE-1613. hive --service jar looks for hadoop version but was not - defined - (Edward Capriolo via jvs) - - HIVE-1615. Web Interface JSP needs Refactoring for removed - metastore methods - (Edward Capriolo via jvs) - - HIVE-1570 referencing an added file by it's name in a transform script does - not work in hive local mode (Joydeep Sen Sarma via namit) - -Release 0.5.0 - 2010-02-22 - - INCOMPATIBLE CHANGES - - HIVE-236. RLIKE/REGEXP allowing matching of partial strings. - (Paul Yang via zshao) - - NEW FEATURES - - HIVE-743. Let user specify serde for custom scripts. - (Namit Jain via rmurthy) - - HIVE-749. add hive.optimize.pruner - (Zheng Shao via namit) - - HIVE-693. Add a AWS S3 log format deserializer - (Zheng Shao and Andraz Tori via namit) - - HIVE-699. Functions with variable length arguments - (Zheng Shao via namit) - - HIVE-713. Integrate operator counters into query plan to view progress of - queries. (Namit Jain and Raghu Murthy via zshao) - - HIVE-187. Preliminary ODBC Support. (Eric Hwang via rmurthy) - - HIVE-708. Add TypedBytes SerDe for transform. (Namit Jain via zshao) - - HIVE-777. CREATE TABLE with STRUCT type. (He Yongqiang via zshao) - - HIVE-792. Support "add archive" in addition to "add file" and "add jar". - (He Yongqiang via zshao) - - HIVE-645. UDF to run JDBC - (Edward Capriolo via namit) - - HIVE-785. Add RecordWriter for ScriptOperator. (Namit Jain via zshao) - - HIVE-687. Add UDF unhex. (Mihir Kedia via namit) - - HIVE-591. Add Unique Join. (Emil Ibrishimov via namit) - - HIVE-667. Provide hive ql to check table/partition status. - (Yongqiang He via zshao) - - HIVE-843. Add UDFs for hour, minute and second - (Zheng Shao via namit) - - HIVE-854. Provide for post-execute hooks. - (Namit Jain via rmurthy) - - HIVE-853. Provide hints for controlling join order - (Emil Ibrishimov via namit) - - HIVE-31. Support Create Table As Select - (Ning Zhang via namit) - - HIVE-682. Add concat_ws (Jonathan Chang via namit) - - HIVE-868. Add last ddl time and dml time for table/partition. - (Namit Jain via zshao) - - HIVE-869. Allow ScriptOperator to consume not all input data. - (Paul Yang via zshao) - - HIVE-688. UDF find_in_set (Jonathan Pythagoras Hsu via namit) - - HIVE-881. CTAS to work with fields terminator. (Ning Zhang via zshao) - - HIVE-874. Add 'repair' option to mack. (Cyrus Katrak via prasadc). - - HIVE-873. Better error messages for Hive cmdline. (Paul Yang via zshao) - - HIVE-554. Add GenericUDF to create arrays, maps. (Paul Yang via zshao) - - HIVE-911. Add UDF WeekOfYear. (Paul Yang via zshao) - - HIVE-870. Add left semi join. (Ning Zhang via namit) - - HIVE-870. Add table functions. (Paul Yang via namit) - - HIVE-549. Run independent tasks for a query in parallel. - (Chaitanya Mishra via namit) - - HIVE-946. Pass context to custom mapper/reducer - (Paul Yang via namit) - - HIVE-935. Add lateral view (Paul Yang via namit) - - HIVE-571 Add rename column in a table - (He Yongqiang via namit) - - HIVE-1020 Create a confifuration variable to control speculative execution for reducers in hive - (namit via He Yongqiang) - - HIVE-683 Add UDF field - (Larry Odrognek via namit) - - HIVE-1015 Java MapReduce wrapper for TRANSFORM/MAP/REDUCE scripts - (Larry Odrognek via namit) - - HIVE-1036. Add API Method to Query HiveConf Values of the Metastore. - (Paul Yang via zshao) - - HIVE-1106. Support ALTER TABLE t ADD IF NOT EXIST PARTITION. - (Paul Yang via zshao) - - IMPROVEMENTS - - HIVE-760. Add version info to META-INF/MANIFEST.MF. - (Bill Graham via zshao) - - HIVE-759. Add "hive.intermediate.compression.codec/type" option. - (Yongqiang He via zshao) - - HIVE-732. Use LazyBinarySerDe (Zheng Shao via namit) - - HIVE-768. Add conf var to disable counters introduced by HIVE-713. - (Namit Jain via zshao) - - HIVE-679. Adding the basic JDBC methods to allow querying using the - SQuirrelSQL tool. (Bill Graham via rmurthy) - - HIVE-811. Fix Javadocs. (Namit Jain via zshao) - - HIVE-813. Show the actual exception thrown in UDF evaluation - (Zheng Shao via rmurthy) - - HIVE-756. Performance improvement for RCFile and ColumnarSerDe in Hive. - (Ning Zhang via zshao) - - HIVE-584. Clean up global and ThreadLocal variables in Hive. - (Yonqqiang He via zshao) - - HIVE-74. Hive can use CombineFileInputFormat for when the input has many - small files (Namit Jain via rmurthy) - - HIVE-827. Increase hive.mapjoin.cache.numrows default value. - (Namit Jain via zshao) - - HIVE-855. UDF: Concat should accept multiple arguments. - (Paul Yang via zshao) - - HIVE-914. Optimize UDFJson (Paul Yang via namit) - - HIVE-945. custom mappers/reducers should not be initialized at compile time (namit via He Yongqiang) - - HIVE-947. runlength encding for RCFILE (He Yongqiang via namit) - - HIVE-949. avoid deep copy for group by hash table lookup - (He Yongqiang via namit) - - HIVE-931. optimize group by to use sorting and grouping properties - (He Yongqiang via namit) - - HIVE-968. remove mapjoin files and use a MRU cache to optimize lookups - (Ning Zhang via namit) - - HIVE-980. update readme.txt to build hive using eclipse - (Patrick Angeles via namit) - - HIVE-1012. Ability to run testcases via regular expression - (Carl Steinbach via namit) - - HIVE-963. No out of memory errors for skew join - (Ning Zhang via namit) - - HIVE-1023. typedbytes: datatypes should be derived from data - (namit via He Yongqiang) - - OPTIMIZATIONS - - BUG FIXES - - HIVE-734. problem while inserting nulls. (Ning Zhang via namit) - - HIVE-769. Bug in partition pruner checking. (Zheng Shao via namit) - - HIVE-773. Remove lzocodec import from FileSinkOperator. - (He Yongqiang via johan) - - HIVE-769. Bug in partition pruner checking - bug in patch. - (Zheng Shao via namit) - - HIVE-782. Bug in reducer progress (Raghu Murthy via namit) - - HIVE-780. Better error messages for wrong argument lengths in UDAFs - (Zheng Shao via namit) - - HIVE-790. race conditions with script and union operators - (Ning Zhang via namit) - - HIVE-798. remove UDAFSum and UDAFCount - (Zheng Shao via namit) - - HIVE-778. add describe for div - (Ning Zhang via namit) - - HIVE-755. Driver NullPointerException when calling getResults without first compiling - (Eric Hwang via namit) - - HIVE-752. Bug in shimLoader for HWI server (Edward Capriolo via namit) - - HIVE-810. add test and annotation for jdbc udf (Edward Capriolo via namit) - - HIVE-812. Hive compiled with ant package works with all supported hadoop versions - (Zheng Shao via namit) - - HIVE-823. Make table alise in MAPJOIN hint case insensitive. - (Namit Jain via zshao) - - HIVE-771. Code cleanup in QueryPlan (Emil Ibrishimov via namit) - - HIVE-838. In strict mode, remove error if no partition is selected. - (Namit Jain via rmurthy) - - HIVE-841. Change deprecated Hadoop APIs in Context.java (Cyrus Katrak via namit) - - HIVE-844. Remove ASTPartitionPruner from genmapredTasks. - (Namit Jain via zshao) - - HIVE-817. hive.hwi.war.file incorrectly tries to use environment variables to locate war file - (Edward Capriolo via namit) - - HIVE-795. Better error messages from Hive Server (Bill Graham via namit) - - HIVE-716. Web interface wait/notify, interface changes - (Edward Capriolo via namit) - - HIVE-831. Remove ASTPartitionPruner (missed this in HIVE-844) - (Namit Jain via rmurthy) - - HIVE-845. Shims do not build against latest hadoop - (Cyrus Katrak via namit) - - HIVE-858. Better logging for script operator even in case of failure - (Zheng Shao via namit) - - HIVE-861. NumberFormatException in sum and average - (Zheng Shao via namit) - - HIVE-859. Clean HWI build.xml - (Edward Capriolo via namit) - - HIVE-865. Map Join memory leak - (Ning Zhang via namit) - - HIVE-876. UDFOPNegative should deal with NULL gracefully. - (Ning Zhang via zshao) - - HIVE-877. More test cases for UDFOPNegative. (Ning Zhang via zshao) - - HIVE-879. Fix null pointer for empty dir. (Namit Jain via zshao) - - HIVE-878. Update the hash table entry before flushing in Group By - hash aggregation. (Zheng Shao via namit) - - HIVE-882. Create a new directory every time for scratch. - (Namit Jain via zshao) - - HIVE-884. Metastore Server should call System.exit() on error. - (Zheng Shao via pchakka) - - HIVE-890. Fix cli.sh for detecting Hadoop versions. - (Paul Huff via zshao) - - HIVE-885. Better error messages for debugging serde problem at reducer - input (Zheng Shao via namit) - - HIVE-893. Thrift serde doesn't work with the new version of thrift. - (Ning Zhang via zshao) - - HIVE-880. User group information not populated for pre and post hook. - (Namit Jain via zshao) - - HIVE-883. URISyntaxException when partition value contains special chars. - (Zheng Shao via namit) - - HIVE-903. msck: output not deterministic - (Cyrus Katrak via namit) - - HIVE-905. Smallint not working for typedbyteserde. (Namit Jain via zshao) - - HIVE-840. No error if user specifies multiple columns of same name as - output (He Yongqiang via namit) - - HIVE-902. Fix cli.sh to work with hadoop versions less than 20. - (Carl Steinbach via zshao) - - HIVE-796. RCFile results missing columns from UNION ALL - (He Yongqiang via namit) - - HIVE-819. Add lazy decompress abilitt to rcfile - (He Yongqiang via namit) - - HIVE-910. RCFile is not included when user specifying it as the default - file format (He Yongqiang via namit) - - HIVE-907. NullPointerException in ErrorMsg.findSQLState - (Bill Graham via namit) - - HIVE-910. NULL value is not correctly handled by ColumnarStruct - (He Yongqiang via namit) - - HIVE-804 Support deletion of partitions based on a prefix partition spefication - (Zheng Shao via namit) - - HIVE-921 MapJoin schema reordering (Ning Zhang via namit) - - HIVE-923 Use HiveInputFormat by default (Zheng Shao via namit) - - HIVE-926 bug in mapjoin when rows are getting aged out from cache (namit via He Yongqiang) - - HIVE-912 ctas name should be case insensitive (Ning Zhang via namit) - - HIVE-929. Use a new parameter to check whether to merge files or not - (He Yongqiang via namit) - - HIVE-980 mapjoin followed by union does not work (namit via He Yongqiang) - - HIVE-940 restrict creation of partitions with empty keys (Prasad Chakka via namit) - - HIVE-941 hiveserver.sh doesn't work with Hadoop 0.20.0 or higher - (Ning Zhang via namit) - - HIVE-944 Generate thrift files in queryplan - (Paul Yang via namit) - - HIVE-953 Fix test script_broken_pipe3.q - (Paul Yang via namit) - - HIVE-957 Separate table and partition metadata - (He Yongqiang via namit) - - HIVE-961 bug in group by key wrapper - (He Yongqiang via namit) - - HIVE-966 Hive should emit log messages in 24-hour format - (Zheng Shao via namit) - - HIVE-962 "show functions" should work with unquoted string. - (Paul Yang via zshao) - - HIVE-638 fix sampling in subquery for real - (namit via He Yongqiang) - - HIVE-973. Support nested types in custom scripts. (Namit Jain via zshao) - - HIVE-991 union with 200 kids fail - (namit via He Yongqiang) - - HIVE-993 Remove duplicate conversion for MapJoin - (He Yongqiang via namit) - - HIVE-992 commons-dhcp not working - (Bennie Schut via namit) - - HIVE-595 throw error if rename fails - (Zheng Shao via namit) - - HIVE-999 bug in sampling if denominator != numBuckets - (He Yongqiang via namit) - - HIVE-1000 bug in sampling if buckted table is empty - (He Yongqiang via namit) - - HIVE-1001 CombinedHiveInputFormat should parse the inputpath correctly - (namit via He Yongqiang) - - HIVE-913 no error if user specifies same output table mutliple times - (namit via He Yongqiang) - - HIVE-977 NullPointerException when operating on a non-existing partition - (namit via He Yongqiang) - - HIVE-1004 Change default memory for Hive client to 256M - (Zheng Shao via namit) - - HIVE-1006 getPartitionDescFromPath failing from CombineHiveInputFormat - (Dave Lerman via namit) - - HIVE-927 Check the schema for both inputs of union - (He Yongqiang via namit) - - HIVE-302 Check that lines terminated by can only be "\n" - (Zheng Shao via namit) - - HIVE-979 selectNoStar is a part of explainPlan - (Paul Yang via namit) - - HIVE-1009 bug in union along with transform - (Ning Zhang via namit) - - HIVE-986 Ant "eclipse-files" target is broken for Hadoop 0.20 - (Zheng Shao via namit) - - HIVE-1017 || and && are not supported currently - (Ning Zhang via namit) - - HIVE-916 typedbytes: changes - (namit via He Yongqiang) - - HIVE-976 Compare the path in unit tests for sampling - (John Sichi via namit) - - HIVE-1026 Fix test sample6.q to make it deterministic - (John Sichi via namit) - - HIVE-1028. Fix tinyint in TypedBytes. (Namit Jain via zshao) - - HIVE-458. Better error messages for fs.default.name. (Paul Yang via zshao) - - HIVE-1030 Hive should use scratchDir instead of system temporary directory - for storing plans (Zheng Shao via namit) - - HIVE-1030 mapjoin should throw an error if the input is too large - (Ning Zhang via namit) - - HIVE-996 describe function throws NPE when when called on UDTF or UDAF - (Carl Steinbach via namit) - - HIVE-1031 describe function array throws ParseException - (Carl Steinbach via namit) - - HIVE-978 Hive jars should follow Hadoop naming and include version - (Chad Metcalf and Zheng Shao via namit) - - HIVE-1038 mapjoin dies if the join prunes all the columns - (namit via He Yongqiang) - - HIVE-1037 SerDe & ObjectInspector for RowContainer mismatch with the - input data (Ning Zhang via namit) - - HIVE-1042 incorrect error for function within transform - (Paul Yang via namit) - - HIVE-1039 bug in multi table/directory inserts - (Ning Zhang via namit) - - HIVE-1049. Fix ant targets "eclipse-files" and "javadoc". - (Carl Steinbach via zshao) - - HIVE-1072. Keep CreateTime when a partition is overwritten. - (Paul Yang via zshao) - - HIVE-1059. Date/DateTime/TimeStamp types should throw an error. - (Paul Yang via zshao) - -Release 0.4.0 - 2009-10-11 - - INCOMPATIBLE CHANGES - - HIVE-143. Remove the old file based metastore, in favour of the - RDBMS based metastore. (prasadc via johan) - - HIVE-724. Change HiveServer.getSchema() to return Hive types rather - than Thrift types. Changed existing getSchema() to getThriftSchema() - (Eric Hwang via rmurthy) - - NEW FEATURES - - HIVE-354. UDF for length of a string. (Neil Conway via namit). - - HIVE-402. Implement UDF regexp. (Raghotham Murthy via namit) - - HIVE-250. Shared memory java dbm for map-side joins. - (Joydeep Sen Sarma via zshao) - - HIVE-164. Use CASE through GenericUDF (Zheng Shao via namit) - - HIVE-464. Add alter partition method to the meastore interface. - (Prasad Chakka via zshao) - - HIVE-352. Column-based storage format RCFile. - (Yongqiang He via zshao) - - HIVE-420. Support regular expressions for column names - (Zheng Shao via namit) - - HIVE-463. Add a pre execution hook to ql - (Ashish Thusoo via prasadc) - - HIVE-476. Add getTable and getPartition calls to the ReadEntity and - WriteEntity objects in PreExecute hooks. (Ashish Thusoo via prasadc) - - HIVE-518. Add test mode to hive where input tables are sampled. - (Namit Jain via rmurthy) - - HIVE-509. Add create table like. - (Zheng Shao via namit) - - HIVE-195. Map-side join. (Namit Jain via zshao) - - HIVE-470. Add COALESCE. (Zheng Shao via namit) - - HIVE-460. Improve Column Pruning. (He Yongqiang via namit) - - HIVE-563. UDF for parsing the URL: parse_url. (Suresh Antony via zshao) - - HIVE-338. add/delete jar commands, Hive Server fix for multithreading, - cli commands via hiveserver - (Min Zhou and Joydeep Sen Sarma via jssarma) - - HIVE-338. Postfix for HIVE-338. (zshao) - - HIVE-567. jdbc: integrate hive with pentaho report designer - (Raghotham Murthy via namit) - - HIVE-136. escaping in lazy serde - (Zheng Shao via namit) - - HIVE-603. list of maps and vice versa - (Zheng Shao via namit) - - HIVE-553. add BinarySortableSerDe - (Zheng Shao via namit) - - HIVE-622. add UDF reverse - (Emil Ibrishimov via namit) - - HIVE-438. Make Hive work with apache thrift - (Raghu Murthy via namit) - - HIVE-522. Extend GenericUDAF to support complex types - (Zheng Shao via namit) - - HIVE-541. add UDF locate and instr - (Min Zhou via namit) - - HIVE-646. add UDF conv, bin and hex - (Emil Ibrishimov via namit) - - HIVE-512. add UDF elt. - (Min Zhou via namit) - - HIVE-609. Optimize multi-group by. (Namit Jain via zshao) - - HIVE-642. add UDF split (Emil Ibrishimov via namit) - - HIVE-639. create contrib directory (Zheng Shao via namit) - - HIVE-674. add UDFs sin, cos, asin, acos (Karan Mangla via namit) - - HIVE-668. add UDFs abs, ascii, repeat, lpad, rpad, space, substring (Emil Ibrishimov via namit) - - HIVE-167. add regex serde(Zheng Shao via namit) - - HIVE-665. Get hadoop/mapreduce cluster status from hive server - (Eric Hwang via rmurthy) - - HIVE-580. add 'show functions {pattern}' - (Scott Chen via namit) - - HIVE-656. Add a PMOD (POSITIVE MOD) function. (Scott Chen via zshao) - - HIVE-698. Add create temporary function for generic UDAF. - (Zheng Shao via namit) - - HIVE-607. Add udafs for variance and standard deviation - (Emil Ibrishimov via namit) - - HIVE-487. Make hive compatibale with hadoop 20 - (Todd Lipcon via namit) - - HIVE-640. Add LazyBinarySerDe to Hive. (Yuntao Jia via zshao) - - HIVE-729. Make AS in select list optional. (Zheng Shao via namit) - - HIVE-691. show documentation for functions. (Emil Ibrishimov via namit) - - HIVE-748. Test for extracting urls. (Namit Jain via zshao) - - IMPROVEMENTS - HIVE-389. Option to build without ivy (jssarma) - - HIVE-360. Generalize the FileFormat Interface in Hive. - (He Yongqiang via zshao) - - HIVE-406. Build file improvements. (Joydeep Sen Sarma via zshao). - - HIVE-254. Link jobtracker from Hive History in Hive Web Interface. - (Edward Capriolo via athusoo) - - HIVE-502. Optimize RCFile's performance by removeing all synchronized - modifiers. (Yongqiang He via zshao) - - HIVE-204. Provide option to run tests with MiniMRCluster. - (Namit Jain via athusoo) - - HIVE-511. Make DoubleWritable's hashCode more uniform. - (Zheng Shao via rmurthy) - - HIVE-490. Add missing configuration variables to hive-default.xml. - (Yongqiang He via zshao) - - HIVE-528. Map Join followup: split MapJoinObject into MapJoinObjectKey and - MapJoinObjectValue. (Namit Jain via zshao) - - HIVE-542. UDF: Faster String Like. (Yuntao Jia via zshao) - - HIVE-521. Move size, if, isnull, isnotnull to GenericUDF. - (Min Zhou via zshao) - - HIVE-439. Merge small files after a map-only job. (Namit Jain via zshao) - - HIVE-516. Enable predicate pushdown for junit tests. - (Prasad Chakka via zshao) - - HIVE-530. Map Join followup: optimize number of map-reduce jobs. - (Namit Jain via zshao) - - HIVE-445. Upgrade JPOX to datanuclues plugins. (Prasad Chakka via zshao) - - HIVE-593. UDF and GenericUDF clean-up. (Zheng Shao via pchakka) - - HIVE-605. Change eclipse classpath for datanuclues. - (Prasad Chakka via zshao) - - HIVE-461. Optimize RCFile reading by using column pruning results. - (Yongqiang He via zshao) - - HIVE-628. Remove stray lines from hive-default.xml. - (Prasad Chakka via zshao) - - HIVE-629. Concat files for map-reduce jobs. (Namit Jain via zshao) - - HIVE-644. Change default size for merging files to 256MB. - (Namit Jain via zshao) - - HIVE-405. Cleanup operator initialization. (Prasad Chakka via zshao) - - HIVE-652. Turn off auto-merge for insert local. (Namit Jain via zshao) - - HIVE-677. Operators to show number of rows forwarded. (Namit Jain via zshao) - - HIVE-689. Dump more memory stat periodically. (Namit Jain via zshao) - - HIVE-280. Reserve keywords such as database etc. (Namit Jain via zshao) - - HIVE-720. Improve ByteStream by removing all synchronized method calls. - (Yongqiang He via zshao) - - HIVE-454. Support escaping of ; in cli. - (Edward Capriolo via namit) - - HIVE-736. Provide a function in Metastore to return the schema of a table. - (Eric Hwang via rmurthy) - - HIVE-617. Add 'jar' service to hive client shell. - (Edward Capriolo via rmurthy) - - HIVE-578. Refactor partition pruning. - (Ashish Thusoo via namit) - - HIVE-737. Support having hadoop jars in HADOOP_HOME/build for running - hive cli. (Johan Oskarsson via athusoo) - - HIVE-750. New partitionpruner does not work with test mode. - (Namit Jain via zshao) - - OPTIMIZATIONS - - HIVE-279. Predicate Pushdown support (Prasad Chakka via athusoo). - - HIVE-266. Use Text instead of String (Zheng Shao via namit). - - HIVE-427. Add missing config parameters in hive-default.xml. - (Namit Jain via zshao) - - HIVE-462. Avoid Text->String->Text conversion (Namit Jain via zshao) - - HIVE-610. Move all properties from jpox.properties to hive-site.xml. - (Prasad Chakka via zshao) - - BUG FIXES - - HIVE-381. Fix JDBC HiveResultSet's next function. - (Kim P via namit) - - HIVE-387. Use URI from FileSystem Object instead of from HADOOPFS - directly. (jssarma) - - HIVE-385. Split Driver's run into compile and execute. - (Neil Conway via namit) - - HIVE-393. Remove unnecessary checks in movetask for file type. - (Zheng Shao via namit) - - HIVE-403. remove password param from job config that is submitted to job - tracker and from log (Prasad Chakka) - - HIVE-407. fix permissions for test scripts in release tarball. - (Ashish Thusoo via namit) - - HIVE-414. Add Hive Web Interface code to Eclipse config - (Prasad Chakka) - - HIVE-372. Fix UDF memory consumptions and bad error messages. - (Zheng Shao via namit) - - HIVE-413. Fix multi-table insert. (Namit Jain via zshao) - - HIVE-415. Fix long query parsing problems. (Zheng Shao via namit). - - HIVE-421. Fix union followed by multi-table insert. (Namit Jain via zshao). - - HIVE-423. Change launch templates to use hive_model.jar. - (Raghotham Murthy via zshao) - - HIVE-426. Fix undeterministic query plan because of aliasToWork. - (Namit Jain via zshao) - - HIVE-404. Fix ordering in "SELECT * FROM t SORT BY col1 LIMIT 100" when - query is a outer-most query. (Namit Jain via zshao) - - HIVE-432. Fix "SORT BY" using only one reducer. - (Zheng Shao via namit) - - HIVE-435. Fix Null pointer exception if password is null. - (Prasad Chakka via namit) - - HIVE-437. Allow both table.name and col.field - (Zheng Shao via namit) - - HIVE-366. testParse should not depend on a static field - (Zheng Shao via namit) - - HIVE-433. Fixed union18 and union19 tests. - (athusoo via johan) - - HIVE-324. Fix AccessControlException when loading data. - (Ashish Thusoo via zshao) - - HIVE-395. Fix build problems with eclipse and 0.19 hadoop. - (Neil Conway via athusoo) - - HIVE-456. Add option to run junit tests in quiet mode. - (Zheng Shao via prasadc) - - HIVE-453. Use FileSystem derived from user supplied path when present - instead of default. (Joydeep Sen Sarma via prasadc) - - HIVE-442. Create partitions after data is moved in the query - in order to close out an inconsistent window. (Prasad Chakka via athusoo) - - HIVE-483. Fix incorect handling of comments in middle of a query - (Namit Jain via athusoo) - - HIVE-486. Fix concurrent modification exception in case of empty partitions - (Namit Jain via prasadc) - - HIVE-485. Fix join not to assume all columns are strings. - (Namit Jain via zshao) - - HIVE-488. Fix load partition for table with multiple partition columns. - (Prasad Chakka via athusoo) - - HIVE-496. UDFDate fails on null. (Zheng Shao via pchakka) - - HIVE-498. Fix null pointer exception in UDFRegExp when - the expression string is empty. (Zheng Shao via athusoo) - - HIVE-410: Heartbeating for streaming jobs should not depend on stdout. - (Ashish Thusoo via namit) - - HIVE-499. Fix for CAST operator on the same type. (Zheng Shao via athusoo) - - HIVE-501. Fix UDFLower() bug. (Zheng Shao via prasadc) - - HIVE-505. console.info prints to stderr. (Raghotham Murthy via namit) - - HIVE-504. Fix script operator with empty input file. - (Raghotham Murthy via zshao) - - HIVE-507. Handle empty files properly. (Namit Jain via zshao) - - HIVE-497. Fix predicate pushdowns when all the columns are not - selected in the query. (Prasad Chakka via athusoo) - - HIVE-500. Fix select from newly created table. - (Yongqiang He via zshao) - - HIVE-451. Fix ORDER BY xxx DESC (He Yongqiang via namit) - - HIVE-467. Scratch data location should be on different filesystems for - different types of intermediate data. (Joydeep Sen Sarma via rmurthy) - - HIVE-514. Partition key names should be case insensitive in alter table add - partition statement. (Prasad Chakka via zshao) - - HIVE-523. Fix PartitionPruner not to fetch all partitions at once. - (Prasad Chakka via zshao) - - HIVE-506. MoveTask should fail if target path cannot be deleted. - (Yongqiang He via zshao) - - HIVE-520. Fix TestTCTLSeparatedProtocol. (Johan Oskarsson via zshao) - - HIVE-525. Fix Eclipse classpath by adding Hadoop test jar. - (Prasad Chakka via johan) - - HIVE-495. Fix join of a table of ThriftSerDe with complex columns - (Zheng Shao via namit) - - HIVE-532. Predicates not pushed above limit - (Prasad Chakka via namit) - - HIVE-534. Fix in the cli so that it does not ignore the first - newline character. (Raghotham Murthy via athusoo) - - HIVE-443. Remove deprecated functions from metastore. - (Prasad Chaaka via athusoo) - - HIVE-479. Change RCFileOutputFormat's generic signatute. - (Yongqiang He via zshao) - - HIVE-533. Predicates containing rand() not pushed above - (Prasad Chakka via namit) - - HIVE-540. Restore test.silent setting - (Zheng Shao via namit) - - HIVE-544. Fix predicate push for exprFieldNodeDesc. - (Prasad Chakka via zshao) - - HIVE-547. Better logging in ExecDriver - (Zheng Shao via namit) - - HIVE-561. Make hash aggregation threshold configurable - (Zheng Shao via namit) - - HIVE-529. Some cleanup for join operator - (Zheng Shao via namit) - - HIVE-573. Fix TestHiveServer. (Raghotham Murthy via zshao) - - HIVE-575. Fix Map join out-of-memory problem. (Namit Jain via zshao) - - HIVE-472. HiveFileFormatUtils's checkInputFormat does not include RCFile. - (He Yongqiang via namit) - - HIVE-560. Column Pruning for mapjoins - (He Yongqiang via namit) - - HIVE-583. Fix spurious 'default database not found'. - (Prasad Chakka via zshao) - - HIVE-587. Duplicate results from multiple TIP - (Zheng Shao via namit) - - HIVE-582. bug in column pruning - (He Yongqiang via namit) - - HIVE-596. Fix PartitionPruner to work with GenericUDF. - (Namit Jain via zshao) - - HIVE-590. Pass type information in genFileSinkPlan and improve getSchema - call in Driver. (Namit Jain via rmurthy) - - HIVE-612. Problem in removing temp files in FileSinkOperator.jobClose - (Zheng Shao via namit) - - HIVE-608. No type conversion in GenericUDF - (Zheng Shao via namit) - - HIVE-616. Make hive work with symbolic linked sub directories - (Zheng Shao via rmurthy) - - HIVE-527. Inserting into a partitioned table without specifying the partition field should fail. - (He Yongqiang via namit) - - HIVE-473. Clean up after tests. - (Johan Oskarsson via namit) - - HIVE-624. Bug in TypeConvertor - (Zheng Shao via namit) - - HIVE-555. Support create temporary function for udaf and generic udf - (Min Zhou via namit) - - HIVE-631. Fix TestParse. (Namit Jain via zshao) - - HIVE-626. Fix Column Pruner column order bug. (Yongqiang He via zshao) - - HIVE-623. optimize UDF reverse and UDF length - (Emil Ibrishimov via namit) - - HIVE-632. Make conditional task serializable. (Namit Jain via zshao) - - HIVE-160. Bug in sampling for subqueries. (Raghu Murthy via namit) - - HIVE-636. Fix concatenation task with partitioned table. - (Namit Jain via zshao) - - HIVE-641. fix test udf_reverse.q - (Emil Ibrishimov via namit) - - HIVE-635. fix union accepting multiple objectinspectors - (Zheng Shao via namit) - - HIVE-643. recognize escaped strings - (Emil Ibrishimov via namit) - - HIVE-592. Renaming internal table should rename HDFS. - (Prasad Chakka via zshao) - - HIVE-654. renaming thrift serde - (Zheng Shao via namit) - - HIVE-666. Propagate errors in FetchTask to client. - (Zheng Shao via rmurthy) - - HIVE-620. bug in displaying function name when more than 1 function points to the same class - (Emil Ibrishimov via namit) - - HIVE-670. dump output column names in explain - (Zheng Shao via namit) - - HIVE-673. Bug in handling of null partitions. - (Namit Jain via zshao) - - HIVE-690. Fix script operator timeout bug - (Zheng Shao via namit) - - HIVE-697. GroupByOperator's initialization calls GenericUDAF.newAggregation before GenericUDAF.init - (Zheng Shao via namit) - - HIVE-700. Fix test error by adding "DROP FUNCTION". - (Min Zhou and Namit Jain via zshao) - - HIVE-702. bug in drop temporary function - (Min Zhou via namit) - - HIVE-710. Fix serialization bug in BinarySortableSerDe for negative double - and float numbers (Zheng Shao via pchakka) - - HIVE-719. Lazy Array/Map index out of bound bug. - (Zheng Shao via namit) - - HIVE-725. Add missing classpath: shims/src/common/java. Bug appeared - after HIVE-487 was committed. (Zheng Shao via rmurthy) - - HIVE-711. test for negative double value. - (Karan Mangla via namit) - - HIVE-344. Fixes for running Hive under cygwin. - (Amr Awadallah via athusoo) - - HIVE-740. Fix HiveMetaStore get_fields. (Eric Hwang via zshao) - - HIVE-597. apache header for jdbc files. (Raghu Murthy via namit) - - HIVE-772. Fix genConversionSelect for init serde with null. - (Namit Jain via zshao) - - HIVE-774. Fix the behavior of "/" and add "DIV". (Ning Zhang via zshao) - - HIVE-776. Make "DIV" an infix operator. (Ning Zhang via zshao) - - HIVE-764. Fixed json.jar. (Raghu Murthy via zshao) - - HIVE-794. MergeTask should use COMPRESSRESULT. (Saurabh Nanda via zshao) - - HIVE-726. Make "ant package -Dhadoop.version=0.17.0" work. - (Todd Lipcon via zshao) - - HIVE-799. final.name should not include hadoop version. - (Todd Lipcon via zshao) - - HIVE-718. Fix Loading data inpath into a new partition. - (Namit Jain via zshao) - - HIVE-864. Fix map-join memory-leak. (Namit Jain via zshao) - -Release 0.3.1 - Unreleased - - INCOMPATIBLE CHANGES - - NEW FEATURES - - HIVE-61. Implement "ORDER BY". (Namit Jain via zshao) - - HIVE-376. In strict mode do not allow join without "ON" condition. - (Namit Jain via zshao) - - IMPROVEMENTS - - HIVE-440. Reducer and Join to print out number of rows processed. - (Namit Jain via zshao) - - OPTIMIZATIONS - - BUG FIXES - - HIVE-416. Fix backtrack in Hive.g. (Namit Jain via zshao) - - HIVE-442. Move the data before creating the partition. - (Prasad Chakka via zshao) - - HIVE-447. Fix tests on hudson. (Ashish Thusoo via zshao) - - HIVE-469. Fix errors for cases where the partition or the - table is empty. (Namit Jain via athusoo) - - HIVE-816. Cache MetastoreClient. (Dave Lerman via zshao) - -Release 0.3.0 - 2009-04-20 - - INCOMPATIBLE CHANGES - - NEW FEATURES - - HIVE-337. LazySimpleSerDe to support multi-level nested array, map, struct - types. (zshao) - - HIVE-313. Add UDF date_add, date_sub, datediff. (zshao) - - HIVE-79. Print number of rows inserted to table(s). - (Suresh Antony via zshao) - - HIVE-30. Hive Web User Interface. (Edward Capriolo via athusoo) - - HIVE-343. Include py packages for thrift service. - (Raghotham Murthy via zshao) - - HIVE-299. Include php packages for thrift service. - (Raghotham Murthy via zshao) - - HIVE-82 Support for building tarballs and javadocs - (Ashish Thusoo via rmurthy) - - IMPROVEMENTS - - HIVE-132. Show table and describe results to be read via FetchTask. - (Raghotham Murthy via zshao) - - OPTIMIZATIONS - - BUG FIXES - - HIVE-349. Fix TestCliDriver when there are test cases with no tasks. - (Suresh Antony via zshao) - - HIVE-339. Fix count distinct in 1 map-reduce job with map side - aggregation. (Namit Jain via zshao) - - HIVE-271. Move test-udfs creation to build-common in order to - fix broken 0.17 build. (athusoo) - - HIVE-286. Use round(xxx,12) to make sure there is no precision - matching problem in testCliDriver_udf7. (zshao via johan) - - HIVE-327. Fix row counts printed in hive history to reflect the - count of rows from the query in the session. (Suresh Anthony via athusoo) - - HIVE-334. Make union3 test output deterministic. - (Joydeep Sen Sarma via athusoo) - - HIVE-320. Fix intermittent nullpointer exception in count(DISTINCT). - (Namit Jain via athusoo) - - HIVE-124. Fix empty aggregations to return 1 row instead of - nothing. (namit) - - HIVE-347. Fix lot of partition scans in strict mode in case of error in - partition specification error. (namit) - - HIVE-251. Throw an error to the CLI if a user defined script fails in - TRANSFORM, MAP or REDUCE commands. (athusoo) - - HIVE-317. Fix HiveServer to accept 1 argument for port. - (Min Zhou via athusoo) - - HIVE-285. Fix to disallow union of different schemas. - (Raghotham Murthy via namit) - - HIVE-253. Fix to disallow computation of rand() at compilation stage. - (Raghotham Murthy via namit) - - HIVE-350. Fix wrong order of aggregations in explain plan. - (namit) - - HIVE-347. undo for Fix lot of partition scans in strict mode in case of error in - partition specification error. (namit) - - HIVE-319. Add UDF for unix timestamp. - (Hao Liu via namit) - - HIVE-363. Use 1 reducer in case of aggregations with no grouping keys. - (namit) - - HIVE-366. Make id a non-bean attribute so that TestParse does not depend on that. - (namit) - - HIVE-342. Fix TestMTQueries - (Prasad Chakka via namit) - - HIVE-318. Fix union all queries. (Namit Jain via zshao) - - HIVE-367. Null Pointer when some of the files in the table are - empty. (Namit Jain via athusoo) - - HIVE-278. Add support for Hive History to - Hive Web UI. (Edward Capriolo via athusoo) - - HIVE-356. Treat Object[] and List differently. - (Zheng Shao via namit) - - HIVE-373. 1 reducer should be used if no grouping key is present in all - scenarios. (Namit Jain via zshao) - - HIVE-375. LazySimpleSerDe directly creates a UTF8 buffer for primitive types. - (Zheng Shao via namit) - - HIVE-382. Fix for hash aggr, remove elements from hash table in the loop - during close, rather than waiting till the end. (Namit Jain via rmurthy) - - HIVE-391. Fix for UDAFCount which was not handling merging nulls - (Namit Jain via rmurthy) - - HIVE-384. Fixing UNION ALL when the first job is a map-only job. - (Namit Jain via zshao) - - HIVE-394. Break plans in Cluster Mode. (Namit Jain via zshao) - - HIVE-399. Fix timeout problems caused due to the bigdata test. - (Namit Jain via athusoo) - - HIVE-397. Make union tests deterministic by ordering the - output results. (Namit Jain via athusoo) - - HIVE-400. Fix bug in genColList. (Namit Jain via zshao) - - HIVE-390. Make partition pruner tests deterministic by ordering the - output results. (Namit Jain via athusoo) - -Release 0.2.0 - Unreleased - - INCOMPATIBLE CHANGES - - HIVE-194. Support specifying decimal places for ROUND function. - ROUND always rounds away from zero now. (David Phillips via zshao) - - NEW FEATURES - - HIVE-223. Single map-reduce group-by using map-side aggregation. - (Namit Jain via zshao) - - HIVE-269. Add log/exp/pow UDF functions to Hive. (zshao) - - HIVE-258. New UDF IF(test, valueTrue, valueFalseOrNull). (zshao) - - HIVE-105. Automatically estimate number of required reducers. (zshao) - - HIVE-176. Added a history log for Hive. (Suresh Anthony via athusoo) - - HIVE-244. Add SQRT() UDF. (Jeff Hammerbacher via zshao) - - HIVE-216. Generate ruby bindings for service. (Raghotham Murthy via zshao) - - HIVE-163. JSON udf function added. (Hao Liu via zshao) - - HIVE-142. Add a metastore check command. (Johan Oskarsson via zshao) - - HIVE-91. Add ADD PARTITION support to ALTER TABLE in order to add - partitions to a table. (Johan Oskarsson via athusoo) - - HIVE-148. Extend bin/hive to include the lineage tool. - (Suresh Antony via zshao) - - HIVE-147. Add a tool for extracting lineage info from hive sql. - (Suresh Antony via zshao) - - HIVE-48. Support JDBC connections for interoperability between - Hive and RDBMS. (Raghotham Murthy and Michi Mutsuzaki via dhruba) - - HIVE-140. Event Based Infrastructure for Syntax Trees in the compiler. - (Ashish Thusoo through zshao) - - HIVE-98. Dependency management with hadoop core using ivy. - (Ashish Thusoo through zshao) - - HIVE-73. Thrift Server and Client for Hive (Raghotham Murthy through zshao) - - HIVE-113. Distribute by and sort by support. (zshao) - - HIVE-118. Add date related functions. (zshao) - - HIVE-62. Support nested types. - (Ashish Thusoo via dhruba) - - IMPROVEMENTS - - HIVE-300. DISTRIBUTE BY now supports expressions. (zshao) - - HIVE-292. Replace MetadataTypedColumnsetSerde with LazySimpleSerDe. (zshao) - - HIVE-294. Support MAP(a.*), REDUCE(a.*) and TRANSFORM(a.*). (zshao) - - HIVE-270. Add a lazy-deserialized SerDe for efficient deserialization of - rows with primitive types. (zshao) - - HIVE-288. Removed the old serde package. (zshao) - - HIVE-240. Support CREATE TABLE IF NOT EXISTS. (zshao) - - HIVE-126. Don't fetch information on Partitions from HDFS instead of - MetaStore. (Johan Oskarsson via zshao) - - HIVE-209. Enabling asserts in tests. (Prasad Chakka via zshao) - - HIVE-177. Allow specifying custom input and output format in CREATE TABLE. - (David Phillips via zshao) - - HIVE-166. Create eclipse project template. (Ashish Thusoo via zshao) - - HIVE-186. Refactor code to use a single graph, nodeprocessor, dispatcher - and rule abstraction. (Ashish Thusoo via zshao) - - HIVE-182. Add database name parameter to getTable and dropTable. - (Johan Oskarsson via zshao) - - HIVE-181. Restore UDFTestLength unit test for UDFs. - (David Phillips via zshao) - - HIVE-107. Case structure for bin/hive. (Edward Capriolo via zshao) - - HIVE-101. Set svn:ignore for the root. (Johan Oskarsson via zshao) - - HIVE-170. Map-side aggregations to estimate memory size. (Namit via zshao) - - HIVE-180. Data Generator for thrift-serialized sequence files. (zshao) - - HIVE-157. Update README.txt to remove refs to mirror.facebook.com. (zshao) - - HIVE-95. Improve cli error messages by lowering backtracking to 1. - (Pete Wyckoff through zshao) - - HIVE-102. Refactor DDLTask. (Johan Oskarsson through zshao) - - HIVE-85. New compression options for Hive. (Joydeep Sarma through zshao) - - HIVE-69. genMapRedTasks uses tree walker. (Namit through zshao) - - HIVE-249. Give execute permissions to the hive binary - (Jeff Hammerbacher via athusoo) - - HIVE-231. Create junit reports for tests. (Johan Oskarsson via athusoo) - - HIVE-119. Make error messages more informative. (Pete Wyckoff via athusoo) - - OPTIMIZATIONS - - BUG FIXES - - HIVE-340. Fixed null pointer exception with nulls in map-side aggregation. - (Namit Jain via zshao) - - HIVE-308. UNION ALL: FileSinkOperator now adds files in case the target - exists. (zshao) - - HIVE-276. Fix input3_limit.q for hadoop 0.17. (zshao) - - HIVE-131. Remove uncommitted files from failed tasks. - (Joydeep Sen Sarma via zshao) - - HIVE-264. TBinarySortable Protocol supports null characters. (zshao) - - HIVE-255. Propagate user name to Hive metastore. (Prasad Chakka via zshao) - - HIVE-263. TCTLSeparatedProtocol should use UTF-8 to encode/decode - the data. (zshao) - - HIVE-255. Propagate user name to Hive metastore. (Prasad Chakka via zshao) - - HIVE-235. Fixed DynamicSerDe to work with null values with Thrift - Protocols that can have missing fields for null values. (zshao) - - HIVE-222. Fixed Group by on a combination of disitinct and non distinct - aggregates. (Ashish Thusoo via zshao) - - HIVE-161. Fixed xpath x.y when x is a null list. (zshao) - - HIVE-206. Fixed partition pruning check for uppercase table names. - (Ashish Thusoo via zshao) - - HIVE-151. Tasks depending on other tasks cannot be a root task. - (Namit Jain via zshao) - - HIVE-197. Fixed UDFToBoolean. (zshao) - - HIVE-171. Fixed select star with cluster by, distribute by and sort by. - (zshao) - - HIVE-190. Fixed tests failed due to test running order. (zshao) - - HIVE-184. Tests fail due to including old hive jar files. - (David Phillips via zshao) - - HIVE-188. Hive CLI quits when stdout is closed. (zshao) - - HIVE-104. Tables with at least 1 non-string columns to use DynamicSerDe. - (zshao) - - HIVE-158. Make table aliases work for sampled tables in joins. - (Raghotham Murthy via zshao) - - HIVE-168. Fixed join on a subquery with a group by. (Namit Jain via zshao) - - HIVE-169. Fixed configuration parameter used for determining join interval - in JoinOperator. (Namit Jain via zshao) - - HIVE-114. Drop partition does not delete data for external tables now. - (Johan Oskarsson via zshao) - - HIVE-144. Hive/ql java source copied to build/ql/java to make it work - with eclipse. (Johan Oskarsson via zshao) - - HIVE-129. Fix aux.jar packaging to work properly with 0.17 and 0.18 - versions of hadoop. (Joydeep Sarma via zshao) - - HIVE-162. Fix join0.q test failure with hadoop 0.17. (zshao) - - HIVE-146. Fix builds for non-default build directory. - (David Phillips through zshao) - - HIVE-47. CLI to support multiline queries from an input file. - (Ashish through zshao) - - HIVE-103. Disable inserts in sub queries. (Namit Jain through zshao) - - HIVE-92. Fixed union all for non-embedded query. (Namit Jain through zshao) - - HIVE-93. Dynamic serde to handle _-prefixed column names in DDL. - (Pete Wyckoff through zshao) - - HIVE-127. Fetch Task to pass the jobconf to SerDe. (Namit through zshao) - - HIVE-116. Let test depend on deploy. (Johan Oskarsson through zshao) - - HIVE-90. Fixed TestGetDBs for File.list() order. - (Johan Oskarsson through zshao) - - HIVE-111. Support join without a ON clause. (Namit through zshao) - - HIVE-77. Thread safe query execution. (Joydeep through zshao) - - HIVE-86. Drop table should not delete data for external tables. - (Johan Oskarsson through zshao) - - HIVE-108. Sampling to use internal column name. (Namit through zshao) - - HIVE-60. Fix the build scripts for the new hive tree. - (Ashish through zshao) - - HIVE-54. Create this file to record the patches going into a - particular release. (dhruba) - - HIVE-12. Improve README for Hive. - (Ashish Thusoo via dhruba) - - HIVE-68. Fix casting to short. - (Ashish Thusoo via dhruba) - - HIVE-70. A configuration variable that limits the amount of data - writen by a task to its standard error. - (Joydeep Sen Sarma via dhruba) - - HIVE-17. Remove duplicate entries for hive.metastore.uris in config file. - (Jeff Hammerbacher via dhruba) - - HIVE-72. Generate correct results when partition pruning is not strict - and no map-reduce jobs are needed. (Namim Jain via dhruba) - - HIVE-75. Make limit work when applied to outermost block that is not - a query. (Namim Jain via dhruba) - - HIVE-76. Fix for column number mismatch between query and destination - tables when alias.* expressions are present in the select list of a - join. (Ashish Thusoo via dhruba) - - HIVE-196. Two test runs can run simultaneously on the same machine. - (Ashish Thusoo via dhruba) - - HIVE-202. Fix Lineage for join queries. - (Suresh Antony via dhruba) - - HIVE-84. Make MetaStore Client thread safe. (Prasad Chakka via dhruba) - - HIVE-203. Fix eclipse templates to get junit tests to run. - (Raghotham Murthy via dhruba) - - HIVE-220. Incorrect log directory in TestMTQueries causing null pointer - exception. (Prasad Chakka via dhruba) - - HIVE-230. Fix for a Null Pointer Exception that occured while loading a - table from a query that returns empty data. (Prasad Chakka via dhruba) - - HIVE-232. Metastore.warehouse configuration should use inherited - hadoop configuration. (Prasad Chakka via dhruba) - - HIVE-239. Check that replace columns in alter table does not have names - that are same as the partitioning columns. (Prasad Chakka via athusoo) - - HIVE-25. Enable Table aliases in cluster by, distribute by and sort - by clauses. (Prasad Chakka via athusoo) - - HIVE-217. Report progress during FileSinkOperator in order to avoid - Stream closes exceptions. (Johan Oskarsson via athusoo) - - HIVE-242. Fix to allow CLI to interpret line breaks in any CLI - command. (Prasad Chakka via athusoo) - - HIVE-65. Rewrite typechecking to use the walker interface and add - Resolvers to UDF and UDAF to support proper implicit casting - in a manner similar to other RDBMSs. (athusoo) - - HIVE-246. Fix to make msck command to look for tables in hdfs - that are in the metastore. (Johan Oskarsson via athusoo) - - HIVE-248. Create file path names properly during the load command - in case relative path names were specified. (Prasad Chakka via athusoo) - - HIVE-179. Make substr behavior similar to other RDBMS. - (David Phillips via athusoo) - - HIVE-257. Set hive history log location to build for tests. - (Suresh Anthony via athusoo) - - HIVE-256. Fix in map side aggregation wherein we were not including - private members of the records in calculating the avg size of the - rows and we were also not estimating variable length columns - properly. (Namit Jain via athusoo) - - HIVE-262. Fix for joins wherein a merged join having and outer or - right outer join gave spurious rows in join. (Namit Jain via athusoo) - - HIVE-189. Make sampling tests deterministic by sorting output. (athusoo) - - HIVE-273. Fix avg UDAF which got broken hive 65. (athusoo) - - HIVE-283. Do case insensitive comparison of aliases in partition - pruning. (athusoo) - - HIVE-1088. RCFileRecordReader's first split will read duplicate rows if - the split end is < the first sync mark (Yongqiang He via Ning Zhang) - - HIVE-1087. Let user script write out binary data into a table - (Zheng Shao via Ning Zhang) - diff --git build.xml build.xml index 25f8945..b74371c 100644 --- build.xml +++ build.xml @@ -42,7 +42,6 @@ - @@ -458,23 +457,9 @@ - - - - - - - - - - - - - -