

# Amazon EMR 6.12.0 - Hive release notes
<a name="Hive-release-history-6120"></a>

## Amazon EMR 6.12.0 - Hive changes
<a name="Hive-release-history-changes-6120"></a>


****  

| Type | Description | 
| --- | --- | 
| Improvement | Added Support For JDK 11 and JDK 17 Runtime | 
| Improvement | Add support to query case sensitive and reserved keyword column names when using S3 Select. To use it, define table property in format "s3select.column.mapping" = "{{column1}}:{{fieldName1}}, {{column2}}:{{fieldName2}},..." | 
| Improvement | [HIVE-23133](https://issues.apache.org/jira/browse/HIVE-23133): Numeric operations can have different result across hardware archs | 
| Improvement | [HIVE-27145](https://issues.apache.org/jira/browse/HIVE-27145): Use StrictMath for remaining Math functions as followup of HIVE-23133 | 
| Bug Fix | Fix wildcard incompatibility in get\_partitions\_by\_filter and get\_num\_partitions\_by\_filter HMS APIs caused by porting [HIVE-22900](https://issues.apache.org/jira/browse/HIVE-22900) in EMR Hive 6.4.0 | 
| Bug Fix | [HIVE-26736](https://issues.apache.org/jira/browse/HIVE-26736): Authorization failure for nested Views having WITH clause | 
| Bug Fix | [HIVE-22416](https://issues.apache.org/jira/browse/HIVE-22416): MR-related operation logs missing when parallel execution is enabled | 
| Bug Fix | [HIVE-19653](https://issues.apache.org/jira/browse/HIVE-19653): Incorrect predicate pushdown for groupby with grouping sets | 
| Bug Fix | [HIVE-22094](https://issues.apache.org/jira/browse/HIVE-22094): queries failing with ClassCastException: hive.ql.exec.vector.DecimalColumnVector cannot be cast to hive.ql.exec.vector.Decimal64ColumnVector | 
| Bug Fix | [HIVE-26340](https://issues.apache.org/jira/browse/HIVE-26340): Vectorized PTF operator fails if query has upper case window function | 
| Bug Fix | [HIVE-26184](https://issues.apache.org/jira/browse/HIVE-26184): COLLECT\_SET with GROUP BY is very slow when some keys are highly skewed | 
| Bug Fix | [HIVE-26373](https://issues.apache.org/jira/browse/HIVE-26373): ClassCastException when reading timestamps from HBase table with Avro data | 
| Bug Fix | [HIVE-26388](https://issues.apache.org/jira/browse/HIVE-26388): ClassCastException when there is non string type column in source table of CTAS query Upgrade [HIVE-26172](https://issues.apache.org/jira/browse/HIVE-26172): Hive - Upgrade Ant to 1.10.11 due to CVE-2021-36373 and CVE-2021-36374 | 
| Bug Fix | [HIVE-26114](https://issues.apache.org/jira/browse/HIVE-26114): Fix jdbc connection hiveserver2 using dfs command with prefix space will cause exceptio | 
| Bug Fix | [HIVE-26396](https://issues.apache.org/jira/browse/HIVE-26396): The trunc function has a problem with precision interception and the result has many 0 | 
| Bug Fix | [HIVE-26446](https://issues.apache.org/jira/browse/HIVE-26446): HiveProtoLoggingHook fails to populate TablesWritten field for partitioned tables. | 
| Bug Fix | [HIVE-26639](https://issues.apache.org/jira/browse/HIVE-26639): ConstantVectorExpression and ExplainTask shouldn't rely on default charset | 
| Bug Fix | [HIVE-22670](https://issues.apache.org/jira/browse/HIVE-22670): ArrayIndexOutOfBoundsException when vectorized reader is used for reading a parquet file | 
| Bug Fix | [HIVE-23607](https://issues.apache.org/jira/browse/HIVE-23607): Permission Issue: Create view on another view succeeds but alter view fails | 
| Bug Fix | [HIVE-25498](https://issues.apache.org/jira/browse/HIVE-25498): Query with more than 31 count distinct functions returns wrong result | 
| Bug Fix | [HIVE-25780](https://issues.apache.org/jira/browse/HIVE-25780): DistinctExpansion creates more than 64 grouping sets II | 
| Bug Fix | [HIVE-23868](https://issues.apache.org/jira/browse/HIVE-23868): Windowing function spec: support 0 preceeding/following | 
| Bug Fix | [HIVE-24539](https://issues.apache.org/jira/browse/HIVE-24539): OrcInputFormat schema generation should respect column delimiter | 
| Bug Fix | [HIVE-23476](https://issues.apache.org/jira/browse/HIVE-23476): LLAP: Preallocate arenas for mmap case as well | 
| Bug Fix | [HIVE-25806](https://issues.apache.org/jira/browse/HIVE-25806): Possible leak in LlapCacheAwareFs - Parquet, LLAP IO | 
| Bug Fix | [HIVE-23498](https://issues.apache.org/jira/browse/HIVE-23498): Disable HTTP Trace method on ThriftHttpCliService | 
| Bug Fix | [HIVE-25729](https://issues.apache.org/jira/browse/HIVE-25729): ThriftUnionObjectInspector should be notified when fully inited | 
| Bug Fix | [HIVE-23846](https://issues.apache.org/jira/browse/HIVE-23846): Avoid unnecessary serialization and deserialization of bitvectors | 
| Bug Fix | [HIVE-24233](https://issues.apache.org/jira/browse/HIVE-24233): except subquery throws nullpointer with cbo disabled | 
| Bug Fix | [HIVE-24276](https://issues.apache.org/jira/browse/HIVE-24276): HiveServer2 loggerconf jsp Cross-Site Scripting (XSS) Vulnerability | 
| Bug Fix | [HIVE-25721](https://issues.apache.org/jira/browse/HIVE-25721): Outer join result is wrong | 
| Bug Fix | [HIVE-25223](https://issues.apache.org/jira/browse/HIVE-25223): Select with limit returns no rows on non native table | 
| Bug Fix | [HIVE-25794](https://issues.apache.org/jira/browse/HIVE-25794): CombineHiveRecordReader: log statements in a loop leads to memory pressure | 
| Bug Fix | [HIVE-23602](https://issues.apache.org/jira/browse/HIVE-23602): Use Java Concurrent Package for Operation Handle Set | 
| Bug Fix | [HIVE-24045](https://issues.apache.org/jira/browse/HIVE-24045): No logging related to when default database is created | 
| Bug Fix | [HIVE-24305](https://issues.apache.org/jira/browse/HIVE-24305): avro decimal schema is not properly populating scale/precision if value is enclosed in quote | 
| Bug Fix | [HIVE-25040](https://issues.apache.org/jira/browse/HIVE-25040): Drop database cascade cannot remove persistent functions | 
| Bug Fix | [HIVE-23501](https://issues.apache.org/jira/browse/HIVE-23501): AOOB in VectorDeserializeRow when complex types are converted to primitive types | 
| Bug Fix | [HIVE-23704](https://issues.apache.org/jira/browse/HIVE-23704): Thrift HTTP Server Does Not Handle Auth Handle Correctly | 
| Bug Fix | [HIVE-23529](https://issues.apache.org/jira/browse/HIVE-23529): CTAS is broken for uniontype when row\_deserialize | 
| Bug Fix | [HIVE-24144](https://issues.apache.org/jira/browse/HIVE-24144): getIdentifierQuoteString in HiveDatabaseMetaData returns incorrect value | 
| Bug Fix | [HIVE-23850](https://issues.apache.org/jira/browse/HIVE-23850): Allow PPD when subject is not a column with grouping sets present | 
| Bug Fix | [HIVE-25919](https://issues.apache.org/jira/browse/HIVE-25919): ClassCastException when pushing boolean column predicate in HBaseStorageHandler | 
| Bug Fix | [HIVE-25261](https://issues.apache.org/jira/browse/HIVE-25261): RetryingHMSHandler should wrap the MetaException with short description of the target | 
| Bug Fix | [HIVE-24792](https://issues.apache.org/jira/browse/HIVE-24792): Potential thread leak in Operation | 
| Bug Fix | [HIVE-23409](https://issues.apache.org/jira/browse/HIVE-23409): If TezSession application reopen fails for Timeline service down, default TezSession from SessionPool is closed after a retry | 
| Bug Fix | [HIVE-23615](https://issues.apache.org/jira/browse/HIVE-23615): Do not deference null pointers in Beeline Commands Class | 
| Bug Fix | [HIVE-24849](https://issues.apache.org/jira/browse/HIVE-24849): Create external table socket timeout when location has large number of files (affects 3.1.2) | 
| Bug Fix | [HIVE-25209](https://issues.apache.org/jira/browse/HIVE-25209): SELECT query with SUM function producing unexpected result | 
| Bug Fix | [HIVE-23666](https://issues.apache.org/jira/browse/HIVE-23666): checkHashModeEfficiency is skipped when a groupby operator doesn't have a grouping set | 
| Bug Fix | [HIVE-23873](https://issues.apache.org/jira/browse/HIVE-23873): Querying Hive JDBCStorageHandler table fails with NPE when CBO is off | 
| Bug Fix | [HIVE-24149](https://issues.apache.org/jira/browse/HIVE-24149): HiveStreamingConnection doesn't close HMS connection | 
| Bug Fix | [HIVE-25561](https://issues.apache.org/jira/browse/HIVE-25561): Killed task should not commit file. (affects 2.x and 3.x versions) | 
| Bug Fix | [HIVE-25683](https://issues.apache.org/jira/browse/HIVE-25683): Close reader in AcidUtils.isRawFormatFile | 
| Bug Fix | [HIVE-24294](https://issues.apache.org/jira/browse/HIVE-24294): TezSessionPool sessions can throw AssertionError | 
| Bug Fix | [HIVE-24182](https://issues.apache.org/jira/browse/HIVE-24182): Ranger authorization issue with permanent UDFs | 
| Bug Fix | [HIVE-22805](https://issues.apache.org/jira/browse/HIVE-22805): Vectorization with conditional array or map is not implemented and throws an error | 
| Bug Fix | [HIVE-22828](https://issues.apache.org/jira/browse/HIVE-22828): Decimal64: NVL and CASE statements implicitly convert decimal64 to 128 | 
| Bug Fix | [HIVE-21398](https://issues.apache.org/jira/browse/HIVE-21398): Columns which has estimated statistics should not be considered as unique keys | 
| Bug Fix | [HIVE-22490](https://issues.apache.org/jira/browse/HIVE-22490): Adding jars with special characters in their path throws error | 
| Bug Fix | [HIVE-22700](https://issues.apache.org/jira/browse/HIVE-22700): Compactions may leak memory when unauthorized | 
| Bug Fix | [HIVE-22053](https://issues.apache.org/jira/browse/HIVE-22053): Function name is not normalized when creating function | 
| Bug Fix | [HIVE-22595](https://issues.apache.org/jira/browse/HIVE-22595): Dynamic partition inserts fail on Avro table table with external schema | 
| Bug Fix | [HIVE-21795](https://issues.apache.org/jira/browse/HIVE-21795): Rollup summary row might be missing when a mapjoin is happening on a partitioned table | 
| Bug Fix | [HIVE-22987](https://issues.apache.org/jira/browse/HIVE-22987): ClassCastException in VectorCoalesce when DataTypePhysicalVariation is null | 
| Bug Fix | [HIVE-22219](https://issues.apache.org/jira/browse/HIVE-22219): Bringing a node manager down blocks restart of LLAP service | 
| Bug Fix | [HIVE-21793](https://issues.apache.org/jira/browse/HIVE-21793): CBO retrieves column stats even if hive.stats.fetch.column.stats is set to false | 
| Bug Fix | [HIVE-22163](https://issues.apache.org/jira/browse/HIVE-22163): CBO: Enabling CBO turns on stats estimation, even when the estimation is disabled | 
| Bug Fix | [HIVE-18735](https://issues.apache.org/jira/browse/HIVE-18735): Create table like loses transactional attribute | 
| Bug Fix | [HIVE-22433](https://issues.apache.org/jira/browse/HIVE-22433): Hive JDBC Storage Handler: Incorrect results fetched from BOOLEAN and TIMESTAMP DataType From JDBC Data Source | 
| Bug Fix | [HIVE-19430](https://issues.apache.org/jira/browse/HIVE-19430): ObjectStore.cleanNotificationEvents OutOfMemory on large number of pending events | 
| Bug Fix | [HIVE-20785](https://issues.apache.org/jira/browse/HIVE-20785): Wrong key name in the JDBC DatabaseMetaData.getPrimaryKeys method | 
| Bug Fix | [HIVE-16116](https://issues.apache.org/jira/browse/HIVE-16116): Beeline throws NPE when beeline.hiveconfvariables={} in beeline.properties | 
| Bug Fix | [HIVE-20066](https://issues.apache.org/jira/browse/HIVE-20066): hive.load.data.owner is compared to full principal | 
| Bug Fix | [HIVE-20489](https://issues.apache.org/jira/browse/HIVE-20489): Explain plan of query hangs | 
| Bug Fix | [HIVE-21033](https://issues.apache.org/jira/browse/HIVE-21033): Forgetting to close operation cuts off any more HiveServer2 output | 
| Bug Fix | [HIVE-19888](https://issues.apache.org/jira/browse/HIVE-19888): Misleading "METASTORE\_FILTER\_HOOK will be ignored" warning from SessionState | 
| Bug Fix | [HIVE-20303](https://issues.apache.org/jira/browse/HIVE-20303): INSERT OVERWRITE TABLE db.table PARTITION (...) IF NOT EXISTS throws InvalidTableException | 
| Bug Fix | [HIVE-16144](https://issues.apache.org/jira/browse/HIVE-16144): CompactionInfo doesn't have equals/hashCode but used in Set | 
| Bug Fix | [HIVE-20818](https://issues.apache.org/jira/browse/HIVE-20818): Views created with a WHERE subquery will regard views referenced in the subquery as direct input | 
| Bug Fix | [HIVE-21005](https://issues.apache.org/jira/browse/HIVE-21005): LLAP: Reading more stripes per-split leaks ZlibCodecs | 
| Bug Fix | [HIVE-20771](https://issues.apache.org/jira/browse/HIVE-20771): LazyBinarySerDe fails on empty structs. | 
| Bug Fix | [HIVE-18852](https://issues.apache.org/jira/browse/HIVE-18852): Misleading error message in alter table validation | 
| Bug Fix | [HIVE-21124](https://issues.apache.org/jira/browse/HIVE-21124): HPL/SQL does not support the CREATE TABLE LIKE statement | 
| Bug Fix | [HIVE-20935](https://issues.apache.org/jira/browse/HIVE-20935): Upload of llap package tarball fails in EC2 causing LLAP service start failure | 
| Bug Fix | [HIVE-20409](https://issues.apache.org/jira/browse/HIVE-20409): Hive ACID: Update/delete/merge does not clean hdfs staging directory | 
| Bug Fix | [HIVE-20570](https://issues.apache.org/jira/browse/HIVE-20570): Union ALL with hive.optimize.union.remove=true has incorrect plan | 
| Bug Fix | [HIVE-20421](https://issues.apache.org/jira/browse/HIVE-20421): Illegal character entity '\\b' in hive-default.xml.template | 
| Bug Fix | [HIVE-19133](https://issues.apache.org/jira/browse/HIVE-19133): HS2 WebUI phase-wise performance metrics not showing correctly | 
| Bug Fix | [HIVE-18977](https://issues.apache.org/jira/browse/HIVE-18977): Listing partitions returns different results with JDO and direct SQL | 
| Bug Fix | [HIVE-20034](https://issues.apache.org/jira/browse/HIVE-20034): Roll back MetaStore exception handling changes for backward compatibility | 
| Bug Fix | [HIVE-20672](https://issues.apache.org/jira/browse/HIVE-20672): Logging thread in LlapTaskSchedulerService should report every fixed interval | 
| Bug Fix | [HIVE-12812](https://issues.apache.org/jira/browse/HIVE-12812): Enable mapred.input.dir.recursive by default to support union with aggregate function | 
| Bug Fix | [HIVE-20147](https://issues.apache.org/jira/browse/HIVE-20147): Hive streaming ingest is contented on synchronized logging | 
| Bug Fix | [HIVE-19203](https://issues.apache.org/jira/browse/HIVE-19203): Thread-Safety Issue in HiveMetaStore | 
| Bug Fix | [HIVE-20091](https://issues.apache.org/jira/browse/HIVE-20091): Tez: Add security credentials for FileSinkOperator output | 
| Bug Fix | [HIVE-16906](https://issues.apache.org/jira/browse/HIVE-16906): Hive ATSHook should check for yarn.timeline-service.enabled before connecting to ATS | 
| Bug Fix | [HIVE-20714](https://issues.apache.org/jira/browse/HIVE-20714): SHOW tblproperties for a single property returns the value in the name column | 
| Bug Fix | [HIVE-24730](https://issues.apache.org/jira/browse/HIVE-24730): Shims classes override values from hive-site.xml and tez-site.xml silently | 
| Bug Fix | [HIVE-22055](https://issues.apache.org/jira/browse/HIVE-22055): select count gives incorrect result after loading data from text file | 