[HUDI-901] Bug Bash 0.6.0 Tracking Ticket

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.7.0
• Assignee: sivabalan narayanan
• Reporter: sivabalan narayanan
• Created: 15/May/20 12:14
• Updated: 03/Dec/20 03:06
• Resolved: 23/Sep/20 01:14

Description

This is a tracking ticket for all bug bash 0.6.0 tickets. 

We have done our best to assign tickets to those who might have good context and to those who volunteered for bug bash. The cursory assignment is just to help you out, and by no means forcing you to work on it. If you feel you can't work on it, please unassign yourself, or you could swap with someone here. 

All tickets are labelled with "bug-bash-0.6.0". If anyone feels to pitch in with any of the work you have or currently doing, feel free to add the label, but don't remove from existing ones. 

Some tickets are support ones, which might need follow up questions/clarifications with the reporter of the ticket. For those try to start working right away so we can drive to completion by end of day 10. 

We are looking to time it for 10 days. Planning to wrap it up by 27th of May. 

Again, we totally understand that some tickets may not be completed by the time due to various reasons, like support questions, not able to repro locally, env mis-match, swamped with some PR work, or don't have cycles during these 10 days, etc. Let's try our best to take these to completion.

We are all ears for any questions or clarification. Please respond here in Jira or you could send an email to our mailing list in bug bash thread.

 

 

 

 

Issue Links

• depends upon: HUDI-258 Hive Query engine not supporting join queries between RT and RO tables
• depends upon: HUDI-722 IndexOutOfBoundsException in MessageColumnIORecordConsumer.addBinary when writing parquet
• depends upon: HUDI-733 presto query data error
• depends upon: HUDI-786 InlineFileSystem.read API should ensure content beyond inline length gets an EOF
• depends upon: HUDI-863 nested structs containing decimal types lead to null pointer exception
• depends upon: HUDI-395 hudi does not support scheme s3n when wrtiing to S3
• depends upon: HUDI-718 java.lang.ClassCastException during upsert
• depends upon: HUDI-723 SqlTransformer's schema sometimes is not registered.
• depends upon: HUDI-867 Graphite metrics are throwing IllegalArgumentException on continuous mode
• depends upon: HUDI-528 Incremental Pull fails when latest commit is empty
• depends upon: HUDI-4 Support for writing to EMRFS
• depends upon: HUDI-92 Include custom names for spark HUDI spark DAG stages for easier understanding
• depends upon: HUDI-836 Implement datadog metrics reporter
• depends upon: HUDI-773 Hudi On Azure Data Lake Storage V2
• depends upon: HUDI-818 Optimize the default value of hoodie.memory.merge.max.size option
• depends upon: HUDI-259 Hadoop 3 support for Hudi writing
• depends upon: HUDI-859 Improve documentation around key generators
• depends upon: HUDI-760 Remove Rolling Stat management from Hudi Writer
• depends upon: HUDI-110 Better defaults for Partition extractor for Spark DataSource and DeltaStreamer
• depends upon: HUDI-690 filtercompletedInstants in HudiSnapshotCopier not working as expected for MOR tables
• depends upon: HUDI-728 Support for complex record keys with TimestampBasedKeyGenerator
• depends upon: HUDI-794 Add support for maintaining separate table wise configs in HoodieDeltaStreamer similar to HoodieMultiTableDeltaStreamer
• depends upon: HUDI-837 Fix AvroKafkaSource to use the latest schema for reading
• depends upon: HUDI-473 IllegalArgumentException in QuickstartUtils
• depends upon: HUDI-303 Avro schema case sensitivity testing
• depends upon: HUDI-307 Dataframe written with Date,Timestamp, Decimal is read with same types
• depends upon: HUDI-494 [DEBUGGING] Huge amount of tasks when writing files into HDFS
• depends upon: HUDI-304 Bring back spotless plugin
• depends upon: HUDI-13 Clarify whether the hoodie-hadoop-mr jars need to be rolled out across Hive cluster #553