Affects Version/s: None
Fix Version/s: None
- Create a CSV file from bug data.
- Upload this file to HDFS
- Use spark2 interpreter to read the csv file and convert it to dataframe.
Steps to reproduce:
While converting csv file data to dataframe , spark-shell throws below WARN message.
"WARN DataSource: Error while looking for metadata directory." message is not shown in output of zeppelin notebook. This warn message is a key to debug the notebook failure.
Since zeppelin does not print this message , It becomes hard for an user to debug issue from zeppelin.
Tried with sc.setLogLevel("DEBUG") as well. But this message wasn't printed.