Affects Version/s: None
Fix Version/s: None
Paths in HMS are expected to be in one of these forms:
- /path, in which case, scheme will be constructed from FileSystem.getDefaultURI
- URIs with non hdfs scheme will just be ignored
I came across atleast 2 sentry users where HMS did have paths which do not comply with above rules and hence HMS plugin initialization for pathupdates failed. See sentry-1260 and sentry-1270 for details on how these errors surface.
With 1260 and 1270 we should have more information on what these malformed paths were. But we should continue to investigate and fix the root cause, It would most likely be in HMS code base. Until then, here is how you can diagnose and fix it manually:
Look for malformed paths in HMS : Look in DBS as well as SDS tables.
Fix it manually updating the HMS location
Lets track occurrences of these malformed paths here:
- hdfs://nameservice1 : Not sure why would any one create a db/table in root directory? Should we accept this in Sentry?
What does SKEWED_COL_VALUE_LOC_MAP.location in HMS correspond to? Double check if there are any malformed paths here?