io.xskipper.metadatastore.parquet
Wrapper for stringToPath to return backend specific error message
Wrapper for stringToPath to return backend specific error message
string to convert to org.apache.hadoop.fs.Path
metadata hadoop fs path
ParquetMetaDataStoreException
if invalid path
Metadata base location
ParquetMetaDataStoreException
if invalid metaDataLocation or invalid metadataType
Given a db name extracts the base path from the database parameters
Constructs the metadata path for a given base path and a uri by concatenating sha256 digest of the uri to the base path
Constructs the metadata path for a given base path and a uri by concatenating sha256 digest of the uri to the base path
the base path
the uri of the dataset (can be either a path or table identifier)
the path of the metadata
Resolves the metadata path according to the given parameters
Resolves the metadata path according to the given parameters
SparkSession instance for accessing the catalog if needed
the URI of the dataset
depending on the type can be: type = EXPLICIT_METADATA_LOCATION => an explicit location of the metadata type = EXPLICIT_BASE_PATH_LOCATION => an explicit definition of the base path of the metadata type = HIVE_TABLE_NAME => the name of the hive table that contains the table properties the exact path of the metadata. Note that if the parameter contains only the table name then the current database is used type = HIVE_DB_NAME => the name of the hive database that contains in the db properties the base path of the metadata
the path of the metadata