Hive: check what parameters are set in a session or for a job? -
we have few parameters in hive such following:
set hive.cbo.enable=true; set hive.compute.query.using.stats=true; set hive.stats.fetch.column.stats=true; set hive.stats.fetch.partition.stats=true; set mapreduce.job.running.map.limit=50; how check parameters set(true)?? how many mappers particular job using can seen in gui, how can check status of other parameters? there way so??
just print set param_name;
hive> set hive.cbo.enable; hive.cbo.enable=true or in query:
hive> select ${hiveconf:hive.cbo.enable}; ok true time taken: 1.042 seconds, fetched: 1 row(s) more complex example (check boolean variable in case):
hive> select case when ${hiveconf:hive.cbo.enable} 1 else 0 end; ok 1 time taken: 0.041 seconds, fetched: 1 row(s) hive> in shell:
hive_cbo_enable=$(hive -e 'select ${hiveconf:hive.cbo.enable} ;') echo "$hive_cbo_enable" true
all params true:
hive -e 'set;' | grep "=true" datanucleus.fixeddatastore=true datanucleus.rdbms.uselegacynativevaluestrategy=true dfs.block.access.token.enable=true dfs.client.block.write.replace-datanode-on-failure.enable=true dfs.client.mmap.enabled=true dfs.datanode.drop.cache.behind.reads=true dfs.datanode.drop.cache.behind.writes=true ...
Comments
Post a Comment