hadoop - How to load split HDFS files to Oracle database? -


i need load data split files on hdfs oracle database.

[user@asdf 007]$ hadoop dfs -ls  hdfs://xxxxxx/split_files/test_folder/test_table_with_partitions/* found 18 items drwxrwxrwx   - bigsql hdfs          0 2017-07-24 01:00 hdfs://xxxxxx/split_files/test_folder/test_table_with_partitions/tm=2017-07-24/dept=1 drwxrwxrwx   - bigsql hdfs          0 2017-07-24 01:00 hdfs://xxxxxx/split_files/test_folder/test_table_with_partitions/tm=2017-07-24/dept=2 drwxrwxrwx   - bigsql hdfs          0 2017-07-24 01:00 hdfs://xxxxxx/split_files/test_folder/test_table_with_partitions/tm=2017-07-24/dept=3 drwxrwxrwx   - bigsql hdfs          0 2017-07-24 01:00 hdfs://xxxxxx/split_files/test_folder/test_table_with_partitions/tm=2017-07-24/dept=4 drwxrwxrwx   - bigsql hdfs          0 2017-07-24 01:00 hdfs://xxxxxx/split_files/test_folder/test_table_with_partitions/tm=2017-07-24/dept=5 .......

if open files inside folder

hdfs://xxxxxx/split_files/test_folder/test_table_with_partitions/tm=2017-07-24/dept=5

they don't have time & department information inside them. hence when use sqoop information not loaded database table.

how can information loaded database too? there option in sqoop it?

from given details hdfs files refer hive table.

to export partitioned hive table rdbms have make use of --hcatalog-table argument of sqoop. example given below, test1 hive table partitioned , being exported mysql table test.test.

sqoop export --connect jdbc:mysql://10.0.0.35:3306/test --username root --table test1 --hcatalog-table test1

to export oracle database have replace jdbc:mysql://10.0.0.35:3306/test jdbc:oracle:thin:@<hostname>:<port>:<service>


Comments

Post a Comment

Popular posts from this blog

python - Selenium remoteWebDriver (& SauceLabs) Firefox moseMoveTo action exception -

while performing simple hover test on firefox through selenium (3.4.0) python bindings (3.4.3) using of available os in saucelabs (except linux, latest available firefox version old), performing following actionchain: hover = actionchains(driver) hover.move_to_element(elm_men_menu).perform() it throws following error: taceback: file [...] in testhover hover.perform() file "/usr/local/lib/python2.7/dist-packages/selenium/webdriver/common/action_chains.py", line 80, in perform action() file "/usr/local/lib/python2.7/dist-packages/selenium/webdriver/common/action_chains.py", line 290, in <lambda> command.move_to, {'element': to_element.id})) file "/usr/local/lib/python2.7/dist-packages/selenium/webdriver/remote/webdriver.py", line 256, in execute self.error_handler.check_response(response) file "/usr/local/lib/python2.7/...
Read more

html - How to custom Bootstrap grid height? -

why bootstrap grid has height 591.067 ? did height came ? .main-post { padding: 20px; background-color: #fff; border: 1px solid #d8d8d8; margin-bottom: 100px; } .main-post .post-categories { margin-bottom: 10px } .main-post h3 { margin: 0 0 10px; color: #777; letter-spacing: -1px; font-weight: bold } .main-post .post-author, .main-post .post-date, .main-post .post-comments { font-size: 12px } .main-post img { display: block; margin: 10px 0; } .main-post .post-summary { line-height: 1.7; color: #888 } .main-post { color: #999 } <div class="col-sm-6"> <div class="main-post"> <h3 class="post-title"> <a href="#"> post title </a> </...
Read more

transpose - Maple isnt executing function but prints function term -

im using maple im in worksheetmode tried using maple input , 2d input , want transpose matrix a: := `<|>`(`<,>`(1, .5, -2), `<,>`(.5, 9/4+b, 5+3*b), `<,>`(-2, 5+3*b, 18+9*b+4*a)); b:= transpose(a); when exectute sheet dont translated values, there same input. matrix looks same input matrix plus function term. you can see picture in following link: why arent functions executed? meanwhile b:=a^+ doing right way , transposed matrix. other functions return function body instead needed values... if using 2d input mode (the default) space you've got between transpose , bracketed (b) interpreted multiplcation. rid of such space. also, either load package @ start of document like, with(linearalgebra): before calling transpose command package, or call it's full name like, linearalgebra:-transpose(b);
Read more