r - rjdbc Parallel query with parallelmap -
i'm trying run query in parallele , 00001: error in .jcheck() : no running jvm detected. maybe .jinit() help. error. queries working when run them 1 one
my script:
i know it's not reproductible can't give give log/pass :)
i tried .jinit() , sys.setenv(java_home='c:\\program files\\java\\jdk1.8.0_102') in slave it's not working
library(rjdbc) library(parallelemap) jdbcdriver <- jdbc(driverclass="oracle.jdbc.oracledriver", classpath="ojdbc6.jar" ) jdbcconnection <- dbconnect(jdbcdriver, "jdbc:oracle:thin:@//mybase", "login", "pass") query_list<- list( "select * table1", "select * table2", "select * table3", "select * table4", "select * table5") import_base_fonction <- function(query) {return(dbgetquery( jdbcconnection , query))} parallelstartsocket( 5 ) parallellibrary("rjdbc","rjava") parallelexport("listquery_list","import_base_fonction" ,"jdbcconnection") mes_tables <- parallelmap(import_base_fonction,query_list) parallelstop() my session info
r version 3.4.1 (2017-06-30) platform: x86_64-w64-mingw32/x64 (64-bit) running under: windows server >= 2012 x64 (build 9200) matrix products: default locale: [1] lc_collate=french_france.1252 lc_ctype=french_france.1252 lc_monetary=french_france.1252 lc_numeric=c lc_time=french_france.1252 attached base packages: [1] stats graphics grdevices utils datasets methods base other attached packages: [1] parallelmap_1.3 phvid_1.0.8 mcmcpack_1.4-0 mass_7.3-47 coda_0.19-1 lbe_1.44.0 dplyr_0.7.1 [8] plyr_1.8.4 shiny_1.0.3 dt_0.2 shinydashboard_0.6.1 data.table_1.10.4 rjdbc_0.2-5 rjava_0.9-8 [15] dbi_0.7 loaded via namespace (and not attached): [1] rcpp_0.12.11 compiler_3.4.1 bindr_0.1 tools_3.4.1 digest_0.6.12 checkmate_1.8.3 tibble_1.3.3 lattice_0.20-35 [9] pkgconfig_2.0.1 rlang_0.1.1 matrix_1.2-10 parallel_3.4.1 sparsem_1.77 bindrcpp_0.2 htmlwidgets_0.9 matrixmodels_0.4-1 [17] grid_3.4.1 glue_1.1.1 r6_2.2.2 magrittr_1.5 backports_1.1.0 bbmisc_1.11 htmltools_0.3.6 mcmc_0.9-5 [25] assertthat_0.2.0 mime_0.5 xtable_1.8-2 httpuv_1.3.5 quantreg_5.33 the base on oracle 11.xx server.
please guide.
i think can change import_base_fonction
import_base_fonction <- function(query) { .jinit("ojdbc6.jar") return(dbgetquery( jdbcconnection , query)) }
Comments
Post a Comment