KnowledgeHub
Questions
Tags
Users
Search
Alex Rivera
|
Logout
Edit Question
Title
Body
I am loading the following packages into R: library(foreach) library(doParallel) library(iterators) I "parallelize" code for a long time, but lately I am getting INTERMITTENT stops while code is running. The error is: Error in serialize(data, node$con) : error writing to connection My educated guess is that maybe the connection that I open using the commands below, has expired: ## Register Cluster ## cores<-8 cl <- makeCluster(cores) registerDoParallel(cl) Looking at makeCluster man page I see that by default the connections expires only after 30 days! I could set options(error=recover) in order to check, on the fly, if the connection is opened or not when the code halts, but I decided to post this general question before. IMPORTANT: 1) the error is really intermittent, sometimes I re-run the same code and get no errors. 2) I run everything on the same multi-core machine (Intel/8 cores). So it is not a communation (network) problem among the clusters. 3) I am a heavy user of CPU and GPU parallelization, on my laptop and desktop (64 cores) Unfortunately, it is the first time that I am getting this type of error. Is anybody having the same type of error? As requested I am providing my sessionInfo(): > sessionInfo() R version 2.15.3 (2013-03-01) Platform: x86_64-w64-mingw32/x64 (64-bit) locale: [1] LC_COLLATE=English_United States.1252 LC_CTYPE=English_United States.1252 LC_MONETARY=English_United States.1252 LC_NUMERIC=C [5] LC_TIME=English_United States.1252 attached base packages: [1] parallel stats graphics grDevices utils datasets methods base other attached packages: [1] TTR_0.22-0 xts_0.9-3 doParallel_1.0.1 iterators_1.0.6 foreach_1.4.0 zoo_1.7-9 Revobase_6.2.0 RevoMods_6.2.0 loaded via a namespace (and
Tags (comma-separated)
Save Edits
Cancel