Blog Archives

Parallel processing with short jobs only increases the run time

Parallel processing has become much more important over the years as multi-core processors have become common place. From version 02.14 onwards, parallel processing has become part of the standard R installation in the form of the parallel package. This package

Tagged with: , ,
Posted in R stuff

Parallelization using plyr: loading objects and packages into worker nodes

I really love the plyr package. Apart from having a progress bar and plyr handeling a lot of the overhead, a very interesting feature is being able to run plyr in parallel mode. Essentially, setting .parallel = TRUE runs any

Tagged with: , , ,
Posted in R stuff