Bug 16040 - Long vectors support for the transmission in the multicore part of parallel
Summary: Long vectors support for the transmission in the multicore part of parallel
Status: NEW
Alias: None
Product: R
Classification: Unclassified
Component: Wishlist (show other bugs)
Version: R 3.0.2
Hardware: x86_64/x64/amd64 (64-bit) Linux
: P5 enhancement
Assignee: R-core
URL:
Depends on:
Blocks:
 
Reported: 2014-10-23 11:24 UTC by Julien Damon
Modified: 2014-10-23 11:24 UTC (History)
0 users

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Julien Damon 2014-10-23 11:24:15 UTC
For now, the multicore part of parallel currently doesn't support long vectors for the transmission so the result for one worker cannot exceed 2Gb.

source : http://r.789695.n4.nabble.com/R-3-0-1-parallel-collection-triggers-quot-long-memory-not-supported-yet-quot-td4668388.html 

Use cases of such an enhancement are various when you are working with datasets bigger than 2Gb and want to have some parallel executions. A very simple example is to load simultaneously two or more datasets.

Best regards,
  Julien Damon.