Creating a Large Matrix in ff

Posted by Ryan Rosario on Stack Overflow See other posts from Stack Overflow or by Ryan Rosario
Published on 2010-05-01T18:14:58Z Indexed on 2010/05/01 18:17 UTC
Read the original article Hit count: 331

Filed under:
|

I am trying to create a huge matrix in ff, and I know that ff is good for this sort of thing.

But, there is a major problem. The dimensions of the matrix exceed .Machine$max_integer! I am running on a 64 bit machine, using 64bit R and 64bit ff.

Is there any way to get around this problem?

It's been suggested that R is using the MAXINT value from stdint.h. Is there any way to fix this without changing that file and possibly breaking build?

> ffMatrix <- ff(vmode="boolean", dim=c(1e10,1e10))
Error in if (length < 0 || length > .Machine$integer.max) stop("length must be between 1 and .Machine$integer.max") : 
  missing value where TRUE/FALSE needed
In addition: Warning message:
In ff(vmode = "boolean", dim = c(1e+10, 1e+10)) :
  NAs introduced by coercion

> 1e+10 > .Machine$integer.max
[1] TRUE

© Stack Overflow or respective owner

Related posts about r

    Related posts about rstats