[Date Index] [Thread Index] [Author Index]

Re: Error on importing previously saved data file: Get::bigfile

• To: mathgroup at smc.vnet.net
• Subject: [mg122392] Re: Error on importing previously saved data file: Get::bigfile
• From: Leonid Shifrin <lshifr at gmail.com>
• Date: Thu, 27 Oct 2011 06:31:07 -0400 (EDT)
• Delivered-to: l-mathgroup@mail-archive0.wolfram.com
• References: <201110262136.RAA29918@smc.vnet.net>

Matthias,

Check out my implementation of an alternative to Import for "Table" format -
it lives
here:

http://stackoverflow.com/questions/7525782/import-big-files-arrays-with-mathematica/7527064#7527064

It may be able to solve your problem.

Regards,
Leonid


On Thu, Oct 27, 2011 at 1:36 AM, Matthias Seise <mseise at gmail.com> wrote:

> I'm working in Mathematica 8, 64 bit.
>
> I have saved a data set (Save["filename",data]) - which is about 3.5
> MB on the harddisk (a table with numbers and images,
> ByteCount=610117226).
> When I try to read it again into Memory I get "Get::bigfile: "The file
> "filename" is too large to be read into memory."
>
> I can work around it by splitting the data in smaller junks, but there
> should be a better way since the data set should not be too large
>
> Any ideas?
>
>
> Best regards,
> Matthias Seise
>
>

• References:
  • Error on importing previously saved data file: Get::bigfile
    • From: Matthias Seise <mseise@gmail.com>