MathGroup Archive 1999

[Date Index] [Thread Index] [Author Index]

Search the Archive

Re: out of memory reading large(?) file (Q:)

  • To: mathgroup at smc.vnet.net
  • Subject: [mg18485] Re: out of memory reading large(?) file (Q:)
  • From: paulh at wolfram.com (P.J. Hinton)
  • Date: Wed, 7 Jul 1999 23:08:44 -0400
  • Organization: Wolfram Research, Inc.
  • References: <7lumlt$lf5@smc.vnet.net>
  • Sender: owner-wri-mathgroup at wolfram.com

In article <7lumlt$lf5 at smc.vnet.net>, "iMic" <schaferk at communique.net> writes:

> i am trying to read in a large file (6.3MB) of zeroes (0.0) and ones (1.0).
> 
> after giving the kernel 50MB, the kernel reports out of memory. surely this
> amount of memory should be enough. the version is Mathematica 3.0 on a PowerMac
> 6500/225 with 96MB RAM.
> 
> i have tried before (on much smaller files), using unformatted binary output
> of the file along with ReadBinary, only to find unbearable long read times
> (> 5Mins).
> 
> what's the current best approach toward getting this data into Mathematica for
> processing.
> i'd like to make an animation from the data.

How are the zeroes and ones stored in the data file?  Are they stored 
as bits, or does each byte in the file correspond to a single zero/one?
When you read the data from the file, do you store each entry as an
Integer, Real, or String?  Is it really necessary to store all
of the data in the file in memory at once?

--
P.J. Hinton	
Mathematica Programming Group		paulh at wolfram.com
Wolfram Research, Inc.
Disclaimer: Opinions expressed herein are those of the author alone.


  • Prev by Date: Re: Re: easiest way to sort a list?
  • Next by Date: MULTIMEDIA-MATHEMATICA
  • Previous by thread: out of memory reading large(?) file (Q:)
  • Next by thread: Re: out of memory reading large(?) file (Q:)