Services & Resources / Wolfram Forums / MathGroup Archive

MathGroup Archive 2012

[Date Index] [Thread Index] [Author Index]

Search the Archive

Memory Blowup Issues

  • To: mathgroup at smc.vnet.net
  • Subject: [mg126708] Memory Blowup Issues
  • From: "Kevin J. McCann" <kjm at KevinMcCann.com>
  • Date: Fri, 1 Jun 2012 05:18:43 -0400 (EDT)
  • Delivered-to: l-mathgroup@mail-archive0.wolfram.com
I am dealing with some good sized data sets from satellite data. These 
data are stored in hdf format. The problem is that I process a sequence 
of these data sets by Importing and then processing; however, it seems 
that the memory usage grows with each Import, even if I Remove the data.

Here is a somewhat simplified example:

MemoryInUse[] (* some data already read in *)
2781549920

Data=Import[fileName,"Data"]; (* import a new data set *)
MemoryInUse[]
3302168936

Data=Import[fileName,"Data"];(* import  it again *)
MemoryInUse[]
3822781920

Remove[Data] (* this has no effect on the memory usage *)
MemoryInUse[]
3822787840

As you can see, I will shortly run out of memory. Any ideas?

Thanks,

Kevin
  • Prev by Date: Re: How to add axis labels in bubblechart?
  • Next by Date: Simplify and then discretize a set of equations with derivatives and integrals
  • Previous by thread: Re: How to add axis labels in bubblechart?
  • Next by thread: Re: Memory Blowup Issues