[Date Index] [Thread Index] [Author Index]

Memory Blowup Issues

• To: mathgroup at smc.vnet.net
• Subject: [mg126708] Memory Blowup Issues
• From: "Kevin J. McCann" <kjm at KevinMcCann.com>
• Date: Fri, 1 Jun 2012 05:18:43 -0400 (EDT)
• Delivered-to: l-mathgroup@mail-archive0.wolfram.com

I am dealing with some good sized data sets from satellite data. These 
data are stored in hdf format. The problem is that I process a sequence 
of these data sets by Importing and then processing; however, it seems 
that the memory usage grows with each Import, even if I Remove the data.

Here is a somewhat simplified example:

MemoryInUse[] (* some data already read in *)
2781549920

Data=Import[fileName,"Data"]; (* import a new data set *)
MemoryInUse[]
3302168936

Data=Import[fileName,"Data"];(* import  it again *)
MemoryInUse[]
3822781920

Remove[Data] (* this has no effect on the memory usage *)
MemoryInUse[]
3822787840

As you can see, I will shortly run out of memory. Any ideas?

Thanks,

Kevin

• Follow-Ups:
  • Re: Memory Blowup Issues
    • From: Ralph Dratman <ralph.dratman@gmail.com>
  • Re: Memory Blowup Issues
    • From: Ralph Dratman <ralph.dratman@gmail.com>
  • Re: Memory Blowup Issues
    • From: Ralph Dratman <ralph.dratman@gmail.com>
  • Re: Memory Blowup Issues
    • From: Sseziwa Mukasa <mukasa@gmail.com>