Services & ResourcesWolfram ForumsMathGroup Archive

[Date Index] [Thread Index] [Author Index]

Memory usage

• To: mathgroup at smc.vnet.net
• Subject: [mg53602] Memory usage
• From: "Bruyndonckx P." <pbruynd at vub.ac.be>
• Date: Thu, 20 Jan 2005 03:47:42 -0500 (EST)
• Sender: owner-wri-mathgroup at wolfram.com

I am trying to use mathematica to analyse large data sets but I always run 
into memory problems

I read a set of 16220656 Integer32 numbers from a file.  Mathematica 
stores these numbers efficiently in a packed array which consumes 
16220656*4=64882680  bytes.  I want to divide the list whenever the number 
is 0 using the Split command. However, this process take 316 Mbyte of 
memory (difference between MemoryInUse before and after the Split 
command).  

Could somebody explain why Mathematica is using such a large amount of 
memory and how to avoid this ?  Is there a good reference on the topic of 
memory efficient programming in Mathematica ?

Peter

• Follow-Ups:
  • Re: Memory usage
    • From: DrBob <drbob@bigfoot.com>