Re: Memory usage
- To: mathgroup at smc.vnet.net
- Subject: [mg53647] Re: [mg53602] Memory usage
- From: DrBob <drbob at bigfoot.com>
- Date: Fri, 21 Jan 2005 06:36:16 -0500 (EST)
- References: <200501200847.DAA04081@smc.vnet.net>
- Reply-to: drbob at bigfoot.com
- Sender: owner-wri-mathgroup at wolfram.com
Show us the code you used to Split the array. The result may not be packed, of course, and that could explain a lot of extra space. Bobby On Thu, 20 Jan 2005 03:47:42 -0500 (EST), Bruyndonckx P. <pbruynd at vub.ac.be> wrote: > I am trying to use mathematica to analyse large data sets but I always run > into memory problems > > I read a set of 16220656 Integer32 numbers from a file. Mathematica > stores these numbers efficiently in a packed array which consumes > 16220656*4=64882680 bytes. I want to divide the list whenever the number > is 0 using the Split command. However, this process take 316 Mbyte of > memory (difference between MemoryInUse before and after the Split > command). > > Could somebody explain why Mathematica is using such a large amount of > memory and how to avoid this ? Is there a good reference on the topic of > memory efficient programming in Mathematica ? > > Peter > > > > -- DrBob at bigfoot.com www.eclecticdreams.net
- References:
- Memory usage
- From: "Bruyndonckx P." <pbruynd@vub.ac.be>
- Memory usage