[Date Index] [Thread Index] [Author Index]

Re: Database memory usage

• To: mathgroup at smc.vnet.net
• Subject: [mg109435] Re: Database memory usage
• From: Vince Virgilio <blueschi at gmail.com>
• Date: Tue, 27 Apr 2010 04:05:48 -0400 (EDT)
• References: <hr3tj2$hdo$1@smc.vnet.net>

On Apr 26, 7:31 am, Rui <rui.rojo at gmail.com> wrote:
> I'm new to databases.
> I want to put a big list in a database, to later work on it.
> It all worked fine, using the default hsqldb that comes in
> Mathematica, but I couldn't insert more than few thousand elements at
> a time, and then Link problems or java heap problems.
> Finally, I couldn't even open the connection. Java runs out of memory.
> Memory usage of javaw process is less than 300MB when it runs out.

Rui,

For what it's worth: "Me too", but a long time ago, with a different
kind of database.

I noticed similar failures when I was trying to export very large
Microsoft Excel workbooks (XLS), with multiple worksheets. There
appear to be some hardwired assumptions or limits in Mathematica's
general export mechanism; and obviously the limit interacts with Java,
if not totally determined by it.

Vince Virgilio