[Date Index] [Thread Index] [Author Index]

Re: Import Limitations

• To: mathgroup at smc.vnet.net
• Subject: [mg61091] Re: Import Limitations
• From: "Jens-Peer Kuska" <kuska at informatik.uni-leipzig.de>
• Date: Mon, 10 Oct 2005 02:39:52 -0400 (EDT)
• Organization: Uni Leipzig
• References: <diaau9$ict$1@smc.vnet.net>
• Sender: owner-wri-mathgroup at wolfram.com

Hi,

and OpenRead[] the file and than Read[]  the data 
row by row will not work ?
Or you may try to buy a 64 bit machine, 
Mathematica 5.2 will support this.

Regards
  Jens


"Benedetto Bongiorno" <bbongiorno at attglobal.net> 
schrieb im Newsbeitrag 
news:diaau9$ict$1 at smc.vnet.net...
| To Mathgroup,
|
| I frequently need to Import large data, usually 
a *.csv file, containing
| 3 million rows by 50 columns.
| The file contains both strings and numerics. I 
sometimes do not know the
| make up of which columns are strings and which 
are numerics.
| In small files I import all the data as strings.
| Because of the 2 gig memory limitation of 
Windows XP running V5.2, I
| cannot use the Import.
| The reason Import does not work for me is it 
will only import the
| complete file, thus the system runs
| out of memory. I need to import the data in 
small groups.
| I have tried ReadList, but it only lets you 
select the first group size.
| Suggestions of Skip and SetStreamPosition causes 
me errors, due to the
| fact that I have a problem
| composing the functions.
|
| Thank you,
|
| Ben Bongiorno
|