Re: Import Limitations
- To: mathgroup at smc.vnet.net
- Subject: [mg61091] Re: Import Limitations
- From: "Jens-Peer Kuska" <kuska at informatik.uni-leipzig.de>
- Date: Mon, 10 Oct 2005 02:39:52 -0400 (EDT)
- Organization: Uni Leipzig
- References: <diaau9$ict$1@smc.vnet.net>
- Sender: owner-wri-mathgroup at wolfram.com
Hi, and OpenRead[] the file and than Read[] the data row by row will not work ? Or you may try to buy a 64 bit machine, Mathematica 5.2 will support this. Regards Jens "Benedetto Bongiorno" <bbongiorno at attglobal.net> schrieb im Newsbeitrag news:diaau9$ict$1 at smc.vnet.net... | To Mathgroup, | | I frequently need to Import large data, usually a *.csv file, containing | 3 million rows by 50 columns. | The file contains both strings and numerics. I sometimes do not know the | make up of which columns are strings and which are numerics. | In small files I import all the data as strings. | Because of the 2 gig memory limitation of Windows XP running V5.2, I | cannot use the Import. | The reason Import does not work for me is it will only import the | complete file, thus the system runs | out of memory. I need to import the data in small groups. | I have tried ReadList, but it only lets you select the first group size. | Suggestions of Skip and SetStreamPosition causes me errors, due to the | fact that I have a problem | composing the functions. | | Thank you, | | Ben Bongiorno |