Re: Import Limitations

*To*: mathgroup at smc.vnet.net*Subject*: [mg61091] Re: Import Limitations*From*: "Jens-Peer Kuska" <kuska at informatik.uni-leipzig.de>*Date*: Mon, 10 Oct 2005 02:39:52 -0400 (EDT)*Organization*: Uni Leipzig*References*: <diaau9$ict$1@smc.vnet.net>*Sender*: owner-wri-mathgroup at wolfram.com

Hi, and OpenRead[] the file and than Read[] the data row by row will not work ? Or you may try to buy a 64 bit machine, Mathematica 5.2 will support this. Regards Jens "Benedetto Bongiorno" <bbongiorno at attglobal.net> schrieb im Newsbeitrag news:diaau9$ict$1 at smc.vnet.net... | To Mathgroup, | | I frequently need to Import large data, usually a *.csv file, containing | 3 million rows by 50 columns. | The file contains both strings and numerics. I sometimes do not know the | make up of which columns are strings and which are numerics. | In small files I import all the data as strings. | Because of the 2 gig memory limitation of Windows XP running V5.2, I | cannot use the Import. | The reason Import does not work for me is it will only import the | complete file, thus the system runs | out of memory. I need to import the data in small groups. | I have tried ReadList, but it only lets you select the first group size. | Suggestions of Skip and SetStreamPosition causes me errors, due to the | fact that I have a problem | composing the functions. | | Thank you, | | Ben Bongiorno |