[Date Index] [Thread Index] [Author Index]

Re: how to quickly read a >10MB big file

• To: mathgroup at smc.vnet.net
• Subject: [mg72834] Re: how to quickly read a >10MB big file
• From: Jean-Marc Gulliet <jeanmarc.gulliet at gmail.com>
• Date: Sun, 21 Jan 2007 06:26:12 -0500 (EST)
• Organization: The Open University, Milton Keynes, UK
• References: <eosh9v$9ec$1@smc.vnet.net>

P.Wholey wrote:
> Hello, Friends:
> It is a file which has nearly 100,000 data lines. The file size is
>> 10MB. Using mathematica 5, it takes over 30 mins to read the data in; but using fortran, it takes only several secs. Does anyone has a good idea to read such a file quickly. Many thanks for any help in advance!
> 
Mathematica is no magic. It would have greatly help answering your 
question if you had bother to provide some details about your data file: 
Is it 10^5 lines of numbers? In what format (scientific, raw 
digits,...)? Are there any nested structures? Any character strings? 
...? Moreover, what Mathematica command have you used? (Import, Read, 
BinaryRead,...)

Regards,
Jean-Marc