[Date Index] [Thread Index] [Author Index]

Re: how to quickly read a >10MB big file

• To: mathgroup at smc.vnet.net
• Subject: [mg72823] Re: [mg72807] how to quickly read a >10MB big file
• From: Gerry Flanagan <flanagan at materials-sciences.com>
• Date: Sun, 21 Jan 2007 05:41:35 -0500 (EST)
• References: <200701200844.DAA10812@smc.vnet.net>

Depends on what you're doing with the file. I've found that the Import 
function is as fast as my Fortran. It's so fast for parsing numbers, 
that I've written functions that read a big file, remove all the 
extraneous lines of text, rewrite to disk, then Import as a table. 
That's much faster than anything I can write that parses line-by-line.
G. Flanagan

P.Wholey wrote:
> Hello, Friends:
> It is a file which has nearly 100,000 data lines. The file size is
>   
>> 10MB. Using mathematica 5, it takes over 30 mins to read the data in; but using fortran, it takes only several secs. Does anyone has a good idea to read such a file quickly. Many thanks for any help in advance!
>>     
>
>
>   

• References:
  • how to quickly read a >10MB big file
    • From: "P.Wholey" <p.wholey@gmail.com>