MathGroup Archive 2007

[Date Index] [Thread Index] [Author Index]

Search the Archive

Re: how to quickly read a >10MB big file

  • To: mathgroup at smc.vnet.net
  • Subject: [mg72834] Re: how to quickly read a >10MB big file
  • From: Jean-Marc Gulliet <jeanmarc.gulliet at gmail.com>
  • Date: Sun, 21 Jan 2007 06:26:12 -0500 (EST)
  • Organization: The Open University, Milton Keynes, UK
  • References: <eosh9v$9ec$1@smc.vnet.net>

P.Wholey wrote:
> Hello, Friends:
> It is a file which has nearly 100,000 data lines. The file size is
>> 10MB. Using mathematica 5, it takes over 30 mins to read the data in; but using fortran, it takes only several secs. Does anyone has a good idea to read such a file quickly. Many thanks for any help in advance!
> 
Mathematica is no magic. It would have greatly help answering your 
question if you had bother to provide some details about your data file: 
Is it 10^5 lines of numbers? In what format (scientific, raw 
digits,...)? Are there any nested structures? Any character strings? 
...? Moreover, what Mathematica command have you used? (Import, Read, 
BinaryRead,...)

Regards,
Jean-Marc


  • Prev by Date: Re: Better recursive method?
  • Next by Date: Re: Better recursive method?
  • Previous by thread: Re: how to quickly read a >10MB big file
  • Next by thread: Re: how to quickly read a >10MB big file