RE: how to quickly read a >10MB big file
- To: mathgroup at smc.vnet.net
- Subject: [mg72820] RE: [mg72807] how to quickly read a >10MB big file
- From: "David Annetts" <davidannetts at aapt.net.au>
- Date: Sun, 21 Jan 2007 05:29:25 -0500 (EST)
- References: <200701200844.DAA10812@smc.vnet.net>
Hi, > Hello, Friends: > It is a file which has nearly 100,000 data lines. The file size is > >10MB. Using mathematica 5, it takes over 30 mins to read the > data in; but using fortran, it takes only several secs. Does > anyone has a good idea to read such a file quickly. Many > thanks for any help in advance! How are you reading the file into Mathematica? Read? ReadList? Import? The MathGroup package FastBinary? Are you reading the file, then processing it, or processing it as you go? All these factors will have a bearing on the speed that you can read your data into Mathematica. In addition, while Fortran can be quite a bit quicker than Mathematica, are you sure it's a fair comparison between the two? Please tell the list a bit more about how you're working. Posting code and a sample of the data you're working with will probably get quicker, more appropriate answers than not. Regards, Dave.
- References:
- how to quickly read a >10MB big file
- From: "P.Wholey" <p.wholey@gmail.com>
- how to quickly read a >10MB big file