Re: more efficient method of importing and plotting large (> 100mb) files.
- To: mathgroup at smc.vnet.net
- Subject: [mg120884] Re: more efficient method of importing and plotting large (> 100mb) files.
- From: David Annetts <david.annetts at iinet.net.au>
- Date: Sun, 14 Aug 2011 08:14:24 -0400 (EDT)
- Delivered-to: l-mathgroup@mail-archive0.wolfram.com
Hi Andrew, There are a few approaches ... One is to use ReadList rather than Import, then assign variables of interest & remove the rest. Another, is to read data from a database, so that you only read what you need. Your mileage may vary. As a guide, for my line based data with (say) 40 lines, 2000 (ish) stations per line, and 40 variables out of 200 of interest, the later approach works better than the former for a ~150 MB file D. On 13/08/2011 18:50, Andrew wrote: > I have a number of large data files that I want to import and plot, > however mathematica seems to have a serious issue with these. Is it > possible to get mathematica to not plot every point with listplot? If > so, how do I speed up the importing and ploting of these files? > > Thanks! > > -Andrew >