Reading Data into Mathematica
- To: mathgroup at smc.vnet.net
- Subject: [mg33839] Reading Data into Mathematica
- From: Oleg Burd <OBurd at MaplePartners.com>
- Date: Fri, 19 Apr 2002 02:28:49 -0400 (EDT)
- Sender: owner-wri-mathgroup at wolfram.com
Hello, I'm trying to resolve following problem: Form file of 700 MB, consisting of lines, every line begins with time stamp (hhmmss) and contains information regarding different objects, the information regarding each object must be extracted and anlalysed. After spending several days on playing with Read, ReadList and searching the MathGroup archive, I find out: ReadList is not proper solution, because of RAM restrictions.MemoryConserve doesn't help mauch as well. There are routines in MathSource for working with data, they are designed however only for binary data(!). There is know proper memory management in Mathemtaica, which would make possible to allocate memory for ReadList. Construction While (Read[Stream,Record]=!= EndOfFile) is too slow, for reading such data. Can anybody help me to solve it? Ot may be you know some of proper memory utilities. Or my approach is completely wrong and Matheamtica is neither designed for such tasks nor can handle them? Thx, Oleg.