Re: is accessing parts of an hdf5 dataset possible?
- To: mathgroup at smc.vnet.net
- Subject: [mg99845] Re: is accessing parts of an hdf5 dataset possible?
- From: kevinbowman at mac.com
- Date: Sat, 16 May 2009 05:19:35 -0400 (EDT)
- References: <guj844$hp0$1@smc.vnet.net>
On May 15, 1:11 am, Paul <pnort... at gmail.com> wrote: > I have a large HDF5 dataset that cannot fit into memory if I do an > Import of the dataset. > > Is there a way to load only a portion of a dataset? My dataset is a > two dimensional array. Ideally, I would be able to Import and Export > portions of the array via part assignments. Without this feature, it > is a little difficult to work with large HDF5 datasets in Mathematica, > isn't it? > > I assume the answer is no in case I get no replies. > > But before I write mathlink wrappers, just wanted to double check. > Such a feature is available in two python wrappers of the HDF5 library > (h5py and pytables). > > Thanks, > P=E5l. I think you can read one dataset elements at a time, but I'm not sure if there is a way to read an part of an array. If you figure that out, let me know because these are big issues for these Earth Science datasets. Kevin