is accessing parts of an hdf5 dataset possible?
- To: mathgroup at smc.vnet.net
- Subject: [mg99804] is accessing parts of an hdf5 dataset possible?
- From: Paul <pnorthug at gmail.com>
- Date: Fri, 15 May 2009 04:17:09 -0400 (EDT)
I have a large HDF5 dataset that cannot fit into memory if I do an Import of the dataset. Is there a way to load only a portion of a dataset? My dataset is a two dimensional array. Ideally, I would be able to Import and Export portions of the array via part assignments. Without this feature, it is a little difficult to work with large HDF5 datasets in Mathematica, isn't it? I assume the answer is no in case I get no replies. But before I write mathlink wrappers, just wanted to double check. Such a feature is available in two python wrappers of the HDF5 library (h5py and pytables). Thanks, P=E5l.