[Date Index] [Thread Index] [Author Index]

Re: is accessing parts of an hdf5 dataset possible?

• To: mathgroup at smc.vnet.net
• Subject: [mg99845] Re: is accessing parts of an hdf5 dataset possible?
• From: kevinbowman at mac.com
• Date: Sat, 16 May 2009 05:19:35 -0400 (EDT)
• References: <guj844$hp0$1@smc.vnet.net>

On May 15, 1:11 am, Paul <pnort... at gmail.com> wrote:
> I have a large HDF5 dataset that cannot fit into memory if I do an
> Import of the dataset.
>
> Is there a way to load only a portion of a dataset? My dataset is a
> two dimensional array. Ideally, I would be able to Import and Export
> portions of the array via part assignments. Without this feature, it
> is a little difficult to work with large HDF5 datasets in Mathematica,
> isn't it?
>
> I assume the answer is no in case I get no replies.
>
> But before I write mathlink wrappers, just wanted to double check.
> Such a feature is available in two python wrappers of the HDF5 library
> (h5py and pytables).
>
> Thanks,
> P=E5l.

I think you can read one dataset elements at a time, but I'm not sure
if there is a way to read an part of an array.
If you figure that out, let me know because these are big issues for
these Earth Science datasets.

Kevin