[Date Index] [Thread Index] [Author Index]

Import, http and gzip/compression?

• To: mathgroup at smc.vnet.net
• Subject: [mg104531] Import, http and gzip/compression?
• From: Jason Ledbetter <jasonbrent at gmail.com>
• Date: Tue, 3 Nov 2009 02:54:34 -0500 (EST)

Folk,

I've tried digging through the manual but haven't found any hints....

Is there any way to configure Import["http..."] to request Gzip compression
(or otherwise customize things like the Use-Agent without resorting to using
J/Link)? I know Mathematica supports GZIP as a file based import, but I'm
wanting it to request compressed data from the http server (Generally
requires 'Accept-Encoding: gzip, x-gzip, deflate' being sent in the http
request/headers).

I've got an issue where Import[] seems to silently fail[1] when the remote
host is sending data over a latent link and I know that using gzip
compression has resolved similar issues with Perl/LWP for me in the past...

I put in a ticket w/ Wolfram on this on THURSDAY and have yet to receive any
response from support....

[1] It fails to the point where a Print[] after the Import[] inside a Module
doesn't even run(!) when the link latency (I think this is the catalyst
anyway) is high enough.

-jbl