Making Tensor operations more efficient

*To*: mathgroup at smc.vnet.net*Subject*: [mg33787] Making Tensor operations more efficient*From*: Luci Ellis <luci at verbeia.com>*Date*: Tue, 16 Apr 2002 03:50:42 -0400 (EDT)*Sender*: owner-wri-mathgroup at wolfram.com

Dear MathGroupers, It's been a while since I had to do any Mathematica programming and it shows! I am trying to implement an econometric procedure in Mathematica, and while it works, I'm having problems making it efficient enough to be usable with larger datasets on a desktop computer. I won't bore you with the details of the rest of the procedure. Judicious use of TimeUsed[] shows that the two commands within the function that take the most time are the following ones. Each of these commands takes 10-20 seconds on tensors of the required size (say 400*7*100), which is not ideal as the econometric procedure requires doing the whole thing more than 1000 times. If anyone could make some suggestions on making this more efficient, I'd be very grateful. The first is: Zk=MapThread[ Transpose[ Join[Transpose[#1],Transpose[#2]]]&,{KroneckerProduct[{#},Inn]&/@ Transpose[Vmat],KroneckerProduct[{#},Inn]&/@zbar }]; (* where Inn is just a conformable IdentityMatrix, Vmat and zbar are matrices *) That is, I have two 3D tensors that I need to join at the second level: one is Tj*h*p and the other is Tj*h*q, so I should end up with a Tj*h*(p+q) result. Note that AppendRows from the MatrixManipulation package is about fifty times slower than Transpose[Join[Transpose -- I've checked. I tried Zk=With[{bit1=KroneckerProduct[{#},Inn]&/@Transpose[Vmat], bit2=KroneckerProduct[{#},Inn]&/@zbar }, Table[Transpose[ Join[Transpose[bit1[[i]], Transpose[bit2[[i]] ]]],{i, Length[bit1]}]]; But this gives pretty much the same speed and memory requirements. The second problem command is Do[zSz= zSz+ TZk[[i]].izk[[i]];,{i,Tj}] ; (* where TZk = Transpose[Zk,{1,3,2}] and izk is a 3D tensor with conformable elements *) So here I have two 3D tensors and I need the element-by-element sum of the dot products of the corresponding (matrix) elements from each tensor. I originally tried a Plus @@ MapThread[] construct but the memory requirements were so enormous the kernel kept quitting (I'm using a Mac G4 with Mac OS 9). KroneckerProduct is just the one given in the Mathematica book: KroneckerProduct[a_?MatrixQ,b_?MatrixQ]:=BlockMatrix[Outer[Times,a,b]] Thanks in advance, Luci Ellis http://www.verbeia.com/mathematica/