Re: Re: PseudoInverse for exact matrices: Comments...
- To: mathgroup at smc.vnet.net
- Subject: [mg25217] Re: [mg25187] Re: PseudoInverse for exact matrices: Comments...
- From: "Mark Harder" <harderm at ucs.orst.edu>
- Date: Fri, 15 Sep 2000 02:21:51 -0400 (EDT)
- Sender: owner-wri-mathgroup at wolfram.com
Mark, Gianluca, & everybody,
(1.) I once tried to perform a pseudoinverse of a (more or less)
15-element matrix (elements were nonlinear functions of exponential
functions of symbolic variables) with Mathematica (vsn4.0.1) on my
Pent.II,266MHz, WinNT4 machine, and after 12hrs it was still crunching away,
no crashes, no error msgs., but no signs of progress either. (I didn't
bother to tell the system that the symbols were real. See (2.) below
regarding this.) However, I decided that it was just too slow to be
practical, and never tried to do symbolic pseudoinverses again until today.
If anyone out there knows that Mathematica *should* have handled this
problem faster than this, I'd like to know, so I can debug what I was doing;
until then, I'm assuming the procedure is just too slow to be practical.
Then again, maybe I should try implementing some variant of mark Mark
Fisher's pseudoinverse, altered for symbolic matrices (?).
(2.) Speaking of which, I succeeded in repeating Mark's results on my
system:
IN:
mn = {{1 + I, 1}};
psmn = PseudoInverse[mn]
OUT:
{{1/3 - I/3}, {1/3}}
IN:
Simplify[psmn.mn]
OUT:
{{2/3, 1/3 - I/3}, {1/3 + I/3, 1/3}}
IN:
Simplify[Transpose[psmn.mn ] ]
OUT:
{{2/3, 1/3 + I/3}, {1/3 - I/3, 1/3}}
As Mark pointed out there is a serious discrepancy here, since psmn.mn and
its Transpose should be the same IF the matrix being transposed is real.
The problem is that Mathematica's Transpose doesn't automatically conjugate
elements when it transposes them (for good reasons, I think); so it gives
the wrong answer in case of complex exact expressions and also with symbolic
expressions not declared to be Real. (NB. the anti-symmetric relationships
in the signs of the imaginary parts of the off diagonal elements of psmn.mn
and its "Transpose".) What we need here is a ConjugateTranspose function
for complex matrices, and Mathematica doesn't give us one; even the examples
I found in the LinearAlgebra`MatrixManipulation documentation constructs
one, so lets make our own ConjugateTranspose function:
IN:
ConjugateTranspose[x_List?MatrixQ] := Transpose[Conjugate[x] ];
and now
IN:
Simplify[ConjugateTranspose[psmn.mn] ]
OUT:
{{2/3, 1/3 - I/3}, {1/3 + I/3, 1/3}}
,which == psmn.mn .
SO, the problem lies with using the built-in Transpose function. When
ConjugateTransposition is used instead, PseudoInverse proves to be O.K.
BTW, similar results are obtained when m={{1+x,1}}, and x is not declared
real. Try this for yourself.
A suggestion for future Mathematica vsns.: add an option to Transpose which
enables Conjugate transposition!!
-Mark Harder
harderm at ucs.orst.edu
-----Original Message-----
From: Mark Fisher <mark.fisher at atl.frb.org>
To: mathgroup at smc.vnet.net
Subject: [mg25217] [mg25187] Re: PseudoInverse for exact matrices
>I don't know much about pseudoinverses, but I do know that
>myPseudoInverse gives a result different from what Mathematica's
PseudoInverse
>gives.
>
>(* copied from original email *)
>myPseudoInverse[m_List?MatrixQ /; Precision[m] === Infinity] :=
> Module[{n = NullSpace[m]},
> n = If[n === {}, {Table[0, {Length[First[m]]}]}, n];
> Inverse[Transpose[m].m + Transpose[n].n].Transpose[m]];
>
>
>In[69]:=
>p = PseudoInverse[m = {{1 + I, 1}}]
>
>Out[69]=
>{{1/3 - I/3}, {1/3}}
>
>In[70]:=
>pp = myPseudoInverse[m]
>
>Out[70]=
>{{3/5 - I/5}, {1/5 - (2*I)/5}}
>
>In "Further Examples" from the help listing for PseudoInverse, it says
>that the pseudoinverse satisfies four conditions:
>
>In[72]:=
>{m.p.m == m, p.m.p == p, p.m == Transpose[p.m], m.p == Transpose[m.p]}
>
>Out[72]=
>{True, True, False, True}
>
>In[73]:=
>{m.pp.m == m, pp.m.pp == pp, pp.m == Transpose[pp.m], m.pp ==
>Transpose[m.pp]}
>
>Out[73]=
>{True, True, True, True}
>
>Well it appears as though Mathematica's built in PseudoInverse has failed
the
>tests, whereas myPseudoInverse has passed. Is this a bug or have I done
>something wrong?
>
>-- Mark
>Mark Fisher
>Economic Advisor
>Research Department
>Federal Reserve Bank of Atlanta
>Atlanta, GA 30303
>404-521-8757 (voice)
>404-521-8810 (fax)
>mark.fisher at atl.frb.org
>
>personal web page: www.markfisher.net
>
>