Trace dual of the \|\cdot\|_{\infty\rightarrow 1} norm

Update: it turns out this isn’t quite right. Almost, but not quite. I need to fix this.
It turns out that the quantity I mentioned in the last post:
\vert\vert\vert A \vert\vert\vert = \inf \{ \|d\|_1 : A = GDG^t, D = \text{diag}(d) \text{ and } \|G\|_{1\rightarrow \infty} \leq 1 \}
is indeed a norm on the set of symmetric matrices (here, \|G\|_{1 \rightarrow \infty} is the largest (absolute) entry in G). Furthermore, it is the trace dual of the \|\cdot\|_{\infty \rightarrow 1} norm I looked at earlier. This interesting fact is about all I’ve been able to show for my time in looking at this problem, so I provide my proof here.

First, to see that the quantity is well-defined, note that you can diagonalize any symmetric matrix, and write it as a sum of positive and negative definite matrices, for each of which such a factorization exists by Cholesky decomposition. Construct G and D appropriately from these factorizations, and we see that the set being minimized over is nonempty for any symmetric A.

The only other nontrivial property is to see that the triangle inequality holds: let A_1 = G_1 D_1 G_1^t and A_2 = G_2 D_2 G_2^t be minimal factorizations, and note that
 \displaystyle \begin{pmatrix} G_1 & G_2 \end{pmatrix}
\begin{pmatrix} D_1 & 0 \\ 0 & D_2 \end{pmatrix}
\begin{pmatrix}G_1^t \\ G_2^t \end{pmatrix}
is a permissible factorization for  A_1 + A_2. This implies that \vert\vert\vert A_1 + A_2 \vert\vert\vert \leq \vert\vert\vert A_1 \vert\vert\vert + \vert\vert\vert A_2 \vert\vert\vert.

Now we upper bound the trace-dual norm of \vert\vert\vert\cdot\vert\vert\vert. By definition,
 \displaystyle \vert\vert\vert A \vert\vert\vert^\star = \max_{\vert\vert\vert B\vert\vert\vert \leq 1} \langle A, B \rangle.
Since such a B has a decomposition B = GDG^t where \|\text{diag}(D)\|_1 =1 and \|G\|_{1 \rightarrow \infty} \leq 1although not all such decompositions are minimal for the matrices they describe—, we have
\displaystyle \vert\vert\vert A \vert\vert\vert^\star \leq \max_{\|G\|_{1 \rightarrow \infty} \leq 1} \max_{\|d\|_1\leq 1} \langle A, GDG^t \rangle.

Note that \langle A, GDG^t \rangle = \text{Tr}(AGDG^t) = \text{Tr}(G^tAGD) = \langle G^tAG, D \rangle . Since D = \text{diag}(d), this last quantity is actually \langle \text{diag}(G^tAG), d \rangle. The \ell_1 and \ell_\infty norms are dual, so
\displaystyle \vert\vert\vert A \vert\vert\vert^\star \leq \max_{\|G\|_{1 \rightarrow \infty} \leq 1} \|\text{diag}(G^tAG)\|_\infty = \max_{\|u\|_\infty \leq 1} |u^t A u| .

Recall that when A is symmetric, \|A\|_{\infty \rightarrow 1} = \max_{\|u\|_\infty \leq 1} u^t A u, and we have
\displaystyle \vert\vert\vert A \vert\vert\vert^\star \leq \|A\|_{\infty \rightarrow 1}.

But note that if u is the vector at which \|A\|_{\infty \rightarrow 1} is achieved, then uu^t is its own minimal decomposition, so
\vert\vert\vert A \vert\vert\vert^\star \geq \langle A, uu^t \rangle = \|A\|_{\infty \rightarrow 1}.

Therefore, \vert\vert\vert \cdot \vert\vert\vert and \|\cdot\|_{\infty \rightarrow 1} are trace dual norms.

Possibly relevant posts:

Jan 19th, 2010 | Posted in Mathematics
Tags:
No comments yet.

Leave a comment

XHTML: You can use these tags: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong> <pre lang="" line="" escaped="">
CommentLuv Enabled