Archive for October, 2005

GradPreview, here I come!

Thursday, October 13th, 2005

Someone at Caltech made a big mistake— I got into the GradPreview program. Not that I’m a bad choice necessarily, but how would they know: I didn’t turn in my transcript, or any letters of recommendation. Maybe I had exceptionally great essays? More likely, not very many people applied.

Either way, I don’t care. Nov 9-11, I’ll be at Caltech, soaking in the environs, and seeing if I do want to go there for grad school. I’m not looking forward to the expected social mixing, but I’m holding out for the chance that just being there will loosen me up. One thing I need to do is find out who on the math faculty is doing research I’d be interested in, and inveigle my way into their presence. Also, I need to get a real haircut (opposed to my homebrewed attempts) before I go.

Yeah! CalTech!

One more CSI faux paux

Wednesday, October 12th, 2005

We all know that CSI isn’t the most realistic tv show— in what world do the CSI order detectives around, grill hostile witnesses, and such? But I can’t believe I let this one slide: in one episode of Miami CSI, they were using a gamma imaging device to view the insides of some crates. The images produced were 3d wireframes, nicely colored, and absolutely bogus!

Show me the imaging device that can reconstruct geometry like that… that’s like claiming to have found the holy grail. That’s simply not the way imaging technologies work; they all depend on Fourier transforms, which means that information is collected as intensities and energies. So what you get is a picture, a rather blurry 3d picture, one from which no current technology can unambiguously recover such crisp geometry— that kind of processing requires a human level intellegence. Again, show me such a reconstruction technology, and I’ll show you a million bucks.

That’s making me wonder about some of the more dubious image enhancements they pull on that show: can I believe it when they recover license numbers from blurred photos, or is that more dramatic license? Making fast and loose with the truth like that on a forensic science show is irresponsible, IMO.

speculations on the origins of matrix theory

Wednesday, October 12th, 2005

I’m in the engineering computer lab, where I was sitting by a friend taking the Controls class— one of the few engineering courses that comes in a sequence (I and II), and IMO would be useful and interesting for me to take— but I can’t take it, because of scheduling overlaps. I was looking through his notes when I came across the companion matrix stuff.

After I exhausted myself gushing on and on about how wonderful they are, he asked me for my opinion of where matrices came from. I assumed he meant not only the notation (i.e. when we’re simply using matrices as a shortcut for manipulation linear equations), but the weird seemingly dissociated results we have about matrices as objects in themselves, e.g. determinants. That is, historically, what motivated the higher level concepts of matrix theory, and how were they understood intuitively? Where I’m assuming that they were indeed understood intuitively by the people who first worked with them. I’m sure whoever discovered/invented the determinant didn’t say “hmm, if I design an multilinear function in this way…”

My answer? I don’t have the beginnings of a clue. Which doesn’t bother me— I usually don’t have a clue about the actual beginnings of a particular mathematical subject. About all I know with regard to mathematical history is that Fourier and wavelet analysis was started with Fourier’s idea that a function can be represented as the limit of sums of harmonics, and that rigorizing Fourier’s hypothesis was one of the main motivations behind modern analysis. Usually, I settle for a collection of post facto mileposts, that I could imagine myself following up to the modern presentation of a subject. E.g., the way Riemannian integration is usually taught, as the limit of the areas of rectangles, can be easily extended to a logical, if overly neat, train of imaginary historical mileposts leading to the concept of integration.

What bothers me is the fact that I don’t have even such an account for matrix theory. How the hell did anyone ever think of determinants? I can see where most other things came from; here’s my imaginary history of matrix theory: first, we realized that matrices are convenient notation for handling systems of linear equations, from there, we saw the obvious isomorphism between matrices and linear transformations between finite dimension vector spaces, and a lot of weird lower-level matrix results are merely transcriptions of more intuitive results in linear algebra. But determinants apparently have very little connection to linear algebra (other than indicating the invertibility of the associated transform, I think), but many uses otherwise.

I remember asking professors about this the first couple of times I took classes involving matrices, but I never got a satisfactory answer. I had buried it until he asked me about it today. Now this is going to nag me until I solve it.

Companion matrix

Wednesday, October 12th, 2005

Now, if I ever go back to working on BasicCAS, I have one method for computing the roots of polynomials numerically that doesn’t seem to require too many arbitrary starting parameters: namely, by finding the eigenvalues of the polynomial’s companion matrix.

This is one of those neat applications of matrices that is obvious in hindsight, but you wouldn’t necessarily think of it yourself. Here’s the idea: find a ‘companion’ matrix whose characteristic equation involves the polynomial you are trying to find the roots of. Then solving this equation, or finding the roots of the polynomial, is equivalent to determining the eigenvalues of the companion matrix; this latter can be done using fast numerical methods. Of course, the question is how to determine the companion matrix— this would be practically useless if the process of determining the companion matrix was harder than trying to directly solve the polynomial by other methods.

The miracle is that the companion matrix is trivial to form: given a monic polynomial  p(x) = a_0 + \cdots + a_{n-1} x^{n-1} + x^n , the n\times n companion matrix is


\left[\begin{array}{ccccc}
0 & 0 & 0 & \cdots & -a_0 \\
1 & 0 & 0 & \cdots & -a_1 \\
0 & 1 & 0 &\cdots & -a_2 \\
\vdots & \vdots & \ddots & \ddots & \vdots \\
0 & 0 & \cdots &  1 & -a_{n-1} \\
\end{array}\right]

I think this is the method Matlab uses to find roots of equations.

Solving strange equations

Monday, October 10th, 2005

How does one go about solving strange equations like:

 \phi(t) = \sum_k c_k \phi(2t - k)

where all you know is \{c_k\}_k\in\Z is square summable? How would you find \phi that satisfies this, and is there more than one?

It’s an interesting question to consider. I know the answer, but I can’t imagine how I’d work it out if I hadn’t seen someone else work it out.

Gender dysphoria

Saturday, October 8th, 2005

Gender dysphoria, more commonly known as transsexualism, is the condition where a man (woman) believes that he (she) has the wrong physical gender. Transvetitism is distinguished from transsexualism, in that folk having the former want to play dress-up only part of the time; transsexuals identify with the opposite physical gender all the time. Gender dysphoria is an interesting topic, since it highlights the question of how gender identification and sexual identity interact.

Having read Middlesex, and seen La Mala Educacion, I thought I had a picture of what a transsexual is like, both of the male and female type. But— sympathetic as those have been— I’ve never read a non-fictional, non-dramatic account of what is like to be a transsexual. This is a great site (a collection of narratives) written by a transsexual that transitioned. Here’s an excerpt:

There is some logic to this, however extreme it may seem: a typical transsexual response to the hypothetical question “would you be happier if we could change your mind so that you are happy with the sex of your birth?” is “no”, because however much it may pain the transsexual, the notion of changing one’s personality to be ‘normal’ seems like giving up an essential part of one’s soul. All transsexuals ask themselves this at some stage, and all I have corresponded with have come to a similar response. Transsexuals see the condition not so much as a mental illness but as an unusual and inappropriate assignation - there exists in them a belief that at heart they are the opposite sex, and it seems that all would rather change the body than the soul.

Systems of Sets

Friday, October 7th, 2005

Between taking the measure theory class and reading some probability stuff, I’ve been introduced to all sorts of interesting systems of sets over a universal set \Omega:

  • Rings — nonempty, closed under finite intersections, finite unions, and differences
  • Fields, or algebras — contain \emptyset, closed under finite unions, complementation
  • \sigma-fields, or \sigma-algebras — closed under countable unions, complementation, and containing \Omega
  • \pi-systems — closed under finite intersections
  • \lambda-systems — contains \Omega, closed under proper differences, and increasing limits

The most useful of these is the \sigma-algebra; the others seem to be convenient starting points for generating a \sigma-algebra. For example, the following theorem is useful for extending a known property from a system C to the \sigma-algebra it induces, \sigma(C):

Let C be a \pi-system and D a \lambda-system in some space \Omega such that C \subset D. Then \sigma(C) \subset D.

These are just the systems that pop up in measure theory/ probability; I’m sure there are more out there— open and closed sets, in topology, come to mind.

Bessel Families and Frames

Wednesday, October 5th, 2005

Here’s why I needed to know about adjoints. In the last wavelets seminar, Papadakis proved the following:

Suppose H is a Hilbert space, \{x_n\} \subseteq H, H = \overline{\text{span}}\{x_n\}. Define the linear mapping X: l^2 \rightarrow H,  X: \delta_n \rightarrow x_n. Then:

  1. \{x_n\} is a Bessel family iff X is bounded
  2. \{x_n\} is a frame for H iff  V = X^\star(H) is closed iff \text{range} X = H iff X^\star is invertible iff X|_V is invertible iff X^\star X|_V is invertible

I’m was having a little trouble with the first one, because it involved adjoints in a way that made the proof look incomplete to me (he defined another operator and proved its adjoint was bounded; to everyone else but me, it was clear the adjoint of this operator was in fact X) . I’m currently going over the second one, because I didn’t understand how the proof given.

Hopefully soon, I’ll have these notes up, and I’ll post a link here. They are pretty interesting, for people into signal processing or functional analysis, and easy to follow if you take a few theorems and results for granted. I’d say someone who’s read the multilinear analysis chapter of Rudin and has some minimal experience with using Hilbert space reasoning, could follow this easily. At least after I’m finished rewriting it at my level.

Adjoints (in Hilbert spaces)

Wednesday, October 5th, 2005

I finally have a good grasp of adjoints, and I need to record it for the next time I need it. Let \varphi be a bounded bilinear form, i.e. \varphi : H \times H \rightarrow R, is linear in the first variable, conjugate linear in the second, and there is an M >0 such that  | \varphi(x,y) | \leq M \|x\| \|y\| . Then by the Riesz representation theorem, there is a bounded operator A such that  \varphi(x,y) = \langle Ax, y \rangle .

Now, define a new bilinear form  \tilde \varphi (x,y) = \langle x, Ay \rangle . Then \|\tilde \varphi(x,y) \| \leq |\langle x, Ay \rangle| \leq \|x\|\|Ay\| \leq \|A\|\|x\|\|y\| . Therefore, \tilde \varphi is a bounded bilinear form, so there is a A^\tilde such that  \varphi(x,y) = \langle x, Ay \rangle = \langle A^\star x, y \rangle . We call A^\star the adjoint of A.

Note immediately that  (A^\star)^\star = A , or in fancy language, \star is involutive. Together with the fact \|A^\star\| \leq \|A\| (from the last inequality above), this shows \|A^\star\| = \|A\|.

Whalla! I’m not sure this’ll be useful to anyone else but me. Probably if you know what the Riesz representation theorem is, you already know this …