2025-04-27

1092: Orthogonal Projection from Vectors Space with Inner Product into Vectors Subspace

<The previous article in this series | The table of contents of this series | The next article in this series>

definition of orthogonal projection from vectors space with inner product into vectors subspace

Topics


About: vectors space

The table of contents of this article


Starting Context



Target Context


  • The reader will have a definition of orthogonal projection from vectors space with inner product into vectors subspace.

Orientation


There is a list of definitions discussed so far in this site.

There is a list of propositions discussed so far in this site.


Main Body


1: Structured Description


Here is the rules of Structured Description.

Entities:
F: {R,C}, with the canonical field structure
V: { the F vectors spaces }, with any inner product, ,:V×VF
V: { the vectors subspaces of V}
f: :VV, { the projections }
//

Conditions:
vV(vV(vf(v),v=0))
//


2: Note


This definition is not saying that for any V and V, there is such a map, but is saying that if there is such a map, it is called "projection".

If there is such a f(v) for a v, it is unique, by the proposition that for any vectors space with the norm induced by any inner product, any subspace, and any vector on the superspace, if there is a vector on the subspace whose distance to the vector is the minimum, it is unique and the difference of the vectors is perpendicular to the subspace, and if there is a vector on the subspace such that the difference of the vectors is perpendicular to the subspace, it is unique and the distance is the minimum.

There are some typical cases in which f exists.

A typical case is that V is finite-dimensional: V has an orthonormal basis, B={b1,...,bd}; then, f(v)=j{1,...,d}v,bjbj is the one: for each vV, v=j{1,...,d}vjbj and vf(v),v=vf(v),j{1,...,d}vjbj=j{1,...,d}vjvf(v),bj=j{1,...,d}vj(v,bjl{1,...,d}v,blbl,bj)=j{1,...,d}vj(v,bjl{1,...,d}v,blbl,bj)=j{1,...,d}vj(v,bjl{1,...,d}v,blδl,j)=j{1,...,d}vj(v,bjv,bj)=0.

Although it has used a basis, it does really depend on the choice of basis, because f is uniquely determined by the proposition that for any vectors space with the norm induced by any inner product, any subspace, and any vector on the superspace, if there is a vector on the subspace whose distance to the vector is the minimum, it is unique and the difference of the vectors is perpendicular to the subspace, and if there is a vector on the subspace such that the difference of the vectors is perpendicular to the subspace, it is unique and the distance is the minimum.

Another typical case is that V is any Hilbert space and V is any closed vectors subspace: the proposition that for any Hilbert space, any nonempty closed convex subset, and any point on the Hilbert space, there is the unique point on the subset whose distance to the point is the minimum and the proposition that for any vectors space with the norm induced by any inner product, any subspace, and any vector on the superspace, if there is a vector on the subspace whose distance to the vector is the minimum, it is unique and the difference of the vectors is perpendicular to the subspace, and if there is a vector on the subspace such that the difference of the vectors is perpendicular to the subspace, it is unique and the distance is the minimum.

V is inevitably a Hilbert space, by the proposition that for any complete metric space, any closed subspace is complete.

When V is separable (when V is separable, V is inevitably so), V has an orthonormal Schauder basis, B={b1,b2,...}, by the proposition that any separable Hilbert space has an orthonormal Schauder basis, and f(v)=jv,bjbj is the one: it converges by the proposition that for any Hilbert space, any countable orthonormal subset, and any element of the Hilbert space, the linear combination of the subset with the the-element-and-subset-element-inner-product coefficients converges; for each vV, v=jvjbj and vf(v),v=vf(v),jvjbj=jvjvf(v),bj=jvjvlv,blbl,bj=jvj(v,bjlv,blbl,bj)=jvj(v,bjlv,blδl,j)=jvj(v,bjv,bj)=0.

Let us see that f is a projection from vectors space into vectors subspace by the definition of projection from vectors space into vectors subspace.

f is linear, because (r1v1+r2v2)(r1f(v1)+r2f(v2)),v=r1(v1f(v1))+r2(v2f(v2)),v=r1v1f(v1),v+r2v2f(v2),v=r10+r20=0, which means that f(r1v1+r2v2)=r1f(v1)+r2f(v2).

For each vV, for each wV, vv,w=0,w=0, which means that f(v)=v.


References


<The previous article in this series | The table of contents of this series | The next article in this series>