Why is the dot product connected to projection?

You have already used coordinates, vector lengths, and normalization. Here we also use angles: 0° means the same direction, 90° means perpendicular, and 180° means opposite directions. We will introduce the formulas after two experiments.

Imagine a blue arrow a above a horizontal line. Drop a perpendicular from its tip to that line. The green arrow from the origin to the landing point is its “shadow.” The orange arrow b points right along the same direction.

The explorer also reports a number called the dot product. Can you work out how that number relates to the shadow?

Keep a record of your investigation

Keep an experiment record in a notebook or text file: settings, prediction, observed signed shadow length, dot product, and projection vector. Use angle 0° with lengths 10 and 1 as the first reference. Change only the angle in the first experiment; in the second, fix $\mathbf a=(3,4)$ and the direction of $\mathbf b$ , then change only its length. Before opening an explanation, compare a trial with its reference and write what the evidence says about your prediction.

First experiment: rotate without stretching

Keep a at length 10 and b at length 1. Before trying the controls, predict:

At 0°, how long should the shadow be?
At 90°, can the shadow disappear even though the arrow still has length?
At 180°, which direction should the shadow point? What sign would record that direction?

Now select 0°, 90°, and 180°. Then try 60°. Compare the shadow and the two numerical readouts.

Rotate a. Watch its shadow.

Blue: vector aGreen: projectionOrange: vector b

b points right and is drawn below the line for visibility. Both vectors use the same scale.

Angle θ 20°

Length of a 10

Length of b 1

Signed projection9.40

Dot product9.40

Projection vector(9.40, 0)on the horizontal line

What changed even though the arrow’s length stayed fixed? Explain the sign before opening the comparison.

Compare your observations

The signed shadow length is 10 at 0°, 0 at 90°, and −10 at 180°. The minus sign records a direction opposite to b, not a negative geometric length. At 60°, it is 5. With b at length 1, the dot product matches this signed number in every case.

The shadow lies on the whole line through b. It can extend beyond the tip of b or point backward.

Second experiment: can the number change without the shadow moving?

In the same explorer, select a = (3, 4). This sets b to $(1,0)$ . Record the signed shadow length, the dot product, and the projection vector.

Before changing Length of b from 1 to 2, predict which of those three quantities will change. Keep a fixed, make the change, and compare.

Now predict the results for length 3 and test again. What rule explains both experiments?

Compare your rule

The shadow vector stays $(3,0)$ and its signed length stays 3. The dot product takes values 3, 6, and 9 as the length of b changes from 1 to 2 to 3. The direction of b fixes where the shadow falls; its length scales the dot product.

Name the quantities and explain the pattern

The shadow arrow is the vector projection. Its signed length along b is the scalar projection, which we will call $p$ .

For an acute angle $\theta$ , the arrow, its shadow, and the perpendicular form a right triangle. Cosine is the adjacent side divided by the hypotenuse, so $p/\|\mathbf a\|=\cos\theta$ . The signed version extends through 90° to 180°:

p=\|\mathbf a\|\cos\theta.

The dot product can be calculated from coordinates. In two dimensions:

\mathbf a\cdot\mathbf b=a_xb_x+a_yb_y.

For our second experiment, $(3,4)\cdot(1,0)=3$ , while $(3,4)\cdot(2,0)=6$ . Doubling the horizontal component of b doubled the dot product, while the shadow stayed at $(3,0)$ .

The two experiments show what the dot product responds to. In the first, both lengths stayed fixed while the angle changed. In the second, the angle stayed fixed while the length of b changed. One comparison isolated alignment; the other isolated magnitude.

That’s the geometric intuition behind the dot product: with their lengths held fixed, the more two vectors are aligned, the more strongly they contribute to the resulting scalar.

The formula is:

\boxed{\mathbf a\cdot\mathbf b=\|\mathbf a\|\|\mathbf b\|\cos\theta}

There are two things happening:

Magnitudes ( $\|\mathbf a\|\|\mathbf b\|$ ) determine the maximum possible size of the dot product.
Alignment ( $\cos\theta$ ) determines how much of that maximum is realized.

Here, stronger alignment means a larger signed value. The cosine is 1 for the same direction, 0 for perpendicular vectors, and −1 for opposite directions. Opposite vectors therefore give the most negative value, with the same absolute size as the positive maximum.

For example, with $\|\mathbf a\|=7$ , $\|\mathbf b\|=6.5$ , and $\theta=39.48^\circ$ , the magnitude product is $7\times6.5=45.5$ . The alignment factor is $\cos(39.48^\circ)\approx0.772$ , so

\mathbf a\cdot\mathbf b=7(6.5)\cos(39.48^\circ)\approx35.1.

At this angle, the dot product is about 77.2% of its maximum positive value. Keeping both lengths fixed and rotating the vectors into the same direction would give the full $45.5$ .

To connect this back to the shadow, substitute $p=\|\mathbf a\|\cos\theta$ into the boxed formula:

\mathbf a\cdot\mathbf b=p\|\mathbf b\|.

The dot product is the signed projection length multiplied by $\|\mathbf b\|$ . A unit vector has length 1, so using one makes the dot product equal to $p$ , as in the first experiment. The angle formula assumes nonzero vectors; the coordinate formula also works for the zero vector.

For a nonzero reference vector b:

Quantity	Formula	What you get
Dot product	$\mathbf a\cdot\mathbf b$	Signed projection length multiplied by $\\|\mathbf b\\|$
Scalar projection	$\dfrac{\mathbf a\cdot\mathbf b}{\\|\mathbf b\\|}$	Signed length along b
Vector projection	$\dfrac{\mathbf a\cdot\mathbf b}{\\|\mathbf b\\|^2}\mathbf b$	A vector on the line through b

If b is the zero vector, the dot product is zero, but projection onto its direction is undefined: it has no direction to project onto.

Try a new case: reverse the reference arrow

Work this case on paper: keep $\mathbf a=(3,4)$ and change $\mathbf b$ from $(2,0)$ to $(-2,0)$ . Predict the dot product, scalar projection, and vector projection before calculating. Does reversing the arrow change the line it lies on?

Check your reasoning

The dot product is $3(-2)+4(0)=-6$ . Dividing by $\|\mathbf b\|=2$ gives scalar projection $-3$ . The vector projection is

\frac{-6}{4}(-2,0)=(3,0).

The line and shadow vector stay the same. The signed quantities change because the reference direction reverses.

Coordinates are projections, too

The horizontal coordinate of $(3,4)$ is 3 because its dot product with the horizontal unit vector $(1,0)$ is 3. Its vertical coordinate is 4 because its dot product with $(0,1)$ is 4.

More generally, in an orthonormal basis (perpendicular unit vectors), each coordinate is a dot product:

a_i = \mathbf a\cdot\mathbf e_i

Choosing a different orthonormal basis means measuring the same vector along different directions. This is the geometry behind the projection steps in PCA and SVD.

Why this matters for a neuron

A neuron’s weighted sum $\mathbf w\cdot\mathbf x$ measures the signed projection of the input x onto the weight direction w, scaled by $\|\mathbf w\|$ . A bias shifts that result, and an activation function transforms it.

For inputs of the same length, stronger alignment with w gives a larger weighted sum. That’s the geometric sense in which a neuron can detect a direction in its input space.

Takeaway: the angle controls how much of one vector falls along another direction. The dot product measures that amount, scaled by the reference vector’s length.

Design your own comparison

Choose an angle other than the worked angles, keeping both vectors nonzero. Record the settings and the three readouts. Propose a change to the length of $\mathbf b$ that you think will alter the dot product while preserving the shadow vector. Write your prediction, keep $\mathbf a$ and the direction of $\mathbf b$ fixed, then test your change.

Repeat at 90° as a separate comparison. Does changing the length of $\mathbf b$ still change the dot product? Revise your claim to include this boundary case.

Write a short conclusion: what you predicted, what you observed, and how the evidence changed or supported your explanation.

Check the reasoning in your investigation

For a fixed direction of $\mathbf b$ , its positive length does not affect either projection. The dot product scales with that length, but when the signed shadow is zero, every such dot product stays zero. Cite your settings and readouts, and distinguish this observation from the formula that explains the general rule.

Check your understanding

Try five questions about angles, scaling, and what a projection measures. Select an answer, then use Check answer to see the reasoning. You can revisit a question and try again.

Question 1 of 50 checked · 0 correct

Vector a has length 10 and makes a 60° angle with unit vector b. What is a · b?1050

Keep learning

To see how a matrix uses dot products to produce each output coordinate, continue with Dot products: building the output one row at a time.