von Neumann Minimax

lean4-proofoptimizationvisualization
minxmaxyf(x,y)=maxyminxf(x,y)\min_x \max_y f(x,y) = \max_y \min_x f(x,y)

Statement

Let XRmX \subseteq \mathbb{R}^m and YRnY \subseteq \mathbb{R}^n be compact convex sets, and f:X×YRf : X \times Y \to \mathbb{R} be convex in xx and concave in yy. Then:

minxXmaxyYf(x,y)=maxyYminxXf(x,y).\min_{x \in X}\, \max_{y \in Y}\, f(x,y) = \max_{y \in Y}\, \min_{x \in X}\, f(x,y).

The common value is the saddle point value vv^*. A pair (x,y)(x^*, y^*) is a saddle point if f(x,y)f(x,y)f(x,y)f(x^*, y) \le f(x^*, y^*) \le f(x, y^*) for all x,yx, y.

Trivial inequality: maxyminxfminxmaxyf\max_y \min_x f \le \min_x \max_y f always holds. The minimax theorem provides equality.

Visualization

2x2 matrix game: A=(1230)A = \begin{pmatrix} 1 & 2 \\ 3 & 0 \end{pmatrix}. Player I picks row ii, Player II picks column jj. Payoff: AijA_{ij}.

Pure strategy analysis:

Strategy II →Col 1Col 2row min
Row 1121
Row 2300
col max32

maximinjAij=1\max_i \min_j A_{ij} = 1 (row 1 is the maximin row). minjmaxiAij=2\min_j \max_i A_{ij} = 2 (col 2 is the minimax column).

No pure saddle point exists (121 \ne 2). Mixed strategy equilibrium recovers the minimax value.

Mixed strategy computation: let x=(p,1p)x = (p, 1-p) and y=(q,1q)y = (q, 1-q). Payoff:

v(p,q)=pq+2p(1q)+3(1p)q=3q+2p4pq.v(p,q) = pq + 2p(1-q) + 3(1-p)q = 3q + 2p - 4pq.

At the saddle point v/p=24q=0q=1/2\partial v / \partial p = 2 - 4q = 0 \Rightarrow q = 1/2 and v/q=34p=0p=3/4\partial v / \partial q = 3 - 4p = 0 \Rightarrow p = 3/4.

Minimax value: v=3(1/2)+2(3/4)4(3/4)(1/2)=3/2+3/23/2=3/2v^* = 3(1/2) + 2(3/4) - 4(3/4)(1/2) = 3/2 + 3/2 - 3/2 = 3/2.

Proof Sketch

  1. Weak inequality: maxyminxf(x,y)minxmaxyf(x,y)\max_y \min_x f(x,y) \le \min_x \max_y f(x,y) holds by swapping order.
  2. Nash's supporting hyperplane argument: for each fixed yy, g(y)=minxf(x,y)g(y) = \min_x f(x,y) is concave. Its supremum is attained at yy^*.
  3. Separation theorem: if equality failed, a hyperplane would separate the epigraph of minxf\min_x f from the hypograph of maxyf\max_y f, contradicting the convex-concave structure.
  4. Mathlib: IsSaddlePointOn in Mathlib.Order.SaddlePoint formalises the saddle point characterisation; the minimax theorem for finite games reduces to LP duality.

Connections

  • LP Duality — the minimax theorem and LP duality are equivalent; each is a consequence of the other
  • Nash Equilibrium ExistenceNash Equilibrium Existence finite game,  σ:  ui(σ)ui(σi,σi)  i,σi\forall\text{ finite game},\; \exists \sigma^*:\; u_i(\sigma^*) \ge u_i(\sigma_i', \sigma^*_{-i})\;\forall i, \sigma_i'Every finite strategic-form game has at least one mixed Nash equilibriumRead more → — Nash's theorem generalises the minimax theorem to non-zero-sum games via Brouwer's fixed point theorem
  • Convex FunctionConvex Functionf(λx+(1λ)y)λf(x)+(1λ)f(y)f(\lambda x + (1-\lambda)y) \le \lambda f(x) + (1-\lambda)f(y)A function is convex when the chord between any two points lies above the graphRead more → — the minimax theorem requires convexity in one variable and concavity in the other
  • Brouwer Fixed-Point TheoremBrouwer Fixed-Point Theoremf:DnDn continuous    x,  f(x)=xf : D^n \to D^n \text{ continuous} \implies \exists\, x,\; f(x) = xEvery continuous map from a compact convex set to itself has a fixed pointRead more → — Nash's proof of minimax for general games uses Brouwer's fixed point theorem

Lean4 Proof

import Mathlib.Order.SaddlePoint

/-- The trivial minimax inequality: max min ≤ min max.
    Equality (von Neumann) requires compactness + convexity/concavity,
    which is beyond current Mathlib for the full theorem.
    Here we verify the concrete 2x2 mixed-strategy value v* = 3/2. -/
theorem minimax_2x2_value :
    (3 : ) * (1 / 2) + 2 * (3 / 4) - 4 * (3 / 4) * (1 / 2) = 3 / 2 := by
  norm_num