Convex cone

In linear algebra, a cone—sometimes called a linear cone for distinguishing it from other sorts of cones—is a subset of a vector space that is closed under positive scalar multiplication; that is, ${\displaystyle C}$ is a cone if ${\displaystyle x\in C}$ implies ${\displaystyle sx\in C}$ for every positive scalar ${\displaystyle s}$. A cone need not be convex, or even look like a cone in Euclidean space.

A convex cone (light blue). Inside of it, the light red convex cone consists of all points αx + βy with α, β > 0, for the depicted x and y. The curves on the upper right symbolize that the regions are infinite in extent.

When the scalars are real numbers, or belong to an ordered field, one generally calls a cone a subset of a vector space that is closed under multiplication by a positive scalar. In this context, a convex cone is a cone that is closed under addition, or, equivalently, a subset of a vector space that is closed under linear combinations with positive coefficients. It follows that convex cones are convex sets.^[1]

In this article, only the case of scalars in an ordered field is considered.

Definition

A subset ${\displaystyle C}$ of a vector space ${\displaystyle V}$ over an ordered field ${\displaystyle F}$ is a cone (or sometimes called a linear cone) if for each ${\displaystyle x}$ in ${\displaystyle C}$ and positive scalar ${\displaystyle \alpha }$ in ${\displaystyle F}$, the product ${\displaystyle \alpha x}$ is in ${\displaystyle C}$.^[2] Note that some authors define cone with the scalar ${\displaystyle \alpha }$ ranging over all non-negative scalars (rather than all positive scalars, which does not include 0).^[3]

A cone ${\displaystyle C}$ is a convex cone if ${\displaystyle \alpha x+\beta y}$ belongs to ${\displaystyle C}$, for any positive scalars ${\displaystyle \alpha }$, ${\displaystyle \beta }$, and any ${\displaystyle x}$, ${\displaystyle y}$ in ${\displaystyle C}$.^[4][5] A cone ${\displaystyle C}$ is convex if and only if ${\displaystyle C+C\subseteq C}$.

This concept is meaningful for any vector space that allows the concept of "positive" scalar, such as spaces over the rational, algebraic, or (more commonly) the real numbers. Also note that the scalars in the definition are positive meaning that the origin does not have to belong to ${\displaystyle C}$. Some authors use a definition that ensures the origin belongs to ${\displaystyle C}$.^[6] Because of the scaling parameters ${\displaystyle \alpha }$ and ${\displaystyle \beta }$, cones are infinite in extent and not bounded.

If ${\displaystyle C}$ is a convex cone, then for any positive scalar ${\displaystyle \alpha }$ and any ${\displaystyle x}$ in ${\displaystyle C}$ the vector ${\displaystyle \alpha x={\tfrac {\alpha }{2}}x+{\tfrac {\alpha }{2}}x\in C.}$ It follows that a convex cone ${\displaystyle C}$ is a special case of a linear cone.

It follows from the above property that a convex cone can also be defined as a linear cone that is closed under convex combinations, or just under additions. More succinctly, a set ${\displaystyle C}$ is a convex cone if and only if ${\displaystyle \alpha C=C}$ and ${\displaystyle C+C=C}$, for any positive scalar ${\displaystyle \alpha }$.

Examples

Convex cone that is not a conic hull of finitely many generators.

Convex cone generated by the conic combination of the three black vectors.

A cone (the union of two rays) that is not a convex cone.

• For a vector space ${\displaystyle V}$, the empty set ${\displaystyle \emptyset }$, the space ${\displaystyle V}$, and any linear subspace of ${\displaystyle V}$ are convex cones.
• The conical hull of a finite or infinite set of vectors in ${\displaystyle \mathbb {R} ^{n}}$ is a convex cone.
• The tangent cones of a convex set are convex cones.
• The set $${\displaystyle \left\{x\in \mathbb {R} ^{2}\mid x_{2}\geq 0,x_{1}=0\right\}\cup \left\{x\in \mathbb {R} ^{2}\mid x_{1}\geq 0,x_{2}=0\right\}}$$ is a cone but not a convex cone.
• The norm cone $${\displaystyle \left\{(x,r)\in \mathbb {R} ^{d+1}\mid \|x\|\leq r\right\}}$$ is a convex cone.
• The intersection of two convex cones in the same vector space is again a convex cone, but their union may fail to be one.
• The class of convex cones is also closed under arbitrary linear maps. In particular, if ${\displaystyle C}$ is a convex cone, so is its opposite ${\displaystyle -C}$, and ${\displaystyle C\cap -C}$ is the largest linear subspace contained in ${\displaystyle C}$.
• The set of positive semidefinite matrices.
• The set of nonnegative continuous functions is a convex cone.

Special examples

Affine convex cones

An affine convex cone is the set resulting from applying an affine transformation to a convex cone.^[7] A common example is translating a convex cone by a point p: p + C. Technically, such transformations can produce non-cones. For example, unless p = 0, p + C is not a linear cone. However, it is still called an affine convex cone.

Half-spaces

A (linear) hyperplane is a set in the form ${\displaystyle \{x\in V\mid f(x)=c\}}$ where f is a linear functional on the vector space V. A closed half-space is a set in the form ${\displaystyle \{x\in V\mid f(x)\leq c\}}$ or ${\displaystyle \{x\in V\mid f(x)\geq c\},}$ and likewise an open half-space uses strict inequality.^[8][9]

Half-spaces (open or closed) are affine convex cones. Moreover (in finite dimensions), any convex cone C that is not the whole space V must be contained in some closed half-space H of V; this is a special case of Farkas' lemma.

Polyhedral and finitely generated cones

Polyhedral cones are special kinds of cones that can be defined in several ways:^{[10]: 256–257}

• A cone ${\displaystyle C}$ is polyhedral if it is the conical hull of finitely many vectors (this property is also called finitely-generated).^[11][12] I.e., there is a set of vectors ${\displaystyle \{v_{1},\ldots ,v_{k}\}}$ so that ${\displaystyle C=\{a_{1}v_{1}+\cdots +a_{k}v_{k}\mid a_{i}\in \mathbb {R} _{\geq 0},v_{i}\in \mathbb {R} ^{n}\}}$.
• A cone is polyhedral if it is the intersection of a finite number of half-spaces which have 0 on their boundary (the equivalence between these first two definitions was proved by Weyl in 1935).^[13][14]
• A cone ${\displaystyle C}$ is polyhedral if there is some matrix ${\displaystyle A\in \mathbb {R} ^{m\times n}}$ such that ${\displaystyle C=\{x\in \mathbb {R} ^{n}\mid Ax\geq 0\}}$.
• A cone is polyhedral if it is the solution set of a system of homogeneous linear inequalities. Algebraically, each inequality is defined by a row of the matrix ${\displaystyle A}$. Geometrically, each inequality defines a halfspace that passes through the origin.

Every finitely generated cone is a polyhedral cone, and every polyhedral cone is a finitely generated cone.^[11] Every polyhedral cone has a unique representation as a conical hull of its extremal generators, and a unique representation of intersections of halfspaces, given each linear form associated with the halfspaces also define a support hyperplane of a facet.^[15]

Polyhedral cones play a central role in the representation theory of polyhedra. For instance, the decomposition theorem for polyhedra states that every polyhedron can be written as the Minkowski sum of a convex polytope and a polyhedral cone.^[16][17] Polyhedral cones also play an important part in proving the related Finite Basis Theorem for polytopes which shows that every polytope is a polyhedron and every bounded polyhedron is a polytope.^[16][18][19]

The two representations of a polyhedral cone - by inequalities and by vectors - may have very different sizes. For example, consider the cone of all non-negative ${\displaystyle n}$-by-${\displaystyle n}$ matrices with equal row and column sums. The inequality representation requires ${\displaystyle n^{2}}$ inequalities and ${\displaystyle 2n-1}$ equations, but the vector representation requires ${\displaystyle n!}$ vectors (see the Birkhoff-von Neumann Theorem). The opposite can also happen - the number of vectors may be polynomial while the number of inequalities is exponential.^[10]: 256

The two representations together provide an efficient way to decide whether a given vector is in the cone: to show that it is in the cone, it is sufficient to present it as a conic combination of the defining vectors; to show that it is not in the cone, it is sufficient to present a single defining inequality that it violates. This fact is known as Farkas' lemma.

A subtle point in the representation by vectors is that the number of vectors may be exponential in the dimension, so the proof that a vector is in the cone might be exponentially long. Fortunately, Carathéodory's theorem guarantees that every vector in the cone can be represented by at most ${\displaystyle d}$ defining vectors, where ${\displaystyle d}$ is the dimension of the space.

Blunt, pointed, flat, salient, and proper cones

According to the above definition, if C is a convex cone, then C ∪ {0} is a convex cone, too. A convex cone is said to be pointed if 0 is in C, and blunt if 0 is not in C.^[2][20] Blunt cones can be excluded from the definition of convex cone by substituting "non-negative" for "positive" in the condition of α, β.

A cone is called flat if it contains some nonzero vector x and its opposite −x, meaning C contains a linear subspace of dimension at least one, and salient otherwise.^[21][22] A blunt convex cone is necessarily salient, but the converse is not necessarily true. A convex cone C is salient if and only if C ∩ −C ⊆ {0}. A cone C is said to be generating if ${\displaystyle C-C=\{x-y\mid x\in C,y\in C\}}$ equals the whole vector space.^[23]

Some authors require salient cones to be pointed.^[24] The term "pointed" is also often used to refer to a closed cone that contains no complete line (i.e., no nontrivial subspace of the ambient vector space V, or what is called a salient cone).^[25][26][27] The term proper (convex) cone is variously defined, depending on the context and author. It often means a cone that satisfies other properties like being convex, closed, pointed, salient, and full-dimensional.^[28][29][30] Because of these varying definitions, the context or source should be consulted for the definition of these terms.

Rational cones

A type of cone of particular interest to pure mathematicians is the partially ordered set of rational cones. "Rational cones are important objects in toric algebraic geometry, combinatorial commutative algebra, geometric combinatorics, integer programming.".^[31] This object arises when we study cones in ${\displaystyle \mathbb {R} ^{d}}$ together with the lattice ${\displaystyle \mathbb {Z} ^{d}}$. A cone is called rational (here we assume "pointed", as defined above) whenever its generators all have integer coordinates, i.e., if ${\displaystyle C}$ is a rational cone, then ${\displaystyle C=\{a_{1}v_{1}+\cdots +a_{k}v_{k}\mid a_{i}\in \mathbb {R} _{+}\}}$ for some ${\displaystyle v_{i}\in \mathbb {Z} ^{d}}$.

Dual cone

Main article: dual cone

Let C ⊂ V be a set, not necessarily a convex set, in a real vector space V equipped with an inner product. The (continuous or topological) dual cone to C is the set

${\displaystyle C^{*}=\{v\in V\mid \forall w\in C,\langle w,v\rangle \geq 0\},}$

which is always a convex cone. Here, ${\displaystyle \langle w,v\rangle }$ is the duality pairing between C and V, i.e. ${\displaystyle \langle w,v\rangle =v(w)}$.

More generally, the (algebraic) dual cone to C ⊂ V in a linear space V is a subset of the dual space V* defined by:

${\displaystyle C^{*}:=\left\{v\in V^{*}\mid \forall w\in C,v(w)\geq 0\right\}.}$

In other words, if V* is the algebraic dual space of V, C* is the set of linear functionals that are nonnegative on the primal cone C. If we take V* to be the continuous dual space then it is the set of continuous linear functionals nonnegative on C.^[32] This notion does not require the specification of an inner product on V.

In finite dimensions, the two notions of dual cone are essentially the same because every finite dimensional linear functional is continuous,^[33] and every continuous linear functional in an inner product space induces a linear isomorphism (nonsingular linear map) from V* to V, and this isomorphism will take the dual cone given by the second definition, in V*, onto the one given by the first definition; see the Riesz representation theorem.^[32]

If C is equal to its dual cone, then C is called self-dual. A cone can be said to be self-dual without reference to any given inner product, if there exists an inner product with respect to which it is equal to its dual by the first definition.

Constructions

• Given a closed, convex subset K of Hilbert space V, the outward normal cone to the set K at the point x in K is given by

  ${\displaystyle N_{K}(x)=\left\{p\in V\colon \forall x^{*}\in K,\left\langle p,x^{*}-x\right\rangle \leq 0\right\}.}$

• Given a closed, convex subset K of V, the tangent cone (or contingent cone) to the set K at the point x is given by

  ${\displaystyle T_{K}(x)={\overline {\bigcup _{h>0}{\frac {K-x}{h}}}}.}$

• Given a closed, convex subset K of Hilbert space V, the tangent cone to the set K at the point x in K can be defined as polar cone to outwards normal cone ${\displaystyle N_{K}(x)}$:

  ${\displaystyle T_{K}(x)=N_{K}^{o}(x)\ {\overset {\underset {\mathrm {def} }{}}{=}}\ \{y\in V\mid \forall \xi \in N_{K}(x):\langle y,\xi \rangle \leqslant 0\}}$

Both the normal and tangent cone have the property of being closed and convex.

They are important concepts in the fields of convex optimization, variational inequalities and projected dynamical systems.

Properties

If C is a non-empty convex cone in X, then the linear span of C is equal to C - C and the largest vector subspace of X contained in C is equal to C ∩ (−C).^[34]

Partial order defined by a convex cone

A pointed and salient convex cone C induces a partial ordering "≥" on V, defined so that ${\displaystyle x\geq y}$ if and only if ${\displaystyle x-y\in C.}$ (If the cone is flat, the same definition gives merely a preorder.) Sums and positive scalar multiples of valid inequalities with respect to this order remain valid inequalities. A vector space with such an order is called an ordered vector space. Examples include the product order on real-valued vectors, ${\displaystyle \mathbb {R} ^{n},}$ and the Loewner order on positive semidefinite matrices. Such an ordering is commonly found in semidefinite programming.

See also

• Cone (disambiguation)
  • Cone (geometry)
  • Cone (topology)
• Farkas' lemma
• Bipolar theorem
• Ordered vector space

Notes

1. Boyd, Stephen; Vandenberghe, Lieven (2004-03-08). Convex Optimization. Cambridge University Press. ISBN 978-0-521-83378-3.
2. Bernstein, Dennis S. (2009-07-26). Matrix Mathematics: Theory, Facts, and Formulas (Second ed.). Princeton University Press. p. 97. ISBN 978-0691140391.
3. C. Zalinescu (1 January 2002). Convex Analysis in General Vector Spaces. World Scientific. p. 1. ISBN 978-981-238-067-8.
4. Nef, Walter (1988-01-01). Linear Algebra. Courier Corporation. p. 35. ISBN 9780486657721.
5. Itô, Kiyosi (1993-01-01). Encyclopedic Dictionary of Mathematics. MIT Press. ISBN 9780262590204.
6. Rockafellar, Ralph Tyrell (2015-04-29). Convex Analysis. Princeton University Press. p. 13. ISBN 9781400873173.
7. Hiriart-Urruty, Jean-Baptiste; Lemaréchal, Claude (2012-12-06). Fundamentals of Convex Analysis. Springer Science & Business Media. ISBN 9783642564680.
8. Aliprantis, Charalambos D.; Border, Kim C. (2007-05-02). Infinite Dimensional Analysis: A Hitchhiker's Guide. Springer Science & Business Media. p. 197. ISBN 9783540326960.
9. Rockafellar, Ralph Tyrell (2015-04-29). Convex Analysis. Princeton University Press. p. 10. ISBN 9781400873173.
10. Lovász, László; Plummer, M. D. (1986). Matching Theory. Annals of Discrete Mathematics. Vol. 29. North-Holland. ISBN 0-444-87916-1. MR 0859549.
11. Loera, Jesús A. De; Hemmecke, Raymond; Köppe, Matthias (2012-01-01). Algebraic and Geometric Ideas in the Theory of Discrete Optimization. SIAM. ISBN 9781611972443.
12. Schrijver, Alexander (1998-07-07). Theory of Linear and Integer Programming. John Wiley & Sons. ISBN 9780471982326.
13. Weyl, H. (1935). "Elementare Theorie der konvexen Polyeder". Commentarii Mathematici Helvetici. 7: 290–306. doi:10.1007/BF01292722.
14. Mirkil, H. (1957). "New characterizations of polyhedral cones". Canadian Journal of Mathematics. 9: 1–4. doi:10.4153/CJM-1957-001-5. MR 0083761.
15. Bruns, Winfried; Gubeladze, Joseph (2009). Polytopes, Rings and K-Theory (1 ed.). Springer Monographs in Mathematics. p. 3. ISBN 9780387763552.
16. Schrijver, Alexander (1998-07-07). Theory of Linear and Integer Programming. John Wiley & Sons. pp. 88–89. ISBN 9780471982326.
17. Conforti, Michele; Cornuejols, Gerard; Zambelli, Giacomo (2014-11-15). Integer Programming. Springer. p. 111. ISBN 9783319110080.
18. Korte, Bernhard; Vygen, Jens (2013-11-11). Combinatorial Optimization: Theory and Algorithms. Springer Science & Business Media. p. 61. ISBN 9783662217115.
19. Villarreal, Rafael (2015-03-26). Monomial Algebras, Second Edition. CRC Press. p. 9. ISBN 9781482234701.
20. Dhara, Anulekha; Dutta, Joydeep (2011-10-17). Optimality Conditions in Convex Optimization: A Finite-Dimensional View. CRC Press. p. 243. ISBN 9781439868225.
21. Neustadt, Lucien W. (2015-03-08). Optimization: A Theory of Necessary Conditions. Princeton University Press. p. 6. ISBN 9781400870530.
22. Edwards, R. E. (2012-10-25). Functional Analysis: Theory and Applications. Courier Corporation. p. 135. ISBN 9780486145105.
23. Schaefer & Wolff 1999, pp. 205–209.
24. Hadjisavvas, Nicolas; Martinez-Legaz, Juan E.; Penot, Jean-Paul (2001-04-10). Generalized Convexity and Generalized Monotonicity: Proceedings of the 6th International Symposium on Generalized Convexity/Monotonicity, Samos, September 1999. Springer Science & Business Media. p. 238. ISBN 9783540418061.
25. Bauschke, Heinz H.; Combettes, Patrick L. (2011-04-19). Convex Analysis and Monotone Operator Theory in Hilbert Spaces. Springer Science & Business Media. p. 88. ISBN 9781441994677.
26. Cameron, Neil (1985-09-05). Introduction to Linear and Convex Programming. CUP Archive. p. 32. ISBN 9780521312073.
27. Panik, M. J. (2013-12-01). Linear Programming: Mathematics, Theory and Algorithms. Springer Science & Business Media. p. 40. ISBN 9781461334347.
28. Dattorro, Jon (2005-01-01). Convex Optimization & Euclidean Distance Geometry. Meboo Publishing USA. p. 96. ISBN 9780976401308.
29. Nicola, PierCarlo (2013-03-14). Mainstream Mathematical Economics in the 20th Century. Springer Science & Business Media. p. 125. ISBN 9783662042380.
30. Fujiwara, Hidenori; Ludwig, Jean (2014-12-05). Harmonic Analysis on Exponential Solvable Lie Groups. Springer. p. 246. ISBN 9784431552888.
31. Gubeladze, Joseph; Michałek, Mateusz (1 January 2018). "The poset of rational cones". Pacific Journal of Mathematics. 292 (1): 103–115. arXiv:1606.02083. doi:10.2140/pjm.2018.292.103. S2CID 119639952.
32. Hunter, John K.; Nachtergaele, Bruno (2001-01-01). Applied Analysis. World Scientific. p. 116. ISBN 9789810241919.
33. Carothers, N. L. (2005-01-01). A Short Course on Banach Space Theory. Cambridge University Press. ISBN 9780521603720.
34. Narici & Beckenstein 2011, pp. 149–153.

References

• Bourbaki, Nicolas (1987). Topological Vector Spaces. Elements of Mathematics. Berlin, New York: Springer-Verlag. ISBN 978-3-540-13627-9.
• Narici, Lawrence; Beckenstein, Edward (2011). Topological Vector Spaces. Pure and applied mathematics (Second ed.). Boca Raton, FL: CRC Press. ISBN 978-1584888666. OCLC 144216834.
• Rockafellar, R. T. (1997) [1970]. Convex Analysis. Princeton, NJ: Princeton University Press. ISBN 1-4008-7317-7.
• Schaefer, Helmut H.; Wolff, Manfred P. (1999). Topological Vector Spaces. GTM. Vol. 8 (Second ed.). New York, NY: Springer New York Imprint Springer. ISBN 978-1-4612-7155-0. OCLC 840278135.
• Trèves, François (2006) [1967]. Topological Vector Spaces, Distributions and Kernels. Mineola, N.Y.: Dover Publications. ISBN 978-0-486-45352-1. OCLC 853623322.
• Zălinescu, C. (2002). Convex Analysis in General Vector Spaces. River Edge, NJ: World Scientific. ISBN 981-238-067-1. MR 1921556.