nLab nonstandard analysis




Nonstandard analysis is a rich formalization of analysis that uses a certain explicit notions of infinitesimal objects. In fact, not only infinitesimal but also infinitely large can be accomodated (and must be). Moreover, not only the field of real numbers, but more general algebraic structures can be extended, essentially via a construction of ultraproducts; also general sets can be extended to contain nonstandard elements (see internal set).

In fact the nonstandard method is not limited to analysis, but is rather a method of producing a models in the sense of model theory, as pioneered by Robinson or using a syntactic extension of set theory, like the theory of internal sets by Nelson.

See also nonstandard analysis in topology, internal set.


At its beginning, infinitesimal calculus was developed nonrigorously, though many interesting arguments and formal manipulations were found. Cauchy and Weierstraß introduced the ϵ\epsilon-δ\delta approach, which enabled modern rigorous analysis, but sometimes this method is cumbersome. For example, sometimes one needs to work with several infinitesimal levels or kinds of continuity in the same problem, and finding estimates may be very cumbersome. One would like to introduce infinitesimal quantities as additional elements of the sets of usual (‘standard’) quantities. Several related rigorous frameworks appeared under the name of nonstandard analysis, since the first such discovered by Abraham Robinson. Most often, approaches using ultrafilters, certain classes called internal sets and using topos theory enable the foundation of nonstandard analysis. Many properties and theorems from classical analysis imply new statements of nonstandard analysis; the mechanism is the so-called transfer principle, which can be required axiomatically without respect to a particular model of nonstandard analysis.


An approach via ultrafilters

Assuming the axiom of choice (whose full strength is not necessary), there exists a free (= not containing finite subsets) ultrafilter FF on the set of natural numbers ={1,2,3,}\mathbb{N}=\{1,2,3,\ldots\}, and such ultrafilters are in 1111 correspondence with finitely additive measures on \mathbb{N} (using the algebra of all subsets) taking values in the two element set {0,1}\{0,1\}.

Fix a free ultrafilter FF on \mathbb{N}, and consider the set of all sequences of real numbers, \mathbb{R}^{\mathbb{N}}. So an element in here is a sequence

a=(a 0,a 1,a 2,) a = (a_0, a_1, a_2, \cdots)

of real numbers.

We write f Fgf\sim_F g if the set {i|f(i)=g(i)}\{i\in\mathbb{N}|f(i)=g(i)\} belongs to FF; these are precisely the sequences which are equal almost everywhere with respect to the associated measure. The relation F\sim_F is an equivalence relation and *:= / F{}^*\mathbb{R} := \mathbb{R}^{\mathbb{N}}/{\sim_F} is a nonstandard extension of \mathbb{R}, whose elements are sometimes called hyperreal numbers.

(This is a special case of the ultraproduct construction in model theory. In fact, we could have started with an ultrafilter on any set, not just \mathbb{N}. Such more general ultraproducts are necessary in order to obtain more refined models of nonstandard analysis satisfying stronger “saturation” principles.)

Given f f\in \mathbb{R}^{\mathbb{N}}, we write f Ff_F for its equivalence class in *{}^*\mathbb{R}. In particular, given any real number rr\in \mathbb{R} the image *r:=(ir) F^* r :=(i\mapsto r)_F of the constant sequence

r=(r,r,r,). r = (r,r,r, \cdots ) \,.

is an element in *^*\mathbb{R} and this gives an injection *: **:\mathbb{R}\hookrightarrow {}^*\mathbb{R}.

*^*\mathbb{R} is equipped with a strict total ordering given by

f F<g F{i|f(i)<g(i)}F, f_F\lt g_F \;\Leftrightarrow\; \{i\in\mathbb{N}|f(i)\lt g(i)\}\in F,

which makes *: **:\mathbb{R}\hookrightarrow {}^*\mathbb{R} a monotone function.

  • An element δ *\delta\in{}^*\mathbb{R} such that *0<δ^* 0\lt\delta is called a positive number .

  • An element δ\delta such that for all positive rr\in \mathbb{R} we have *r<δ< *r -{}^* r \lt \delta\lt{}^* r is called an infinitesimal number.

Unlike in the real numbers, positive infinitesimal numbers exist: for example the class f Ff_F where f:n1/nf:n\mapsto 1/n is such and g Fg_F for g:n1/n 2g:n\mapsto 1/n^2 is a different one.

Let nn be a nonnegative integer and u: nu:\mathbb{R}^n\to\mathbb{R} a function. Then there is a nonstandard extension *u:( *) n *^* u:({}^*\mathbb{R})^n\to{}^*\mathbb{R} of uu; it is defined by

*u(f F 1,,f F n)=g{i|u(f 1(i),,f n(i))=g(i)}F. ^*u(f^1_F,\ldots, f^n_F) = g \;\Leftrightarrow\; \{i\in\mathbb{N}| u(f^1(i),\ldots,f^n(i))=g(i) \}\in F.

This is indeed an extension of uu in the sense that *u( *r 1,, *r n)= *r^* u({}^*r_1,\ldots,{}^*r_n)={}^* r iff u(r 1,,r n)=ru(r_1,\ldots,r_n)=r. This way, the usual operations +,+,\cdot and the absolute value |||\cdot| extend to *^*\mathbb{R}; usually one denotes these and other standard operations on *{}*\mathbb{R} without putting *^* in front, writing simply e.g. f F+g Ff_F+g_F.

To extend division appropriately, we need a little bit more care as it is originally just partially defined, so we need an extension of the formalism to subsets of the real line. In particular there is a following definition of an extension *E *^* E\subset{}^*\mathbb{R} of a subset EE\subset\mathbb{R}:

f F *E{i|f(i)E}F. f_F\in{}^* E \;\Leftrightarrow\; \{i\in\mathbb{N}|f(i)\in E\}\in F.

(For example, a number is positive, as defined earlier, if an only if it belongs to *{r|r>0}^*\{r|r \gt 0\}.) Then division is extended to a function *× *{r|r0} *^*\mathbb{R} \times ^*\{r|r \ne 0\} \to ^*\mathbb{R}. If 1/x1/x is infinitesimal, then xx itself is infinite.

Conversely, an element x *x\in{}^*\mathbb{R} is finite if |x|< *r|x|\lt {}^* r for some rr\in\mathbb{R}. Every finite element x *x\in{}^*\mathbb{R} is infinitely close to a unique real number qq\in\mathbb{R} in the sense that x *qx-{}^*q is infinitesimal. We say that qq is the standard part of xx and is denoted by q=st(x)q= st(x). Given a real number rr\in\mathbb{R}, the subset μ(r)\mu(r) of all elements x *x\in{}^*\mathbb{R} such that st(x)=rst(x)=r is said to be the monad of the real number rr\in\mathbb{R}. Monads should be thought of as infinitesimal neighborhoods. An elementary fact: a subset EE\subset\mathbb{R} is open iff μ(r) *E\mu(r)\subset{}^*E for all rEr\in E; EE is closed iff st(x)Est(x)\in E for all finite x *Ex\in{}^* E; and EE is compact iff, for all x *Ex\in{}^* E, xx is finite and st(x)Est(x)\in E.

In this model of nonstandard analysis, the transfer principle is a corollary of a general theorem on ultraproducts due Jerzy Łoś. It can be stated in terms of a certain formal language L()L(\mathbb{R}) of the real numbers. We can also extend this model to ultrapowers of larger sets, not just \mathbb{R} itself, with a corresponding extension of the language. In the limit where we reach an entire “universe” of mathematics, this leads to the topos-theoretic filterquotient and sheaf models below.

Filterquotients of topoi

The ultrapower construction above can be performed in the general context of topos theory. From any topos \mathcal{E} and any filter Φ\Phi of subterminal objects in \mathcal{E}, one can construct a topos /Φ\mathcal{E}/\Phi, the filterquotient? of \mathcal{E} by Φ\Phi. There is a logical functor /Φ\mathcal{E} \to \mathcal{E}/\Phi.

If =Set/\mathcal{E} = Set / \mathbb{N}, then any filter on \mathbb{N} gives a filter of subterminals in \mathcal{E}, whose corresponding filterquotient corresponds to the above construction. The composite functor

SetSet/(Set/)/Φ Set \to Set/\mathbb{N} \to (Set/\mathbb{N})/\Phi

might be written *()^*(-). If Φ\Phi is an ultrafilter, then (Set/)/Φ(Set/\mathbb{N})/\Phi is a two-valued topos, whose internal logic is essentially that of the ultrafilter model described above. In particular, the global elements of *^*\mathbb{R}, as an object of this topos, are precisely the “hyperreal numbers” described above.

In this context, the transfer principle is the fact that the functor *()^*(-) is both logical and conservative, and hence it both preserves and reflects the truth of formulas in the internal languages.

Sheaves on the topos of filters

A different topos-theoretic construction is to consider the topos of sheaves on a category of filters. This topos models the internal set theory of Nelson, a more axiomatic approach to nonstandard analysis. References:

  • I. Moerdijk, A model for intuitionistic non-standard arithmetic
  • Erik Palmgren, A sheaf-theoretic foundation for nonstandard analysis
  • E. Palmgren, A constructive approach to nonstandard analysis
  • E. Palmgern, Remarks on a constructive sheaf model of nonstandard analysis, doi
  • Jonas Eliasson, Ultrapowers as sheaves on a category of ultrafilters

Measure and generalized functions

The Lebesgue measure on R n\mathbf{R}^n extends to Loeb measure on *R n{}^\ast\mathbf{R}^n. This may be used for probability theory and also for generalized functions.

The theory of generalized functions of Schwarz can be reproduced by nonstandard analysis:

Theorem. (Abraham Robinson) Every generalized function f:RRf:\mathbf{R}\to\mathbf{R} can be represented as the integration of the product of test function with a nonstandard smooth function f˜: *R *R\tilde{f}: {}^\ast\mathbf{R}\to{}^\ast \mathbf{R}

(f,ϕ)=f˜ϕdx (f,\phi) = \int \tilde{f} \phi d x

There is also inutionistic version of nonstandard analysis approach to generalized functions as well as nonstandard approaches to Sato hyperfunctions (Sousa pinto), to Coulombeu distributions etc.

Relationship to other types of infinitesimal

There are other ways of realizing the notion of infinitesimal number precisely, such as synthetic differential geometry and the surreal numbers. Neither seem to be very closely related to NSA—the techniques and flavor of each subject are quite different. However, some things can be said.

  • While the most common infinitesimals appearing in SDG are nilpotent, in contrast to those of NSA which are invertible, some models of SDG do contain invertible infinitesimals; see here.

  • Since the surreal numbers are the universally embedding ordered field, any field of hyperreals can be embedded in the surreals. However, such embeddings don’t seem very useful, since they don’t preserve any of the important structure of the hyperreals (such as the transfer principle).


Original references:

  • Abraham Robinson, Non-standard analysis, Studies in Logic and the Foundations of Mathematics 42, North-Holland (1966), Princeton University Press (1996) [ISBN:9780691044903]

  • Jerome Keisler, Foundations of Infinitesimal Calculus, Prindle Weber & Schmidt (1976, 2022) [pdf]

  • Jerome Keisler, Elementary calculus: an infinitesimal approach, online undergraduate textbook.

Textbook accounts:

See also:

  • Wikipedia: nonstandard analysis, ultraproduct, hyperreal numbers, Abraham Robinson, constructive non-standard analysis, criticism of nonstandard analysis

  • Sergio Albeverio, Jens Erik Fenstad, Raphael Hoegh-Krohn, Nonstandard methods in stochastic analysis and mathematical physics, Academic Press 1986 (there is also a Dover 2009 edition and a 1990 Russian translation)

  • Sergio Salbany, Todor Todorov, Nonstandard analysis in topology, arxiv/1107.3323

  • Ieke Moerdijk, A model for intuitionistic nonstandard arithmetic, Annals of Pure and Applied Logic 73 (1995), pp. 37–51.

  • Jaap van Oosten, Synthetic Nonstandard Arithmetic, 2011 (pdf)

  • Juha Ruokolainen, Constructive nonstandard analysis without actual infinity, 2004, pdf

  • E. Palmgren, Developments in Constructive Nonstandard Analysis, Bull. Symbolic Logic 4, n. 3 (1998), 233–272.

  • E. Palmgren, Constructive nonstandard representations of generalized functions, doi

  • Robert A. Herrmann, Nonstandard analysis and generalized functions, math.FA/0403303

  • Robert A. Hermann, Nonstandard analysis applied to advanced undergraduate mathematics, math.GM/0312432

  • A. E. Hurd, P. A. Loeb, Introduction to nonstandard real analysis, Acad. Press 1985.

  • Hans Vernaeve, Nonstandard principles for generalized functions, arxiv/1101.6075

  • Imme van den Bergh, Vítor Manuel Carvalho das Neves (eds.), The strength of nonstandard analysis, gBooks

  • R. F. Hoskins, J. Sousa Pinto, Theories of generalized functions, Horwood Publ. 2005

  • Imme van den Berg, Nonstandard asymptotic analysis, Lec. Notes Math. 1249, Springer 1987

  • Edward Nelson, Radically elementary probability theory

  • Diener-Diener (eds.), Nonstandard analysis in practice

  • Loeb-Wolff (eds.), Nonstandard analysis for the working mathematician

  • Terry Tao, Ultraproducts as a bridge between discrete and continuous analysis (web)

  • V. A. Lyubetskiĭ, Оценки и пучки. О некоторых вопросах нестандартного анализа, Uspekhi Mat. Nauk 44 (1989), no. 4(268), 99–153, 256; translation Valuations and sheaves. On some questions of non-standard analysis, in Russian Math. Surveys 44 (1989), no. 4, 37–112 MR1023104 doi IOP pdf rus pdf

  • Bruno Dinis, Nonstandard intuitionistic interpretations, arxiv/1512.07113

  • Sam Sanders, The unreasonable effectiveness of nonstandard analysis, arxiv/1508.07434

  • V. Kanovei, A course on foundations of nonstandard analysis, (With a preface by M. Reeken.), IPM, Tehran, Iran, 1994.

  • V. Kanovei, M. Reeken, Internal approach to external sets and uni- verses, Part 1, Bounded set theory, Studia Logica, 1995.

On the relation of the techniques of the pioneers of infinitesimal calculus and Robinson’s nonstandard analysis:

Last revised on December 25, 2023 at 02:51:52. See the history of this page for a list of all contributions to it.