Operational calculus

Operational calculus, also known as operational analysis, is a technique by which problems in analysis, in particular differential equations, are transformed into algebraic problems, usually the problem of solving a polynomial equation.

History

The idea of representing the processes of calculus, differentiation and integration, as operators has a long history that goes back to Gottfried Wilhelm Leibniz. The mathematician Louis François Antoine Arbogast was one of the first to manipulate these symbols independently of the function to which they were applied.^[1]

This approach was further developed by Francois-Joseph Servois who developed convenient notations.^[2] Servois was followed by a school of British and Irish mathematicians including Charles James Hargreave, George Boole, Bownin, Carmichael, Doukin, Graves, Murphy, William Spottiswoode and Sylvester.

Treatises describing the application of operator methods to ordinary and partial differential equations were written by Robert Bell Carmichael in 1855^[3] and by Boole in 1859.^[4]

This technique was fully developed by the physicist Oliver Heaviside in 1893, in connection with his work in telegraphy.

Guided greatly by intuition and his wealth of knowledge on the physics behind his circuit studies, [Heaviside] developed the operational calculus now ascribed to his name.^[5]

At the time, Heaviside's methods were not rigorous, and his work was not further developed by mathematicians. Operational calculus first found applications in electrical engineering problems, for the calculation of transients in linear circuits after 1910, under the impulse of Ernst Julius Berg, John Renshaw Carson and Vannevar Bush.

A rigorous mathematical justification of Heaviside's operational methods came only after the work of Bromwich that related operational calculus with Laplace transformation methods (see the books by Jeffreys, by Carslaw or by MacLachlan for a detailed exposition). Other ways of justifying the operational methods of Heaviside were introduced in the mid-1920s using integral equation techniques (as done by Carson) or Fourier transformation (as done by Norbert Wiener).

A different approach to operational calculus was developed in the 1930s by Polish mathematician Jan Mikusiński, using algebraic reasoning.

Norbert Wiener laid the foundations for operator theory in his review of the existential status of the operational calculus in 1926:^[6]

The brilliant work of Heaviside is purely heuristic, devoid of even the pretense to mathematical rigor. Its operators apply to electric voltages and currents, which may be discontinuous and certainly need not be analytic. For example, the favorite corpus vile on which he tries out his operators is a function which vanishes to the left of the origin and is 1 to the right. This excludes any direct application of the methods of Pincherle…

Although Heaviside’s developments have not been justified by the present state of the purely mathematical theory of operators, there is a great deal of what we may call experimental evidence of their validity, and they are very valuable to the electrical engineers. There are cases, however, where they lead to ambiguous or contradictory results.

Principle

The key element of the operational calculus is to consider differentiation as an operator p = ⁠d/dt⁠ acting on functions. Linear differential equations can then be recast in the form of "functions" F(p) of the operator p acting on the unknown function equaling the known function. Here, F is defining something that takes in an operator p and returns another operator F(p). Solutions are then obtained by making the inverse operator of F act on the known function. The operational calculus generally is typified by two symbols: the operator p, and the unit function 1. The operator in its use probably is more mathematical than physical, the unit function more physical than mathematical. The operator p in the Heaviside calculus initially is to represent the time differentiator ⁠d/dt⁠. Further, it is desired for this operator to bear the reciprocal relation such that p⁻¹ denotes the operation of integration.^[5]

In electrical circuit theory, one is trying to determine the response of an electrical circuit to an impulse. Due to linearity, it is enough to consider a unit step:

Heaviside step function: H(t) such that H(t) = 0 if t < 0 and H(t) = 1 if t > 0.

The simplest example of application of the operational calculus is to solve: p y = H(t), which gives

${\displaystyle y=\operatorname {p} ^{-1}H=\int _{0}^{t}H(u)\,du=t\,H(t).}$

From this example, one sees that ${\displaystyle \operatorname {p} ^{-1}}$ represents integration. Furthermore n iterated integrations is represented by ${\displaystyle \operatorname {p} ^{-n},}$ so that

${\displaystyle \operatorname {p} ^{-n}H(t)={\frac {t^{n}}{n!}}H(t).}$

Continuing to treat p as if it were a variable,

${\displaystyle {\frac {\operatorname {p} }{\operatorname {p} -a}}H(t)={\frac {1}{1-{\frac {a}{\operatorname {p} }}}}\,H(t),}$

which can be rewritten by using a geometric series expansion: $${\displaystyle {\frac {1}{1-{\frac {a}{\operatorname {p} }}}}H(t)=\sum _{n=0}^{\infty }a^{n}\operatorname {p} ^{-n}H(t)=\sum _{n=0}^{\infty }{\frac {a^{n}t^{n}}{n!}}H(t)=e^{at}H(t).}$$

Using partial fraction decomposition, one can define any fraction in the operator p and compute its action on H(t). Moreover, if the function 1/F(p) has a series expansion of the form

${\displaystyle {\frac {1}{F(\operatorname {p} )}}=\sum _{n=0}^{\infty }a_{n}\operatorname {p} ^{-n},}$

it is straightforward to find

${\displaystyle {\frac {1}{F(\operatorname {p} )}}H(t)=\sum _{n=0}^{\infty }a_{n}{\frac {t^{n}}{n!}}H(t).}$

Applying this rule, solving any linear differential equation is reduced to a purely algebraic problem.

Heaviside went further and defined fractional power of p, thus establishing a connection between operational calculus and fractional calculus.

Using the Taylor expansion, one can also verify the Lagrange–Boole translation formula, e^{a p} f(t) = f(t + a), so the operational calculus is also applicable to finite-difference equations and to electrical engineering problems with delayed signals.

See also

• Calculus of finite differences
• Umbral calculus

References

1. Louis Arbogast (1800) Du Calcul des Derivations, link from Google Books
2. Francois-Joseph Servois (1814) Analise Transcendante. Essai sur un Nouveau Mode d'Exposition des Principes der Calcul Differential, Annales de Gergonne 5: 93–140
3. Robert Bell Carmichael (1855) A treatise on the calculus of operations, Longman, link from Google Books
4. George Boole (1859) A Treatise on Differential Equations, chapters 16 &17: Symbolical methods, link from HathiTrust
5. B. L. Robertson (1935) Operational Method of Circuit Analysis, Transactions of the American Institute of Electrical Engineers 54(10):1035–45, link from IEEE Explore
6. Norbert Wiener (1926) The Operational Calculus, Mathematische Annalen 95:557, link from Göttingen Digitalisierungszentrum

Further sources

During Heaviside's lifetime

• Terquem & Gerono (1855). "[no title cited]". Nouvelles Annales de Mathématiques. 14: 83. — Some historical references on the precursor work up to Carmichael].

• Heaviside, Oliver (1892). Electrical Papers. London, UK.{{cite book}}: CS1 maint: location missing publisher (link)

• Heaviside, Oliver (1902) [1893, 1899]. Electromagnetic Theory. London, UK.{{cite book}}: CS1 maint: location missing publisher (link)

• Heaviside, Oliver (1893). "III. On Operators in Physical Mathematics. Part I." Proceedings of the Royal Society of London. 52: 504–529. doi:10.1098/rspl.1892.0093. ISSN 0370-1662.

Heaviside, Oliver (1894). "VIII. On Operators in Physical Mathematics. Part II". Proceedings of the Royal Society of London. 54 (326–330): 105–143. doi:10.1098/rspl.1893.0059. ISSN 0370-1662. S2CID 121790063.

After Heaviside's death

• Berg, E. (1929). Heaviside's Operational Calculus. McGraw-Hill – via Internet Archive (archive.org).

• Bush, V. (1929). Operational Circuit Analysis. John Wiley & Sons. with an appendix by Norbert Wiener

• Calvert, James B. (2002). "Heaviside, Laplace, and the inversion integral". mysite.du.edu (academic pers.). University of Denver.

• Carslaw, H.S. (1941). Operational Methods in Applied Mathematics. Oxford University Press. Archived from the original on 19 July 2011 – via www.new.dli.ernet.in.

• Carson, J.R. (January–February 1926). "The Heaviside operational calculus". Bulletin of the American Mathematical Society. 32 (1): 43–68. doi:10.1090/S0002-9904-1926-04162-8. Retrieved 7 December 2023 – via Project Euclid (projecteuclid.org).

• Carson, J.R. (1926). Electric Circuit Theory and the Operational Calculus. McGraw Hill.

• Churchill, R.V. (1958). Operational Mathematics. McGraw-Hill.

• Davis, H.T. (1936). The Theory of Linear Operators. Bloomington, IL: Principia Press – via Internet Archive (archive.org).

• Erdélyi, A. (2013) [1962]. Operational Calculus and Generalized Functions (reprint ed.). Dover. ISBN 978-0486497129.

• Jeffreys, H. (1927). Operational Methods in Mathematical Physics. Cambridge University Press. Archived from the original on 2011-07-19 – via www.new.dli.ernet.in.

• Jeffreys, H. (1927). Operational Methods in Mathematical Physics. Cambridge University Press – via Internet Archive (archive.org).

• Lützen, J. (1979). "Heaviside's operational calculus and attempts to rigorize it". Archive for History of Exact Sciences. 21 (2): 161–200. doi:10.1007/BF00330405. S2CID 118606242.

• Mc Lachlan, N.W. (1941). Modern Operational Calculus. MacMillan. Archived from the original on 19 July 2011 – via www.new.dli.ernet.in.

• March, H.W. (May–June 1927). "The Heaviside operational calculus". Bulletin of the American Mathematical Society. 33 (3): 311–318. doi:10.1090/S0002-9904-1927-04363-4 – via Project Euclid (projecteuclid.org).

"A correction". Bulletin of the American Mathematical Society. 33 (4): 492. July–August 1927. doi:10.1090/S0002-9904-1927-04412-3. Retrieved 7 December 2023 – via Project Euclid (projecteuclid.org).

• Mikusiński, J. (1960). Operational Calculus. Elsevier.

• Nahin, P.J. (1985). "Oliver Heaviside: Fractional operators, and the age of the Earth". IEEE Transactions on Education. E-28 (2): 94–104. Bibcode:1985ITEdu..28...94N. doi:10.1109/TE.1985.4321749. S2CID 7161941 – via IEEE Explore.

• Rota, G.C.; Kahaner, D.; Odlyzko, A. (1973). "On the foundations of combinatorial theory. VIII. Finite operator calculus". Journal of Mathematical Analysis and Applications. 42 (3): 684. doi:10.1016/0022-247X(73)90172-8.

• van der Pol, B.; Bremmer, H. (1950). Operational Calculus. Cambridge University Press.

• van der Pol, B. (1950). "Heaviside's operational calculus". Heaviside Centenary Volume. Institute of Electrical Engineers.

External links

• IV Lindell HEAVISIDE OPERATIONAL RULES APPLICABLE TO ELECTROMAGNETIC PROBLEMS
• Ron Doerfler Heaviside's Calculus
• Jack Crenshaw essay showing use of operators More On the Rosetta Stone