part I of an introduction to stochastic calculus
part II is n PDE/SDE mapping
part III on the Maxwell demon and the Ito-Stratanovitch controversy
part IV is on the Langevin equation
2. Luc_Faucheux_2020
What is this class, and what it is not
Β¨ Not a formal, so please interrupt if any question
Β¨ More of a pragmatic approach on how to approach stochastic calculus
Β¨ I have tried as much as possible to alert when there is something to be careful about
Β¨ I have also tried as much as possible to be as rigorous as possible, without getting lost in the
notations, or being too formal just for the sake of being formal
Β¨ Those notes are more βnotes of a practitionerβ, and by no means I would dare to hope to
substitute a robust course in stochastic calculus
Β¨ Those slides originated from a class I taught in 2018 at the hedge fund DRW to their first
year associate class, 40 students or so from various backgrounds. The class was a general
Fixed-Income class over 8 full days. It was intense, exhilarating, and kept me on my toes the
whole time
Β¨ Starting from the usual Ito lemma as in most textbooks (Hull), play with it for a while, then
start again from the proper formulation of the stochastic integrals
2
3. Luc_Faucheux_2020
How those slides came about
Β¨ Those slides originated from a class I taught in 2018 at the hedge fund DRW in the great city
of Chicago. I have modified them and added to them over the past couple of years.
Β¨ The class was composed of 40 students or so with various backgrounds, ranging from
computer science students with almost no background in Finance, to recent graduates of
Masters in Math, to some graduates of the prestigious MSCF (Master of Science in
Computational Finance) at Carnegie Melon University under the guidance of Steven Shreve,
to some who had almost no mathematical background in options, bond math, random
processes but had advanced degrees in Economy, so it was rather a tricky bunch
Β¨ The class was a general Fixed-Income class over 8 full days. It was intense, exhilarating, and
kept me on my toes the whole time. It pushed me to realize what I had not understood
about stochastic processes for 20 years or so, because I never bothered to ask the βwhat ifβ
questions and took a lot for granted out of sheer intellectual laziness
Β¨ The textbook we used was Hull so you will see pages reference to this book, as we used it in
class as a starting point to further explorations of the derivative pricing theory.
3
4. Luc_Faucheux_2020
How those slides came about - II
Β¨ It is often said that the only person who learns anything out of a class is the teacher.
Β¨ I hope that my DRW students got something out of it.
Β¨ But I know for a fact that without those two weeks in Chicago teaching, I would not have
gotten those slides off the ground, and most of the materials would still be in disparate
pieces of papers flying around my desk.
Β¨ Hopefully the end result is not complete garbage, at least I know that I greatly enjoyed
putting those together.
Β¨ So, even if the end result is not up to your standards, I am extremely grateful to DRW for
having given me the opportunity to teach the associate class that summer of 2018, and even
more so grateful to the students who during those two weeks, took me out of my comfort
zone, and forced me to confront what I knew and what I realized I was rather ignorant of.
Β¨ When you are teaching in front of a bunch of super smart people with different backgrounds
for 8 days straight, there is no hiding behind the curtain
Β¨ So thanks again to DRW and the 2018 associate class ! I miss you guys.
4
5. Luc_Faucheux_2020
How those slides came about - III
Β¨ Also for those of you who have spent more than 5 minutes with me, you will have noticed
that I bring the Ito-Stratonovitch controversy a lot.
Β¨ First of all that is sort of a hobby of mine, ever since my PhD thesis (Appendix B)
Β¨ Second, I have found it to be quite enlightening, because everyone takes Ito for granted, and
then you ask the question βwhat ifβ, and that forces you to make sure that your
understanding of Ito was solid. So I am using the example of Stratonovitch to really test the
fact that my understanding of ITO is solid
Β¨ Apologies on the Powerpoint format, there are battles with Microsoft that you cannot win
(including the fact that the Solver is a Macro and not a function, as opposed to some of the
earlier spreadsheets like Wingz)
Β¨ At times it might feel like going down the rabbit hole, or going up the river to meet Kurtz,
but (at least in my experience), I have found those discursions to be useful.
Β¨ So this is not really something great about Stratonovitch, it is using Stratonovitch to
convince ourselves that we understand ITO
5
6. Luc_Faucheux_2020
How those slides came about - IV
Β¨ Again quite frankly those notes are more for me (sorry)
Β¨ I had noticed that I had a number of handwritten notes flying around my desk, and when
needed at times I would just rederive from scratch rather then finding the right one.
Β¨ So this is trying to put in one place, in a format that I can copy/past easily, most of what I
had to go through and still use. I have tried (and failed at many places) to keep the notation
consistent
Β¨ Again, this is from a βpractitionerβ point of view, I have tried to be rigorous when I felt it was
needed, and be less so when I felt that this was a detail that was not needed and at times
would obscure the intuition.
Β¨ Notations are hard to keep consistent. I have also find at times that the right notation can
be illuminating, whereas the full explicit one can be cumbersome. So I have tried to adapt
the notation to what was needed to grasp the concept, and at times be more careful about
it to make sure that we do not fall into a trap.
Β¨ I guess Godel knew that, the right notation can change completely the proofβ¦.
6
7. Luc_Faucheux_2020
If you really want to master stochastic calculus.
Β¨ The uncontested bible in the field of stochastic calculus for Finance. Quite dense and
concise. It sometimes take me 40 pages to understand what Steven Shreve does in 2 lines.
7
8. Luc_Faucheux_2020
If you really want to master stochastic calculus - II
Β¨ An absolute wonderful short book. The notations at times are infuriating, but an absolute
must read
8
9. Luc_Faucheux_2020
If you really want to master stochastic calculus - III
Β¨ If you are like me coming from a Physics background, this book is still relevant today, a
testament to the genius of Van Kampen
9
10. Luc_Faucheux_2020
If you really want to master stochastic calculus - IV
Β¨ You cannot ignore this book. Every sentence carries meaning, and is worth reading time and
time again.
10
11. Luc_Faucheux_2020
If you really want to master stochastic calculus - V
Β¨ Another wonderful short book. The logic is clear, concise and beautiful. The exercises are
worth going through. From one of the most respected options traders in the field. He also
has quite a ferocious appetite for chocolate cakes.
11
12. Luc_Faucheux_2020
If you really want to master stochastic calculus - VI
Β¨ Quite applied. The appendix on SDEs is rather beautiful, and follows Mikosch. Great for
practical applications in the field of Fixed-Income
12
13. Luc_Faucheux_2020
If you really want to master stochastic calculus - VII
Β¨ What not to say about this book? An absolute gem. The 1900 Ph.D. thesis of Louis
Bachelier (in French!) with an amazing translation by Davis and Etheridge, and some great
chapters about the history of modern finance. Bachelier did it all, 80 years or so before
everyone else
13
14. Luc_Faucheux_2020
If you really want to master stochastic calculus - VIII
Β¨ I could not but not add this one here. It is a movie about the life of Vincent (Wolfgang)
Doblin (Doebling) who essentially discovered Ito calculus at least 5 to 10 years before Ito in
circumstances so incredible that they made a movie out of his life. Ito lemma and calculus is
now usually referred to as Ito-Doblin lemma and calculus in recognition of Vincentβs
incredible accomplishments
14
15. Luc_Faucheux_2020
If you really want to master stochastic calculus - IX
Β¨ Amazing book if you are coming from a Physics background
15
16. Luc_Faucheux_2020
If you really want to master stochastic calculus - X
Β¨ Found this book as I was almost finished with those slides, and thought about throwing
them away, because this book has pretty much anything you want. Pretty heavy on the
operators formalism, which is quite elegant once you get used to it, but that it a step that
you need to go through
16
17. Luc_Faucheux_2020
What is so hard about Stochastic Calculus?
Β¨ It is quite recent
Β¨ It is quite cumbersome
Β¨ It is not intuitive
Β¨ It is incomplete
Β¨ No one really knows how to do it.
Β¨ This presentation is trying to strike a balance between being practical and being rigorous, so
apologies for the many terms in ββ, whereas a rigorous math class will define what terms like
βstableβ or βgot to 0β or βgo to infinityβ or βconvergeβ much more exactly. What we will say
is βalmostβ rigorous and works in practice 99% of the time
Β¨ This is more of a practitionerβs point of view on how to use (or not) stochastic calculus, as it
relates to finance and Physics
17
18. Luc_Faucheux_2020
Stochastic Calculus is quite recent
Β¨ Geometry ~ -6,000 BC (navigating looking at the stars, buildings, ships,β¦)
Β¨ Fractions (music with scale, buildings,,)
Β¨ Probabilities (~1,600 AD), Pascal triangle, combinatory analysis
Β¨ Calculus (Newton, Leibniz, finite differences) (~1,600 AD) (we started shooting canons long
range, Electricity, magnets, how do they work? The ICP is still asking)
Β¨ Taylor Expansion (1720)
Β¨ Brown (1890), Wiener (1940), Bachelier (1900), Einstein (1905),Langevin (1908),
Doblin(1940), Ito (1950), Feynman-Kac (1950), Stratonovitch (1966), Black-Sholes (1972)
Β¨ So letβs go a little easy on ourselves, shall we?
Β¨ Quantum Stochastic Calculus (1980), random processes (diffusion) in fractal geometries
18
19. Luc_Faucheux_2020
Stochastic calculus is a French thing (except Gauss)
Β¨ Black-Sholes might have gotten a Nobel prize in 1972, but Louis Bachelier did it all in his
Ph.D. thesis in 1900 (almost)
Β¨ Ito might have been known until recently for the Ito calculus and Ito lemma, but Vincent
Doelin wrote it all while on the Ardennes front in World War I. This is now being recognized
and some textbooks use the term βIto-Doeblinβ instead of βItoβ
Β¨ Paul Langevin also essentially wrote the textbook on SDEs
Β¨ And for the math, all you need is Laplace, Fourier, Cauchy
Β¨ Taylor expansion is the only non-French, but it is essentially LβHospital rule, so
againβ¦Frenchβ¦
Β¨ Note: LβHopital rule is very powerful and often overlooked.
Β¨ If two functions π(π₯) and π(π₯) and are differentiable, and lim
!β#
[
$%(!)
(%(!)
] exists, then
Β¨ lim
!β#
[
$(!)
((!)
] = lim
!β#
[
$%(!)
(%(!)
]
19
20. Luc_Faucheux_2020
The Ph.D. thesis of Louis Bachelier
Β¨ Reading the original thesis (both in French if you can and the excellent translation by Mark
Davis and Alison Etheridge) is humbling.
Β¨ Without a strong well-developed theory of stochastic calculus (Ito lemma) that only came
about in the 1960s or so
Β¨ Without a strong theoretical footing of what is a numeraire and how to price a derivative in
the risk-neutral probability associated to that numeraire (Pliska 1980 or so)
Β¨ Without yet the strong connection between PDE (Partial Differential Equations) and SDE
(Stochastic Differential Equations) that really came about from the Feynman-Kac formula
(1950 roughly)
Β¨ Louis Bachelier managed to not only built a theory of option pricing that is nowadays
coming back in fashion with a vengeance, but perusing through the rather short thesis, one
cannot but be amazed at the breadth of his genius, but also at his attention to details.
Bachelier at times go through numerical examples with the same precision and clarity of
thoughts that he displays in the other more theoretical parts of his thesis.
20
21. Luc_Faucheux_2020
Stochastic Calculus is not intuitive
Β¨ Regular calculus has usually to do with βthings that are around some other thingsβ
Β¨ Taylor expansion and derivatives (expansion around a value, local derivatives at or around a
point)
Β¨ Finite difference for integrating functions on an axis or a path (keep following the path in a
continuous fashion)
Β¨ Stochastic Calculus tries to address the problem of dealing with βthings around things that
are not thereβ. What do I mean ?
Β¨ Take the coin flipping problem (Head is +1, Tail is -1). The coin is either head or tail (+1 or -
1), never anything else. And yet we will try to calculate expansions, derivations, integrations
of functions around the mean or average (0), which is NOT a possible state of the coin.
Β¨ Without stating the obvious or oversimplifying, this is the crux of the problem with
stochastic calculus, and also that we are so used to usual calculus that we take a lot of things
for granted
21
22. Luc_Faucheux_2020
Stochastic processes are βnon-differentiableβ
Β¨ A stochastic process essentially βflips a coinβ at each point in time.
Β¨ A βregularβ process, meaning it is differentiable, would have a unique tangent for every
point in time. If π π‘ is differentiable, there is a unique
)*(+)
)+
Β¨ The stochastic process does NOT have a unique tangent, because, using the coin flip idea,
and being somewhat liberal with scaling, at each point in time, π π‘ goes to either {π π‘ +
πΏπ} or {π π‘ β πΏπ} with some probability (50% in the simplest case, or driftless case).
Β¨ The tangent is NOT the average (0) of the two possible tangents.
Β¨ So in essence for a stochastic process, writing something like
)*(+)
)+
is meaningless
Β¨ In stochastic processes, the only real thing that we can do is integrals, almost never
differential calculus (not surprising as it is not differentiable)
Β¨ NOTE that non-differentiable does NOT mean not smooth or not continuous
22
23. Luc_Faucheux_2020
Stochastic calculus is usually self-similar
Β¨ We will go over this in more details, but essentially the simplest stochastic process is the
Wiener process or also called the standard Brownian motion. We will start with it
Β¨ π π‘ has a normal π(0, π‘) distribution function
Β¨ π π‘ β π has obviously the same normal π(0, π‘ β π ) distribution function
Β¨ {π π‘ β π(π )} has ALSO the same π(0, π‘ β π ) distribution
Β¨ Note that they are NOT the same, writing π π‘ β π π = π(π‘ β π ) is obviously wrong
but you will find sometimes the notation:
Β¨ π π‘ β π π β π(π‘ β π ), meaning distributional identity, NOT pathwise identity
Β¨ The simple Brownian motion is self-similar with coefficient (1/2)
Β¨ π, π π‘- , π, π π‘. , . . , π, π π‘/ β π ππ‘- , π ππ‘. , . . , π ππ‘/ , with π» = 1/2
Β¨ This is sometimes used to numerically construct Brownian motion.
Β¨ If you βscaleβ up the time scale by a factor π, the space scale gets only magnified by a factor
π.
23
24. Luc_Faucheux_2020
Stochastic Calculus is cumbersome
Β¨ Usual knowledge and tricks of calculus do not apply anymore
Β¨ Chain rule does not work
Β¨ Functional derivation does not work : π πππ β ( βππ π) !
Β¨ Integration and especially derivations are not well defined
Β¨ Usual calculus π(π‘), when (πΏπ‘) β0, (πΏπ)~πΏπ‘, (πΏπ).~(πΏπ‘).
Β¨ Stochastic calculus we still have (πΏπ) β 0, BUT WE ALSO HAVE (πΏπ).~πΏπ‘ so higher orders
are mixed together
Β¨ Coin toss (+1, -1). Average is 0, variance scales linearly with the number of flips
Β¨ Can you think of processes where variance goes to 0 and we need to go to the next order?
Β¨ Can you think of a process where (πΏπ). scales maybe as (πΏπ‘)0, where π < 1 ?
Β¨ Also, if you think about it, when πΏπis stochastic, somehow (πΏπ). is now deterministic, or
at least has a deterministic component, the inverse is NOT true
24
25. Luc_Faucheux_2020
Always better to integrate than to differentiate
Β¨ If we have a stochastic process π(π‘), we would like to work with functions π(π) (please
note that those functions are usually well behaved, meaning differentiable and such,
without going into too much math)
Β¨ π(π) is differentiable in π
Β¨ π(π‘) is NOT differentiable in π‘
Β¨ But we are really dealing with π(π π‘ ) so we would like to write things like
Β¨ πΏπ =
)$
)1
.
)1
)+
. πΏπ‘ which is one way to write the traditional βchain ruleβ
Β¨ In integral form, the chain rule would read something like:
Β¨ π π π‘ β π π 0 = β«234
23+ )$
)1
.
)1
)2
. ππ
Β¨ The crux of the issue in stochastic calculus is that we do not know what
)1
)2
means, and so
we should NOT expect to be able to rely on the usual chain rule
25
26. Luc_Faucheux_2020
The whole Ito-Stratanovitch thing
Β¨ Essentially, ITO breakthrough was to find a way to define:
Β¨ π π π‘ β π π 0 = β«234
23+ )$
)1
.
)1
)2
. ππ = β«234
23+ )$
)1
. ππ
Β¨ ITO invented the field of stochastic integrals
Β¨ The essence of it is that ππ(π‘) is a βjumpβ
Β¨ ITO (1950) defines the ITO integral as a limit of a sum where the value of
)$
)1
is taken βbefore
the jumpβ. A consequence of this convention is that the usual rules of calculus (chain rule,
Leibniz rule,..) do not apply. For example π πππ β ( βππ π) ! On the other hand the ITO
integral has the nice property to be a martingale (zero expected value)
Β¨ Stratanovitch (STRATO) defines the STRATO integral as a limit of a sum where the value of
)$
)1
is taken βin the middle of the jumpβ. A rather intriguing consequence is that in STRATO
calculus the usual rules of calculus are (formally!) respected. π πππ = ( βππ π). HOWEVER
the STRATO integral is NOT a martingale.
26
27. Luc_Faucheux_2020
The whole Ito-Stratanovitch thing - II
Β¨ So we will see how to not get confused between the two equally valid interpretations of the
integrals (from a really theoretical point of view mathematicians prefer ITO because it is
defined over a wider range of functions than STRATO, but really nothing we should concern
ourselves at this point).
Β¨ This will take us some time, first going over the Riemann integral in regular calculus
Β¨ Then defining the ITO
Β¨ Then looking at the relationship between ITO and STRATO integral
Β¨ Then explicitly proving the ITO lemma, then the equivalent STRATO lemma
Β¨ From then we look at the SDE (SIE), and we try to map the relations between a specific SDE
and its associated PDE for the PDF
Β¨ SDE: Stochastic Differential Equation
Β¨ SIE: Stochastic Integral Equation
Β¨ PDE: Partial Differential Equation (that is usual regular calculus, but not easy by any means)
Β¨ PDF: Probability Density Function
27
28. Luc_Faucheux_2020
The whole Ito-Stratanovitch thing - III
Β¨ So apologies in advance if those slides feel pedestrian at time, but unfortunately in order to
be somewhat rigorous without losing the intuition, and in order to convince ourselves that
we are on somewhat firm ground to justify what we write (without having a 100% rigorous
mathematical proof), we have to walk before we run.
Β¨ Alternatively, you could be a genius like Vincent Doelin and bypass the entire theory of
stochastic integrals and express everything as a Brownian time change, 40 years or so before
everyone else, while fighting WWII in the Ardennes as a radio operator.
Β¨ If I have time, part V of those decks will be on that
Β¨ Also the ITO-STRATO controversy in the 1990s was linked to the concept of thermal ratchets,
Brownian motors, biological motors, hence quite a few articles on the subject.
Β¨ This is also linked to an individual that physicists refer to as the Maxwellβs demon
Β¨ In deck III we will revisit this unsavory character, who prompted me spending a lot of time
on ITO-STRATO over my life and as a PhD student.
28
31. Luc_Faucheux_2020
The whole Ito-Stratanovitch thing - VI
Β¨ There are actually applications in Finance of the Maxell demon, known as the Parrondo
paradox.
Β¨ Two trading strategies (PM at a hedge fund) on average lose money (B and C, blue and green
line)
Β¨ However you can alternate between the two strategies to create one (A-red line) that on
average will be profitable, like the thermal ratchet who is extracting work out of thermal
noise, this Parrondo construct extract positive return out of random switches between two
losing strategies
31
32. Luc_Faucheux_2020
Just a taste of how powerful Vincent Doelin was
Β¨ SDE have usually the form:
Β¨ ππ π‘ = π π π‘ , π‘ . ππ‘ + π π π‘ , π‘ . ππ, which really should always be written as SIE:
Β¨ π π‘5 β π π‘6 = β«+3+6
+3+5
ππ π‘ = β«+3+6
+3+5
π π π‘ , π‘ . ππ‘) + β«+3+6
+3+5
π π π‘ , π‘ . ππ(π‘)
Β¨ The whole theory of ITO is trying to define what exactly is : β«+3+6
+3+5
π π π‘ , π‘ . ππ(π‘)
Β¨ What Doelin did essentially was to say: hey I do not need to define this integral, which is
subject to the exact convention of βwhere to take the value of π π π‘ , π‘ before, during or
after the jump ππ(π‘)β, and run into all sort of Ito-Stratanovitch confusion, because I am a
genius, whatever that integral is, it is equal to :
Β¨ β«+3+6
+3+5
π π π‘ , π‘ . ππ(π‘) β π(β«+3+6
+3+5
π π π‘ , π‘ .. ππ‘) which is perfectly well defined.
Β¨ Boom. Microphone drop.
Β¨ And by the way he burnt most of his research before killing himself to avoid capture by the
Germans, so who knows what else he had discoveredβ¦.
32
34. Luc_Faucheux_2020
Ito-Doblin and stochastic calculus is..
Β¨ βFirst and foremost defined as an integral calculusβ
Β¨ Really the only thing that works is integrating stochastic processes.
Β¨ There are theories of differentiations for stochastic variables
Β¨ Malliavin calculus (1980)
Β¨ One day I will try to understand what that actually means. I still have no idea. But I should
try after all Malliavin is also French
Β¨ So even the Ito lemma as we know it is really better expressed in integral form
Β¨ However most textbooks do present it in βdifferentialβ form like a Taylor expansion, or even
deal with SDE quite liberally. This is sometimes for ease of notations and we will fall into
that pattern also. Note that this is a FORMAL equivalence to regular calculus equations like
Taylor expansion. Taking those literally leads to mistakes, as we will demonstrate
34
35. Luc_Faucheux_2020
Why are PDEs so important, and why SDEs are terrifying
Β¨ PDEs are Partial Differential Equations
)!7(!,+)
)!! =
)7(!,+)
)+
Β¨ Usually in the context of stochastic calculus they will appear for the PDF (Probability Density
Function) of the stochastic variable π (like a Gaussian), π(π₯, π‘) or for functions of that
variable (call payoff or πΆ(π, π, πΎ, π) for example)
Β¨ PDEs are well defined and well known (since 1700), tons of knowledge on how to deal with
those (Navier-Stokes in fluid mechanic, Maxwell equations in electro-magnetism, Fokker-
Planck, Feynman-Kac,..)
Β¨ Once you know the PDE, you know ALL the moments of the distribution in the case of a PDE
Β¨ PDEs are complete, SDEs are incomplete
Β¨ SDEs are Stochastic Differential equations ππ = π. π. ππ‘ + π. π. ππ
Β¨ No one really knows how to deal with them, especially if the volatility is a function of the
stochastic variable (and it always is, or when you look at functions of X)
Β¨ But sometimes you can get rid of a SDE and use a related PDE (that was the trick that Black
Sholes discovered and got a Nobel prize for), or Dupire equation
Β¨ Also stay away from SDE, always look for the PDE
35
36. Luc_Faucheux_2020
The structure of those slides
Β¨ We will first start with the usual textbook (Hull) that presents essentially what are Ito SDEs
and Ito lemma being a regular Taylor expansion just making sure that we go high enough to
keep all the terms linear in time and linear in the stochastic driver
Β¨ So in some ways, in the usual calculus π(π‘), when (πΏπ‘) β0, (πΏπ)~πΏπ‘, (πΏπ).~(πΏπ).
Β¨ Stochastic calculus we still have (πΏπ) β 0, BUT WE ALSO HAVE (πΏπ).~πΏπ‘ so higher orders
are mixed together, but if we keep the right terms we should be fine
Β¨ This is usually where most textbooks in finance stops
Β¨ We will show by using something called Stratonovitch convention, that treating the SDEs and
the Taylor expansion the way we would do in regular calculus is wrong.
Β¨ In fact the Ito lemma and the Ito SDEs are just a formal manner to write Integrals and SIE,
which is really the only thing that you can do in stochastic calculus
Β¨ Remember, you always read that a stochastic process is NOT differentiable, yet somehow we
all proceed happy to write Stochastic DIFFERENTIAL Equations, and writing Ito lemma as a
Taylor expansion, without really thinking twice about it
36
37. Luc_Faucheux_2020
The structure of those slides - II - Integrals
Β¨ We then take a couple of steps back and go over a review of the regular integrals (Riemann)
in the regular calculus
Β¨ We extend this to the realm of stochastic calculus
Β¨ We show that unlike the regular case, the point taken in the partition buckets (the mesh)
actually matters. One convention is to take the starting point (ITO). Another one is to take
the middle point (Stratonovitch)
Β¨ We then derive the relationships between the Ito and the Strato integral
Β¨ At this point there is no finance theory but it will be worth keeping in mind that the Ito
integral will have the property of being a martingale (zero expected value)
Β¨ Note that things like βpartitionβ or βmeshβ will not be super rigorously defined, but we leave
that to mathematicians, we use those concepts assuming that they are well defined, and we
can check that indeed they are over a certain range of βnon-pathologicalβ functions or
geometries
37
38. Luc_Faucheux_2020
The structure of those slides - III - Lemma
Β¨ From what we learned from looking at those integrals, we then look at the issue around
making some operations on those integrals. This is where we look at Ito lemma
Β¨ Ito lemma is crucial in finance
Β¨ We will see that formally we can write the lemma, and perform operations on functions and
integral, in a formal manner that looks like regular calculus, with the exceptions that you
have to go βone more upβ in any kind of derivations or Taylor expansion, in order to capture
ALL the terms linear in time and linear in the stochastic driver
Β¨ In doing so the βusualβ rules of calculus (derivations, integrations, Leibniz,..) are no longer
true in stochastic calculus using the Ito interpretation of the integral
Β¨ We will compare this with the Strato integral
Β¨ We will show that the βusualβ rules of calculus are still formally present in Strato calculus
(remember this is a formal analogy). This can be useful when explicitly solving equations
Β¨ We then show the relationship between the Ito and the Strato lemma
38
39. Luc_Faucheux_2020
The structure of those slides - IV - SDE
Β¨ From what we learned looking at the integrals and how to manipulate them, we can try to
look at what would be SDE, Stochastic Differential Equations
Β¨ Remember though, that just the same way we can formally write Ito and Strato lemma in
βdifferentialβ form for ease of notation, those are ALWAYS simpler way to write down what
would really be equations dealing with integrals
Β¨ In stochastic calculus, I do not know what a differentiation would actually mean
Β¨ All I can do really is to integrate
Β¨ Like the integral and the lemma, we will show the relationship between the Ito SDE and the
Strato SDE (or really more exactly the Ito SIE and the Strato SIE), and introduce the so-called
βdriftβ between the two representations
Β¨ SIE: Stochastic Integral Equations
39
40. Luc_Faucheux_2020
The structure of those slides - V - PDE
Β¨ From the SIE, we then explore the correspondence between the SIE and the PDE (Partial
Differential Equation) for the PDF (Probability Distribution Function) of the stochastic
variable.
Β¨ PDE are just part of the regular calculus, there is no issue there
Β¨ SIE and SDE depends on the interpretation (Ito or Strato).
Β¨ We will then by extension look at PDE that would correspond to a specific SDE under Ito,
and similarly under Strato.
Β¨ This is where it can get a little confusing (or even more confusing that it already is)
Β¨ We will revisit our old friend the Maxwell demon and see why it was so confusing in the
1990s when applied to biological concepts of thermal ratchets or Brownian motors
Β¨ Because a PDE is βexactβ (once you know the PDE, and if you can solve it you have the PDF,
so you have exactly all the moments of the stochastic variable) whereas an SDE only has the
first two moments in most cases, and is also subject to interpretation, it is worth keeping in
mind that fact: a PDE is not subject to interpretation. An SDE is subject to interpretation,
and needs to be treated with great caution
40
41. Luc_Faucheux_2020
The structure of those slides - VI - PDE
Β¨ We will look at some cases of PDEs from the world of Physics in order to gain some more
intuition on what is a firm ground to stand on (PDE), and a somewhat more recent and still a
little shaky one (SDE)
Β¨ This will be a somewhat indirect introduction to a fundamental theorem that links the world
of βregularβ well known calculus of PDE (400 years in the making) with the more recent one
having to do with probability and stochastic calculus (only 100 years in the making), and still
very new.
Β¨ This year Abel prize was given to pioneers of the ergodic theory, that essentially to crudely
oversimplify, try to find the solutions of PDEs by using properties of the associated SDEs
Β¨ We can then go back to Black-Sholes with a renewed belief in how justified we are in our
derivation, in particular we tried to βget awayβ using simple Taylor expansions and just
keeping some higher orders, we showed however how wrong it can get very quickly.
41
42. Luc_Faucheux_2020
Β¨ Since we will first fall into the trap of treating an SDE the way we would do usual calculus, a
number of slides in this deck are WRONG. It is sometimes more useful to learn from
mistakes than to follow a magistral correct demonstration.
Β¨ So in order to not make the whole deck a complete garbage of my random wrong ramblings
on stochastic calculus while going up the river to meet colonel Kurtz, I have put a stamp
βWRONGβ across those slides.
Β¨ So do not read those slides at face value, but know that those are WRONG.
Β¨ It might be an interesting exercise for you to convince yourself why those slides are wrong.
Β¨ Again, I left them there because I think it is quite instructive to identify the fault in a
derivation.
Β¨ We could have kept all the slides in ITO calculus, but it is quite enlightening to also look at
STRATANOVITCH calculus, if only to convince ourselves that we really understand ITO (If we
understand the difference between two things, then most likely that increases our
knowledge about each of those things)
A note of caution
42
43. Luc_Faucheux_2020
Why this whole thing about Ito calculus? Hull textbook
Β¨ Hull β White chapters 13, 14 and 15
Β¨ People got excited about stock prices trading as a percentage (people expect a βreturnβ),
p.306, and so what mattered was the return of the stock π, or ββπ π
Β¨ So then they started writing things like : ππ = π. π. ππ‘ + π. π. ππ, (p.307)
Β¨ And then they got stuck, because ππ₯ = π π₯, π‘ . ππ‘ + π π₯, π‘ . ππ, where π π₯, π‘ is a function
of the stochastic variable π₯, is not something we know how to deal with (p.306, and no, it is
NOT a βsmall approximationβ as they claim)
Β¨ So you need to use a βguessβ on how to deal with π π₯, π‘ , which is why it is called a βlemmaβ
Β¨ Ito (1951) guessed that you can write ππ₯ = π π₯, π‘ . ππ‘ + π π₯, π‘ . ππ
as βπ₯ = π π₯, π‘ . βπ‘ + π π₯, π‘ . βπ
or Ξ΄π₯ = π π₯, π‘ . πΏπ‘ + π π₯, π‘ . πΏπ
Β¨ That seems like a good guess but then the rules of calculus are no longer applicable, you can
barely derive without making a mistake, and forget about trying to integrate (p. 311)
Β¨ Now you get this weird thing where π πππ = ( βππ π) β ( βπ. 2). ππ‘, (p.312)
43
44. Luc_Faucheux_2020
Why chose Ito then?
44
Β¨ Someone else made a βbetterβ guess, Stratonovitch (1966)
Β¨ Strato guessed that you can write ππ₯ = π π₯, π‘ . ππ‘ + π π₯, π‘ . ππ
as βπ₯ = π π₯, π‘ . βπ‘ + π π₯ + Ξπ₯/2, π‘ . βπ
or Ξ΄π₯ = π π₯, π‘ . πΏπ‘ + π π₯ + πΏπ₯/2, π‘ . πΏπ
Β¨ Within Stratoβs convention, the usual rules of calculus FORMALLY apply π πππ = ( βππ π),
and the chain rule is verified in the usual manner
Β¨ So this is super confusing
Β¨ We will look at both Ito and Strato, and understand how to go from the SDE (Stochastic
Differential Equation) to the PDE (Partial Differential Equation) and the correct PDF
(Probability Density Function).
Β¨ We will go over the binomial trees and binomial distribution, and its limit the Gaussian
distribution (HW chapter 13, p.296-299)
Β¨ We will show why the Gaussian distribution is so common and so central to everything
(central limit theorem)
45. Luc_Faucheux_2020
Actually it is not called Ito, but Ito-Doeblin
Β¨ It was discovered quite recently (2000) that Vincent Doeblin, born Wolfgang Doeblin, Ph.D.
at 23, and drafted in the French army in 1938, while posted in the Ardennes as a phone
operator, essentially worked out Ito calculus on his own and sent his results to the Academie
des Sciences βsous plis scelleβ.
Β¨ He shot himself after burning the rest of his notes when the German army was about to
advance and take over his positions
Β¨ So wo knows what else was in his notes? Malliavin calculus maybe ?
45
46. Luc_Faucheux_2020
Ito and Stratonovitch βTaylorβ expansion
Β¨ Ito (1951) guessed that you can write ππ₯ = π π₯, π‘ . ππ‘ + π π₯, π‘ . ππ
as Ξ΄π₯ = π π₯, π‘ . πΏπ‘ + π π₯, π‘ . πΏπ
Β¨ If πΉ(π₯) a function of x, the corresponding SDE as a result of Taylor expansion in ITO is:
Β¨ πΏπΉ =
)9
)!
. πΏπ₯ +
-
.
.
)!9
)!! . π.. πΏπ‘
Β¨ That is the celebrated Ito lemma, or how the chain rule gets modified in Ito stochastic
calculus
Β¨ Strato guessed that you can write ππ₯ = π π₯, π‘ . ππ‘ + π π₯, π‘ . ππ
as Ξ΄π₯ = π π₯, π‘ . πΏπ‘ + π π₯ + πΏπ₯/2, π‘ . πΏπ
Β¨ So you think that you could write something like this: the SDE for πΉ(π₯) in Stratonovitch
convention is:
Β¨ πΏπΉ =
)9
)!
. πΏπ₯ +
-
.
.
)!9
)!! . π.. πΏπ‘ +
-
.
.
)9
)!
.
)5
)!
. π. πΏπ‘
46
47. Luc_Faucheux_2020
Ito and Stratonovitch βTaylorβ expansion - II
Β¨ We would like to write something like this for Stratonovitch, following the rule of expanding
to the second order and keeping the terms linear in time and linear in the stochastic driver
(so essentially in a way use Ito calculus in the Stratonovitch convention)
Β¨ Bear in mind that this is absolutely wrong
Β¨ It is quite insightful to go through it though and see where it is wrong
Β¨ So we have a function πΉ of the stochastic variable π₯, the function πΉ in itself is nothing weird,
it is a regular function that we assume to be differentiable πΉ(π₯)
Β¨ Ito calculus tells us that if we want to look at the variations of that function in terms of the
stochastic variable π₯, assuming a process ππ₯ = π π₯, π‘ . ππ‘ + π π₯, π‘ . ππ
Β¨ You can formally write within Ito calculus: Ξ΄π₯ = π π₯, π‘ . πΏπ‘ + π π₯, π‘ . πΏπ
Β¨ πΏπΉ =
)9
)!
. πΏπ₯ +
-
.
.
)!9
)!! . π.. πΏπ‘
47
48. Luc_Faucheux_2020
Ito and Stratonovitch βTaylorβ expansion - III
Β¨ More exactly
Β¨ πΏπΉ =
)9
)!
. πΏπ₯ +
-
.
.
)!9
)!! . πΏπ₯.
Β¨ And : Ξ΄π₯ = π π₯, π‘ . πΏπ‘ + π π₯, π‘ . πΏπ
Β¨ So keeping the terms linear in time and in the stochastic driver
Β¨ πΏπ₯. = π.. πΏπ‘
Β¨ And we get the usual Ito formula: πΏπΉ =
)9
)!
. πΏπ₯ +
-
.
.
)!9
)!! . π.. πΏπ‘
Β¨ The βcanonicalβ example is usually πΉ π₯ = πΏπ(π₯), with
)9
)!
=
-
!
, and
)!9
)!! =
:-
!!, and with
the stochastic process: Ξ΄π₯ = π₯. πΏπ, so π = π₯, and π. = π₯.
Β¨ And so we get: πΏ πΏπ π₯ =
-
!
. πΏπ₯ +
-
.
.
:-
!! . π.. πΏπ‘ =
-
!
. π₯. πΏπ +
-
.
.
:-
!! . π₯.. πΏπ‘
48
49. Luc_Faucheux_2020
Ito and Stratonovitch βTaylorβ expansion - IV
Β¨ Or again:
Β¨ πΏ πΏπ π₯ = πΏπ§ β
-
.
. πΏπ‘ =
;!
!
β
-
.
. πΏπ‘
Β¨ Whereas the βusual rule of calculus would read : πΏ πΏπ π₯ =
;!
!
Β¨ That is the usual example in most textbooks, especially in Finance
Β¨ NOW comes the weird little Stratanovitch trick, where we assume that we can write
something like :
Β¨ Strato guessed that you can write ππ₯ = π π₯, π‘ . ππ‘ + π π₯, π‘ . ππ
as Ξ΄π₯ = π π₯, π‘ . πΏπ‘ + π π₯ + πΏπ₯/2, π‘ . πΏπ
Β¨ So again we follow the βItoβ rule of calculus by expanding in linear terms in time and in the
stochastic driver
49
50. Luc_Faucheux_2020
Ito and Stratonovitch βTaylorβ expansion - V
Β¨ πΏπΉ =
)9
)!
. πΏπ₯ +
-
.
.
)!9
)!! . πΏπ₯.
Β¨ And : Ξ΄π₯ = π π₯, π‘ . πΏπ‘ + π π₯ + πΏπ₯/2, π‘ . πΏπ
Β¨ Or: Ξ΄π₯ = π π₯, π‘ . πΏπ‘ + π π₯, π‘ . πΏπ +
;!
.
.
)5
)!
. πΏπ, which keeping only the terms linear in time
and in the stochastic driver πΏπ, leads to:
Β¨ Ξ΄π₯ = π π₯, π‘ . πΏπ‘ + π π₯, π‘ . πΏπ +
-
.
.
)5
)!
. π. πΏπ‘
Β¨ And so: πΏπΉ =
)9
)!
. πΏπ₯ +
-
.
.
)!9
)!! . πΏπ₯.
Β¨ πΏπΉ =
)9
)!
. πΏπ₯ +
-
.
.
)!9
)!! . π.. πΏπ‘ +
-
.
.
)9
)!
.
)5
)!
. π. πΏπ‘
50
51. Luc_Faucheux_2020
Ito and Stratonovitch βTaylorβ expansion - VI
Β¨ So we think that within the Ito rules of calculus (doing a Taylor expansion and keeping only
the terms linear in time and the stochastic driver) but following the Stratonovitch
convention we can write something like:
Β¨ πΏπΉ =
)9
)!
. πΏπ₯ +
-
.
.
)!9
)!! . π.. πΏπ‘ +
-
.
.
)9
)!
.
)5
)!
. π. πΏπ‘
Β¨ The βcanonicalβ example again is πΉ π₯ = πΏπ(π₯), with
)9
)!
=
-
!
, and
)!9
)!! =
:-
!!, and with the
stochastic process: Ξ΄π₯ = π₯. πΏπ, so π = π₯, and π. = π₯., and
)5
)!
= 1
Β¨ So we get:
Β¨ πΏ πΏπ π₯ =
-
!
. πΏπ₯ β
-
.
.
-
!! . πΏπ‘ +
-
.
.
-
!
. 1. π₯. πΏπ‘
Β¨ The last two terms cancel out and we get: πΏ πΏπ π₯ =
-
!
. πΏπ₯
Β¨ Which is the usual result in βregularβ (non stochastic) calculus, and we think that we now
understood stochastic calculus because textbooks are telling us that the usual rules of
calculus are preserved in Strato
51
52. Luc_Faucheux_2020
Ito and Stratonovitch βTaylorβ expansion - VII
Β¨ So far we seem to be pretty happy because we found that for the canonical example, the
βusual rules of calculusβ are preserved when using the Stratonovitch convention within the
Ito calculus (meaning that we are using formally a Taylor expansion, making sure to keep all
the terms linear in time and in the stochastic driver, i.e. the Ito rule of calculus, but assuming
that we are taking the βmid-pointβ of the jump for functions multiplying this jump, i.e. what
we think to be what the Stratonovitch convention is)
Β¨ We will show that nothing could be more wrong
Β¨ Both Ito and Stratonovitch are calculus on their own on the same footing
Β¨ We just cannot do the Taylor expansion within the Stratonovitch framework
Β¨ Not super obvious, took me a long time to be confused about it, the point is to always go
back to the fact that in stochastic calculus the only thing that you can write is an integral,
and sometimes for ease of notation we write something that looks like a Taylor expansion or
and SDE. But this is only a formal way of writing, and the fact that it looks like regular
calculus does NOT allow us to use those equations βas isβ
52
53. Luc_Faucheux_2020
Ito and Stratonovitch βTaylorβ expansion β VII - a
Β¨ So for example, when in Ito calculus we write the chain rule as:
Β¨ πΏπΉ =
)9
)1
. πΏπ +
-
.
.
)!9
)1! . πΏπ.
Β¨ What we are really writing, (and what we should always write from time to remind us, since
we do not have enough paper and ink to write it all the time at every step) is:
Β¨ π π π‘5 β π π π‘6 = β«+3+6
+3+5 )$
)*
. ([). ππ(π‘) +
-
.
β«+3+6
+3+5 )!9
)1! (π π‘ ). ππ‘
Β¨ In the βlimitβ of small time increments, this can be written formally as the Ito lemma:
Β¨ πΏπ =
)$
)*
. πΏπ +
-
.
.
)!9
)1! . πΏπ‘
Β¨ We will go over it once we rebuild our knowledge of stochastic calculus around the integral
Β¨ Here we are following mostly Thomas Mikosch βElementary Stochastic Calculus with Finance
in Viewβ, a wonderful little book that is at times frustrating for some of the weird notations
that he uses.
53
54. Luc_Faucheux_2020
Ito and Stratonovitch βTaylorβ expansion - VIII
Β¨ A very quick manner to realize how wrong we are is to use another example:
Β¨ ππ₯ = π π₯, π‘ . ππ‘ + π π₯, π‘ . ππ
Β¨ with π π₯, π‘ = Ο. π₯ ,
)5
)!
= π , π. = π.. π₯. and π π₯, π‘ = 0,
Β¨ πΉ π₯ = π₯.,
)9
)!
= 2π₯ ,
)!9
)!! = 2
Β¨ Using ITO, πΏπΉ =
)9
)!
. πΏπ₯ +
-
.
.
)!9
)!! . π.. πΏπ‘ = 2π₯. πΏπ₯ + π.. πΏπ‘
Β¨ Using Strato, πΏπΉ =
)9
)!
. πΏπ₯ +
-
.
.
)!9
)!! . π.. πΏπ‘ +
-
.
.
)9
)!
.
)5
)!
. π. πΏπ‘
Β¨ We then get: πΏπΉ = 2π₯. πΏπ₯ + π.. πΏπ‘ +
-
.
. 2π₯. Ο. Ο. π₯. πΏπ‘ = 2π₯. πΏπ₯ + 2.π.. πΏπ‘
Β¨ So neither what we call Ito and what we call Strato do follow the usual rule of calculus. That
should be a sign that we did something very wrong when we loosely used the Taylor
expansion and applied it to the Stratonovitch case, because textbooks are telling us that the
usual rules of calculus (chain rule) are βpreservedβ (similar in form) in Strato
54
55. Luc_Faucheux_2020
Ito and Stratonovitch βTaylorβ expansion - IX
Β¨ The answer is not completely obvious in identifying what we did wrong
Β¨ Conversely, someone could say it is absolutely obvious, because stochastic process are NOT
differentiable, and so any kind of Taylor expansion is wrong
Β¨ As a note, even though in most textbooks in Finance the Ito lemma is expressed as a Taylor
expansion using the formal rules of calculus, the rule is that with stochastic processes you
can NEVER differentiate (at least in a manner that makes sense and is safe), you can ONLY
integrate
Β¨ And so a more formally correct formulation of the Ito Lemma is:
Β¨ πΉ π π‘ = π β πΉ π π‘ = π = β«+3<
+3= )9
)1
. ππ +
-
.
β«+3<
+3= )!9
)1! . ππ‘
Β¨ Or also:
Β¨ β«+3<
+3=
ππΉ(π π‘ ) = β«+3<
+3= )9
)1
. ππ(π‘) +
-
.
β«+3<
+3= )!9
)1! . ππ‘
55
56. Luc_Faucheux_2020
Ito and Stratonovitch βTaylorβ expansion - X
Β¨ What is then the correct formulation of Stratonovitch lemma?
Β¨ Is that?
Β¨ πΉ π₯ π‘ = π β πΉ π₯ π‘ = π = β«+3<
+3= )9
)!
. ππ₯ + β«+3<
+3=
[
-
.
)!9
)!! . π. +
-
.
.
)9
)!
.
)5
)!
. π]. ππ‘
Β¨ Or:
Β¨ β«+3<
+3=
ππΉ(π₯ π‘ ) = β«+3<
+3= )9
)!
. ππ₯ + β«+3<
+3=
[
-
.
)!9
)!! . π. +
-
.
.
)9
)!
.
)5
)!
. π]. ππ‘
Β¨ Or to identify the distinctions between the two:
Β¨ STRATO(β«+3<
+3=
ππΉ(π₯ π‘ ))=ITO(β«+3<
+3=
ππΉ(π₯ π‘ ))+
-
.
β«+3<
+3= )9
)!
.
)5
)!
. π. ππ‘
Β¨ This is still wrong, as we mixed Taylor expansion using the usual rules of calculus (Ito rules)
with something completely different. We will now show what is the correct way to look at it
using integrals.
56
57. Luc_Faucheux_2020
Simple rules of stochastic calculus (cheat sheet)
Β¨ NEVER EVER EVER work with processes where the volatility is a function of the stochastic
variable
Β¨ If you do or have no choice, transform it into a constant volatility equation (Hull p. 320), or
find a way to set the volatility term to 0 (p.330), or give up and come up with something
different (SABR model)
Β¨ If you are working in Finance (and βdiscrete processes) -> use ITO
Β¨ If you are working with a DIGITAL computer -> use ITO
Β¨ If you are working with an ANALOG computer -> use STRATO
Β¨ If you are working in physics, and you do not like to break the time invariance, and you are
also not that smart, so you want the usual rules of calculus -> use STRATO
Β¨ In ALL cases, especially when working with the SDE, and discrete computer simulations,
ALWAYS check that your drift has not been βpollutedβ by the variable diffusion (βspuriousβ
drift, Ryter 1980)
57
59. Luc_Faucheux_2020
We have to start from the basics
Β¨ Because clearly using ITO lemma as a Taylor expansion where we keep certain terms and
using still the usual rules of calculus is wrong.
Β¨ As we hinted at it, we should never write something that looks like a differential but always
as an integral.
Β¨ Letβs now go through that derivation, and start with the usual Riemann integral in the usual
calculus
Β¨ We then show that extending that concept to a stochastic variable is not well defined, and
needs a convention, or interpretation of the integral. ITO is one interpretation, STRATO is
another one.
Β¨ We show the correspondence between the two interpretations.
Β¨ Extending the concept of the integral being a limit of sums subject to an interpretation, we
then derive the ITO lemma as well as the STRATO lemma
59
60. Luc_Faucheux_2020
βRegularβ Riemann integrals (definite integrals)
Β¨ Riemann integrals are the regular integrals
Β¨ Interval [a,b] on regular βcontinuousβ variable t
Β¨ N sections of width (π β π)/π, left side πΏ>, right side π >, and middle π>
Β¨ The Riemann integral β«+36
+35
π π‘ . ππ‘ is the limit when (π β β) of the Riemann sums
Β¨ LEFT Riemann Sum: πΏπ π =
5:6
/
β>3-
>3/
π(πΏ>)
Β¨ RIGHT Riemann Sum: π π π =
5:6
/
β>3-
>3/
π(π >)
Β¨ MIDDLE Riemann Sum: ππ π =
5:6
/
β>3-
>3/
π(π>)
Β¨ SOMETHING Riemann Sum: ππ π =
5:6
/
β>3-
>3/
π(π>) where π> is somewhere in the section
indexed by k, we could also define irregular partitions or βmeshβ if we like
Β¨ All those different sums converge to the same integral
60
62. Luc_Faucheux_2020
Stochastic Integrals
Β¨ When not integrating over a βregularβ continuous variable t but over a stochastic variable X,
those sums do NOT converge to the same value. What does that even look like?
Β¨ So first of all we would like to write something like this β«*3*6
*3*5
π π . ππ
Β¨ The problem is that this is not well defined, what is the path over π that we will integrate
over? Remember π is really π(π‘) and is stochastic (jumps all over the place)
Β¨ So really the only integration we can do is over π‘
Β¨ So we are looking for something like this: β«+3+6
+3+5
π π π‘ . ππ(π‘)
Β¨ When π‘ increases by a small amount πΏπ‘, π(π‘) jumps by a small amount Ξ΄π(π‘)
Β¨ So, breaking the time interval into π sections of small time increment πΏπ‘ =
(+5:+6)
/
Β¨ We looking at something like : SOMETHING = β>3-
>3/
π(π(π‘>)). [π(π‘>?-) β π(π‘>)]
62
63. Luc_Faucheux_2020
Ito Integral
Β¨ That something is the ITO sum, which converges to the ITO integral. Note that at this point it
is just how we define it
Β¨ β«+3+6
+3+5
π π π‘ . ([). ππ(π‘) = lim
/β@
{β>3-
>3/
π(π(π‘>)). [π(π‘>?-) β π(π‘>)]}
Β¨ Note in the integral the usual (.) is replaced by ([) to explicitly indicate ITO convention
Β¨ This is to indicate that we take for π(π(π‘>) the value of π π BEFORE the jump
Β¨ This is to be compared to the ITO lemma where ππ₯ = π π₯, π‘ . ππ‘ + π π₯, π‘ . ππ
gets written in discrete manner as βπ₯ = π π₯, π‘ . βπ‘ + π π₯, π‘ . βπ
or Ξ΄π₯ = π π₯, π‘ . πΏπ‘ + π π₯, π‘ . πΏπ
Β¨ Note also that to be fairly rigorous there are a lot of conditions that need to be verified for
that βSOMETHINGβ to converge in a well defined manner to a well defined function
63
64. Luc_Faucheux_2020
Stratonovitch Integral
Β¨ Similar to the Stratonovitch lemma, where ππ₯ = π π₯, π‘ . ππ‘ + π π₯, π‘ . ππ
gets written in the discrete manner as βπ₯ = π π₯, π‘ . βπ‘ + π π₯ + Ξπ₯/2, π‘ . βπ
or Ξ΄π₯ = π π₯, π‘ . πΏπ‘ + π π₯ + πΏπ₯/2, π‘ . πΏπ
Β¨ The Stratonovitch integral is defined as:
Β¨ β«+3+6
+3+5
π π π‘ . (β). ππ(π‘) = lim
/β@
{β>3-
>3/
π [π(π‘> + π(π‘>?-)]/2). [π(π‘>?-) β π(π‘>)]}
Β¨ If ITO was the βleft side Riemannβ, Stratonovitch is the βmiddle Riemannβ
Β¨ Surprise surprise, they do NOT converge to the same value
Β¨ Notice in the integral the usual (.) is replaced by (β) to indicate that we take the middle point
64
65. Luc_Faucheux_2020
Reverse ITO integral
Β¨ Similarly we can also define a Reverse ITO (OTI?) integral as
Β¨ β«+3+6
+3+5
π π π‘ . (]). ππ(π‘) = lim
/β@
{β>3-
>3/
π(π(π‘>?-)). [π(π‘>?-) β π(π‘>)]}
Β¨ Notice in the integral the usual (.) is replaced by (]) to indicate that we take the right side
Β¨ The Reverse Ito lemma would then expand ππ₯ = π π₯, π‘ . ππ‘ + π π₯, π‘ . ππ
in the discrete manner as βπ₯ = π π₯, π‘ . βπ‘ + π π₯ + Ξπ₯, π‘ . βπ
or Ξ΄π₯ = π π₯, π‘ . πΏπ‘ + π π₯ + πΏπ₯, π‘ . πΏπ
Β¨ This would be equivalent as βreading into the futureβ because we would take the value after
the jump, but we do not know yet what the jump will be
Β¨ Stratonovitch is also sometimes said to be βsimilarβ, as in you need to know the jump ahead
of time to evaluate the function, even though you do not know the jump ahead of time
Β¨ ITO is well adapted to finance and to βMartingalesβ (you do not know the future, expected
value is the current value). The technical term is that the ITO integral is βnon-anticipatingβ
65
66. Luc_Faucheux_2020
Couple of notes here
Β¨ It would seem that ITO would be well suited for processes that are βdiscontinuousβ or
βdiscreteβ in nature (a very poor choice of words on my part), like:
Β¨ Discrete computer simulation (on a digital computer)
Β¨ Finance, gambling, games of chance
Β¨ Radioactive decay (number of particles is discrete and the rate only depends on the previous
state)
Β¨ On the other hand STRATO seems to be better suited for βcontinuousβ processes like most
processes in Physics and Biology (diffusion, advection, chemotaxis, Brownian motors,..)
Β¨ Part of the confusion will arise when trying to model in a discrete fashion a βcontinuousβ
process
66
68. Luc_Faucheux_2020
Conversion between ITO and Stratonovitch 2
Β¨ πππ π΄ππ(π) = πΌππ(π) + lim
/β@
{β>3-
>3/
πβ² π(π‘> . (
[*(+"#$):*(+")]
.
). [π(π‘>?-) β π(π‘>)]}
Β¨ NOW this is a limit of a Riemann sum, because (πΏπ).~πΏπ‘ and is now deterministic (in the
case of a simple Wiener process for π = π)
Β¨ In the more general case of ππ π‘ = π π π‘ , π‘ . ππ‘ + π π π‘ , π‘ . ππ(π‘) we will show that
Β¨ (πΏπ).~π π π‘ , π‘ . πΏπ‘ but for now letβs keep π π‘ = π(π‘) the simple Brownian motion
Β¨ That Riemann sum converges to the definite Riemann integral
-
.
β«+3+6
+3+5
πβ² π π‘ . ππ‘
Β¨ β«+3+6
+3+5
π π π‘ . (β). ππ(π‘) = β«+3+6
+3+5
π π π‘ . ([). ππ(π‘) +
-
.
β«+3+6
+3+5
πβ² π π‘ . ππ‘
Β¨ πππ π΄ππ(π) = πΌππ π +
-
.
β«+3+6
+3+5
πβ² π π‘ . ππ‘
Β¨ πππ π΄ππ(π) = πΌππ π +
-
.
. π πΌπΈππ΄ππ(π%)
68
74. Luc_Faucheux_2020
Chain Rule (Strato lemma)- III
Β¨ π π π‘5 β π π π‘6 =
lim
/β@
{β>3-
>3/ )$
)*
. β .
;*
.
+
-
.
.
)!$
)!! . β .
;*
.
.
β (β
)$
)*
. (β).
;*
.
+
-
.
.
)!$
)!! . (β). (
;*
.
).)}
Β¨ π π π‘5 β π π π‘6 = lim
/β@
{β>3-
>3/ )$
)*
. β .
;*
.
+ β(β
)$
)*
. (β).
;*
.
)}
Β¨ π π π‘5 β π π π‘6 = lim
/β@
{β>3-
>3/ )$
)*
. β . πΏπ}
Β¨ And so defining the integral with the Stratonovitch convention:
Β¨ π π π‘5 β π π π‘6 = β«+3+6
+3+5 )$
)*
. (β). ππ(π‘)
Β¨ In the βlimitβ of small time increments, this can be written formally as the Strato lemma:
Β¨ πΏπ =
)$
)*
. β . πΏπ
Β¨ Please note that we are keeping the notation : β
74
75. Luc_Faucheux_2020
Chain Rule (Strato lemma)- IV
Β¨ Using the Stratonovitch definition of the stochastic integral, we can write :
Β¨ πΏπ =
)$
)*
. β . πΏπ
Β¨ This is the usual chain rule
Β¨ So formally in some textbooks, you will see the following statement:
Β¨ βWe do not mean that the Stratonovitch stochastic integral is a classical (Riemann) integral.
We only claim that the corresponding chain rules have a similar structureβ. Mikosh p127
Β¨ It is important to note that BOTH the Ito and the Stratonovitch integrals are defined in a
mathematically correct manner.
Β¨ Ito rules of calculus are not the usual ones but the Ito integral is a martingale
Β¨ Strato rules of calculus are the usual ones (FORMALLY) but the Strato integral is NOT a
martingale
Β¨ We still have to review how we treat SDE and PDE in those frameworks.
75
76. Luc_Faucheux_2020
Chain Rule (Ito and Strato lemma)- I
Β¨ The crux of the matter is which interpretation of an integral do you want to use:
Β¨ Because lim
/β@
{β>3-
>3/ )$
)*
. β . πΏπ}
Β¨ And
Β¨ lim
/β@
β>3-
>3/
{
)$
)*
. ([). πΏπ}
Β¨ Do NOT converge to the same value, unlike a regular Riemann integral
Β¨ In fact we just showed that
Β¨ π π π‘5 β π π π‘6 = lim
/β@
{β>3-
>3/ )$
)*
. β . πΏπ}
Β¨ π π π‘5 β π π π‘6 = lim
/β@
β>3-
>3/
{
)$
)*
. ([). πΏπ +
-
.
.
)!9
)!! . ([). (πΏπ).}
76
78. Luc_Faucheux_2020
Chain Rule (Ito and Strato lemma)- III
Β¨ We then have for the chain rule using the ITO interpretation of the integral:
Β¨ π π π‘5 β π π π‘6 = lim
/β@
β>3-
>3/
{
)$
)*
. ([). πΏπ +
-
.
.
)!9
)!! . ([). (πΏπ).}
Β¨ β«+3+&
+3+'
ππΉ(π π‘ ) = β«+3+6
+3+5 )$
)*
. ([). ππ(π‘) +
-
.
β«+3+6
+3+5 )!9
)!! π π‘ . (ππ).
Β¨ Note that all integrals are on : β«+3+&
+3+'
()
Β¨ HOWEVER, the increment of integrands are different, ππΉ, ππ and ππ‘
Β¨ BOTH πΉ and π are functions of π‘ ultimately, πΉ(π π‘ ) and π(π‘)
Β¨ So only in a formal manner we write:
Β¨ πΏπ =
)$
)*
. πΏπ +
-
.
.
)!9
)!! . (πΏπ)., which is the celebrated Ito lemma (chain rule)
78
79. Luc_Faucheux_2020
Chain Rule (Ito and Strato lemma)- IV
Β¨ πΏπ =
)$
)*
. πΏπ +
-
.
.
)!9
)!! . π.. πΏπ‘, which is the celebrated Ito lemma (chain rule)
Β¨ We somehow convinced ourselves at first that this was just using regular Taylor expansion
but just keeping higher order terms, in particular the second order in π, because:
Β¨ πΏπ. πΏπ~π.. πΏπ‘
Β¨ But even though it looks formally the same, the only rigorous manner in which to write it is:
Β¨ β«+3+&
+3+'
ππΉ(π π‘ ) = β«+3+6
+3+5 )$
)*
. ([). ππ(π‘) +
-
.
β«+3+6
+3+5 )!9
)!! π π‘ . π π π‘ , π‘ .. ππ‘
Β¨ With the ITO interpretation of the integral:
Β¨ β«+3+6
+3+5
πΉ π π‘ . ([). ππ(π‘) = lim
/β@
{β>3-
>3/
πΉ(π(π‘>)). [π(π‘>?-) β π(π‘>)]}
79
80. Luc_Faucheux_2020
Chain Rule (Ito and Strato lemma)- V
Β¨ We then have for the chain rule using the STRATO interpretation of the integral:
Β¨ π π π‘5 β π π π‘6 = lim
/β@
{β>3-
>3/ )$
)*
. β . πΏπ}
Β¨ β«+3+&
+3+'
ππΉ(π π‘ ) = β«+3+6
+3+5 )$
)*
. β . ππ(π‘)
Β¨ Note that all integrals are on : β«+3+&
+3+'
()
Β¨ HOWEVER, the increment of integrands are different, ππΉ, ππ and ππ‘
Β¨ BOTH πΉ and π are functions of π‘ ultimately, πΉ(π π‘ ) and π(π‘)
Β¨ So only in a formal manner we write:
Β¨ πΏπ =
)$
)*
. πΏπ, which is the celebrated STRATO lemma (chain rule)
80
81. Luc_Faucheux_2020
Chain Rule (Ito and Strato lemma)- VI
Β¨ πΏπ =
)$
)*
. πΏπ, which is the celebrated STRATO lemma (chain rule)
Β¨ HOWEVER, the only rigorous manner in which to write it is:
Β¨ β«+3+&
+3+'
ππΉ(π π‘ ) = β«+3+6
+3+5 )$
)*
. β . ππ(π‘)
Β¨ With the STRATO interpretation of the integral:
Β¨ β«+3+6
+3+5
πΉ π π‘ . (β). ππ(π‘) = lim
/β@
{β>3-
>3/
πΉ [π(π‘> + π(π‘>?-)]/2). [π(π‘>?-) β π(π‘>)]}
81
82. Luc_Faucheux_2020
Chain Rule (Ito and Strato lemma)- VII
Β¨ So sometimes we will just stick to the notation:
Β¨ Ito lemma:
Β¨ πΏπ =
)$
)*
. ([). πΏπ +
-
.
.
)!9
)!! . ([). πΏπ.
Β¨ Just to remind us that we are using stochastic calculus and that it is NOT a usual product
Β¨ Similarly when using STRATO we will sometimes use:
Β¨ πΏπ =
)$
)*
. β . πΏπ
Β¨ To remind us that even if it looks like the regular chain rule, we are in the stochastic world
where things are a little weird.
Β¨ Again the only rigorous manner to deal with those is to always go back to the integrals, and
the interpretation of is as a limit of a sum, which is rigorous.
82
83. Luc_Faucheux_2020
Chain Rule (Ito and Strato lemma)- VIII
Β¨ Note that if the function πΉ(π π‘ ) has an explicit dependency on time πΉ(π π‘ , π‘)
Β¨ Then for the time part the regular chain rule applies and we will obtain terms of the
expression:
)9
)+
. ππ‘ in BOTH ITO and STRATO
Β¨ Because integrating over time is a normal Riemann integral, and both sums converge to the
same limit
Β¨ β«+3+6
+3+5 )9
)+
. β . ππ‘ = β«+3+6
+3+5 )9
)+
. [ . ππ‘ = β«+3+6
+3+5 )9
)+
. ππ‘
83
85. Luc_Faucheux_2020
Leibniz rule - I
Β¨ In most textbooks, it is usually also presented as
Β¨ Hey do a Taylor expansion
Β¨ Just make sure to keep the higher order terms
Β¨ And you good
Β¨ Surprisingly it is formally the same expression
Β¨ Even more surprisingly, if you were to be working in a Strato world, textbooks would say:
Β¨ Hey just use regular calculus
Β¨ Since we have seen now that stochastic calculus can be tricky, letβs spend some time on
convincing ourselves that we can adapt the Leibniz rule in stochastic calculus (it will also be
super useful when changing numeraires in the Numeraire deck)
85
86. Luc_Faucheux_2020
Leibniz rule - II
Β¨ It will be easier to do it once we have a more general expression for the ITO and STRATO
integrals, so for now we will just state them (Leibniz rule for first order)
Β¨ Leibniz rule in the REGULAR calculus:
Β¨ πΏ ππ = π
)$
)*
. πΏπ + π
)(
)*
. πΏπ
Β¨ Leibniz rule in the ITO calculus:
Β¨ πΏ(ππ) = π
)$
)*
. ([). πΏπ + π
-
.
.
)!$
)*! . ([). πΏπ. + π
)(
)*
. ([). πΏπ + π
-
.
.
)!(
)*! . ([). πΏπ. +
)(
)*
.
)$
)*
. ([). πΏπ.
Β¨ Leibniz rule in the STRATO calculus:
Β¨ πΏ ππ = π
)$
)*
. β . πΏπ + π
)(
)*
. β . πΏπ
86
88. Luc_Faucheux_2020
A worked out example to gain some intuition
Β¨ β«+3+6
+3+5
π π π‘ . ([). ππ(π‘) = lim
/β@
{β>3-
>3/
π(π(π‘>)). [π(π‘>?-) β π(π‘>)]}
Β¨ This is the definition of the Ito integral
Β¨ Letβs try with the simple case of the function π(π(π‘>)) = π(π‘>)
Β¨ The Riemann sum is: π/ = β>3-
>3/
π(π(π‘>)). [π(π‘>?-) β π(π‘>)]
Β¨ For this specific case: π/ = β>3-
>3/
π(π‘>). [π(π‘>?-) β π(π‘>)]
88
89. Luc_Faucheux_2020
In the βregularβ case β Riemann integral
Β¨ β«!3!6
!3!5
π π₯ . ππ₯ = lim
/β@
{β>3-
>3/
π(π₯>). [(π₯>?-) β (π₯>)]}
Β¨ This is the usual βtriangleβ representation
89
90. Luc_Faucheux_2020
In the βregularβ case β Riemann integral - II
Β¨ In the regular case,
Β¨ (π₯>?-) β (π₯>) = πΏπ₯ =
!':!&
/
=
;*
/
Β¨ Another way to look at it, is π₯ = π‘, so at every point in time, Ξ΄π₯ = πΏπ‘
Β¨ In particular, Ξ΄π₯. = Ξ΄π‘.
90
Xi i+1i-1
F(X) to integrate
91. Luc_Faucheux_2020
In the stochastic case, we cannot draw that picture
Β¨ We cannot write (π₯>?-) β (π₯>) = πΏπ₯ =
!':!&
/
=
;*
/
Β¨ If anything, what we can write is (π₯>?-) β (π₯>) = πΏπ₯> = Β±πΏπ₯
Β¨ And so β(π₯>?-) β (π₯>) = β πΏπ₯> = 0
Β¨ And β[(π₯>?-) β (π₯>)].= β πΏπ₯>
.
= β πΏπ₯. = π. πΏπ₯.
91
Xi i+1i-1
92. Luc_Faucheux_2020
Another way to think about the difference
Β¨ The regular case, the horizontal axis is the regular non-stochastic variable
Β¨ Any integration of function is the regular Riemann integral
Β¨ In the stochastic case, the horizontal axis becomes time, and the vertical is the stochastic
variable X, and we will need to integrate a function of it over the vertical axis, but whereas
time is regular, a stochastic process cannot be such that each step is just the interval divided
by the number of steps
92
X(t) is stochastic
Time t is regular
F(X(t))tointegrate
93. Luc_Faucheux_2020
The regular case revisited
Β¨ β«!3!6
!3!5
π π₯ ([)ππ₯ = lim
/β@
{β>3-
>3/
π(π₯>). [(π₯>?-) β (π₯>)]}
Β¨ β«!3!6
!3!5
π π₯ ([)ππ₯ = lim
/β@
β>3-
>3/
π(π₯>). πΏπ₯> = lim
/β@
!':!&
/
. β>3-
>3/
π(π₯>)
Β¨ In the case where π(π₯>) = π₯> = π. πΏπ₯ = π.
!':!&
/
Β¨ β«!3!6
!3!5
π₯([)ππ₯ = lim
/β@
!':!&
/
.
!':!&
/
. β>3-
>3/
π = lim
/β@
!':!&
/
.
!':!&
/
.
/(/?-)
.
Β¨ β«!3!6
!3!5
π₯([)ππ₯ = (π₯5 β π₯6). lim
/β@
-
/
.
-
/
.
/(/?-)
.
Β¨ Using π₯6 = 0 without losing any generality,
Β¨ β«!34
!3*
π₯([)ππ₯ =
-
.
π., which is the usual result
93
95. Luc_Faucheux_2020
The regular case revisited β III
Β¨ So in the regular case, the Riemann integral gives the same result, irrespective of where
inside the small interval we pick the value of the function
Β¨ β«!34
!3*
π₯([)ππ₯ =
-
.
π. = β«!34
!3*
π₯(β)ππ₯
Β¨ In essence, this is because the terms β>3-
>3/
. πΏπ₯> scale like 1, and so any terms in β>3-
>3/
. πΏπ₯>
.
will go to 0 in the limit π β β
Β¨ The βquadratic variationβ β>3-
>3/
. πΏπ₯>
.
does not add up to any finite number in the limit.
Β¨ In the case of a stochastic variable, the terms β>3-
>3/
. πΏπ₯> scale like 0, because πΏπ₯> = Β±πΏπ₯,
and the terms like β>3-
>3/
. πΏπ₯>
.
will actually scale like time.
Β¨ The βquadratic variationβ β>3-
>3/
. πΏπ₯>
.
is said to scale linearly with time (some textbooks use
the expression additive with time) and will not βdisappearβ to 0 in the limit.
95
96. Luc_Faucheux_2020
Back to the worked-out example
Β¨ The Riemann sum is: π/ = β>3-
>3/
π(π‘>). [π(π‘>?-) β π(π‘>)]
Β¨ We can expand: [π(π‘>?-) β π(π‘>)].= π(π‘>?-). + π(π‘>). β 2. π(π‘>). π(π‘>?-)
Β¨ And: π(π‘>). [π(π‘>?-) β π(π‘>)] = π(π‘>). π(π‘>?-) β π(π‘>).
Β¨ And : π(π‘>). [π(π‘>?-) β π(π‘>)] =
-
.
. [π(π‘>?-). + π(π‘>). β [π(π‘>?-) β π(π‘>)].β2. π(π‘>).]
Β¨ Or: π(π‘>). [π(π‘>?-) β π(π‘>)] =
-
.
. [π(π‘>?-). β π(π‘>).] β
-
.
. [π(π‘>?-) β π(π‘>)].
Β¨ So: π/ = β>3-
>3/
π(π‘>). [π(π‘>?-) β π(π‘>)] =
-
.
. π(π‘/?-). β
-
.
β>3-
>3/
[π(π‘>?-) β π(π‘>)].
Β¨ The first term is the expected
*!
.
Β¨ The second term would usually disappear when the variable X is regular, because the sum
would scale as π. (
-
/
).~
-
/
which will tend to 0 when π β β
96
97. Luc_Faucheux_2020
Back to the worked-out example - II
Β¨ π/ = β>3-
>3/
π(π‘>). [π(π‘>?-) β π(π‘>)] =
-
.
. π(π‘/?-). β
-
.
β>3-
>3/
[π(π‘>?-) β π(π‘>)].
Β¨ We define π/ = β>3-
>3/
[π(π‘>?-) β π(π‘>)].
Β¨ We can use here the simple βbinaryβ assumption that [π(π‘>?-) β π(π‘>)].= (π‘>?-βπ‘>)
Β¨ Note that this is capturing the essence of the matter
Β¨ A more accurate and general way to go about this would be to assume the following:
Β¨ {π(π‘>?-) β π(π‘>)} follows the π(0, (π‘>?-βπ‘>)) distribution
Β¨ We would then estimate the expected value of π/
Β¨ πΈ π/ = β>3-
>3/
πΈ[π(π‘>?-) β π(π‘>)]. = β>3-
>3/
(π‘>?-βπ‘>) = π‘/?-
Β¨ We would have to show then that: lim
/β@
π/ = πΈ[π/]
Β¨ This opens up the can of worms of how you define convergence (convergence in
distribution, in probability, almost sure convergence, Lp-convergence). Will try to
incorporate later, but trying to keep it simple to not hide the intuition behind notations
97
98. Luc_Faucheux_2020
What did we get?
Β¨ β«+34
+3=
π π π‘ . ([). ππ(π‘) = lim
/β@
{β>3-
>3/
π(π(π‘>)). [π(π‘>?-) β π(π‘>)]}
Β¨ In the simple case π π(π‘> = π(π‘>)
Β¨ β«+34
+3=
π(π‘). ([). ππ(π‘) =
-
.
π. β
-
.
π
Β¨ A couple of notes:
Β¨ Ito integral does NOT recover the usual rules of calculus
Β¨ Ito integral is called a martingale, meaning if X is a martingale (E[X]=0), then the Ito integral
of a function f(X) is also a martingale
Β¨ πΈ π = 0 and πΈ[β«+34
+3=
π π‘ . [). ππ π‘ = πΈ
-
.
π. β
-
.
π = πΈ
-
.
π. β
-
.
π = 0
Β¨ So πΈ π. = π
Β¨ We recover the usual variance of the Brownian motion
98
99. Luc_Faucheux_2020
A couple more notes
Β¨ Letβs recall the relationship between the Ito and Stratonovitch integral (we can also work it
out from the Riemann sum)
Β¨ β«+3+6
+3+5
π π π‘ . (β). ππ(π‘) = β«+3+6
+3+5
π π π‘ . ([). ππ(π‘) +
-
.
β«+3+6
+3+5
πβ² π π‘ . ππ‘
Β¨ Here, π π = π so π% π = 1
Β¨ β«+34
+3=
π π π‘ . (β). ππ(π‘) = β«+34
+3=
π π π‘ . ([). ππ(π‘) +
-
.
β«+34
+3=
1. ππ‘
Β¨ And we have: β«+34
+3=
π(π‘). ([). ππ(π‘) =
-
.
π. β
-
.
π
Β¨ So β«+34
+3=
π π π‘ . (β). ππ(π‘) =
-
.
π.
Β¨ This is the usual rule of calculus
Β¨ The Stratonovitch integral preserves the usual rule of calculus
99
101. Luc_Faucheux_2020
A couple more notes - II
Β¨ The Stratonovitch integral is NOT a martingale (this makes sense since taking the mid point
introduces correlation, and thus the terms in the product are NOT independent)
Β¨ Because the Ito lemma does NOT recover the usual rules of calculus, what a function
actually means has to be at times redefined.
Β¨ For example, we all know the exponential function π π‘ = exp(π‘)
Β¨ It is such that : π% π‘ = π(π‘)
Β¨ However we would not expect this function to preserve the same property when dealing
with a stochastic variable (another way to say it is that this function is convex, and so the
Jensen inequality will introduce a convexity correction, see the lecture on options)
Β¨ We know that Stratonovitch will preserve the rules of calculus
Β¨ So β«+34
+3=
ππ₯π π π‘ . β . ππ π‘ = exp(π(π))
Β¨ And β«+34
+3=
π π π‘ . (β). ππ(π‘) = β«+34
+3=
π π π‘ . ([). ππ(π‘) +
-
.
β«+34
+3=
πβ² π π‘ . ππ‘
101
102. Luc_Faucheux_2020
The Ito exponential function
Β¨ β«+34
+3=
π π π‘ . (β). ππ(π‘) = ππ₯π π π = β«+34
+3=
π π π‘ . ([). ππ(π‘) +
-
.
β«+34
+3=
πβ² π π‘ . ππ‘
Β¨ ππ₯π π π = β«+34
+3=
π π π‘ . ([). ππ(π‘) +
-
.
β«+34
+3=
ππ₯π π π‘ . ππ‘
Β¨ Since the second term is always positive, we have
Β¨ β«+34
+3=
ππ₯π π π‘ . ([). ππ(π‘) <> ππ₯π π π
Β¨ So clearly under Ito, the usual exponential function does not verify πΉ% π = πΉ(π)
Β¨ For that reason, the convention is to rename some of the functions by specifying βItoβ in
front of them
Β¨ This can be confusing at times
102
103. Luc_Faucheux_2020
The Ito exponential function -II
Β¨ Ito lemma has : πΏπΉ =
)9
)*
. πΏπ +
-
.
.
)!9
)*! . πΏπ. +
)9
)+
. πΏπ‘
Β¨ With πΉ π = exp π , πΉ% π = exp π , πΉ%% π = exp(π)
Β¨ We get πΏπΉ = exp π . πΏπ +
-
.
. exp π . πΏπ. = exp(π). πΏπ +
-
.
. exp(π). πΏπ‘
Β¨ With πΉ π, π‘ = exp(π β
+
.
) ,
)9
)*
= exp π β
+
.
,
)!9
)*! = exp π β
+
.
,
)9
)+
=
:-
.
. exp(π β
+
.
)
Β¨ We get πΏπΉ = exp π β
+
.
. πΏπ +
-
.
. exp π β
+
.
. πΏπ. β
-
.
. exp π β
+
.
. πΏπ‘
Β¨ Or: πΏπΉ = exp π β
+
.
. πΏπ = πΉ π, π‘ . πΏπ
Β¨ So you will see sometimes the function πΉ π, π‘ = exp π β
+
.
being referred to as the Ito-
exponential, whereas the regular exponential is of course πΉ π = exp π
103
104. Luc_Faucheux_2020
The Ito exponential function -III
Β¨ So this is another indication that we should be careful with using regular functions and some
of their properties.
Β¨ In regular calculus, the exponential function π π₯ = exp(π₯) is such that : π% π₯ = π(π₯)
Β¨ In ITO calculus, the βITO exponential functionβ that still verifies: πΉ% π(π‘) = πΉ(π(π‘)) is given
by: πΉ π(π‘), π‘ = exp π(π‘) β
+
.
Β¨ In STRATO calculus, the βSTRATO exponential functionβ that still verifies: πΉ% π(π‘) =
πΉ(π(π‘)) is given by: πΉ π(π‘), π‘ = exp π(π‘)
Β¨ Note that we are somehow lucky that those functions are still local (i.e. depends only on the
value of π(π‘) and π‘. It is not clear that we could not have ended up with a more
complicated function that depends on the history or the path β«+34
+3=
π π‘ . ππ‘ for example.
104
107. Luc_Faucheux_2020
Another example: can you integrate X ?
Β¨ Somewhat cultural side note: In French βto integrateβ (or βintegrerβ) is the same word to
perform a mathematical integration or to be accepted in a school.
Β¨ One of the most prestigious schools is called βPolytechniqueβ or βXβ because of the logo on
their hats of two crossed swords (it was created and is still technically a military school, a
little like West Point here, but starts around the junior college level)
Β¨ So anyways, after high school, there are special schools called βclasses preparatoiresβ where
you just study for the entrance exam to those advanced schools (βhautes ecolesβ), with
names like X, Ecole Normale Superieure (Normal Superieure school) or others with names
that are usually tied to their original concentration: Ponts et Chaussees (bridges and
sidewalks), Mines (mining), Supelec (Superior Electricity), and so on
Β¨ Usually students spend around 2 years studying in βclasses preparatoiresβ before taking the
entrance exam (everything is an exam, there is no application, you take the exam, you get
ranked and then the school offers you a spot in the order of ranking).
Β¨ So you get the idea, the question is how many years does it take you to integrate X
Β¨ 50 years later, people will still remember what βhalfsβ they were, or they will lie about it
107
108. Luc_Faucheux_2020
Another example: can you integrate X ? - II
Β¨ If you are a genius and if it takes you only one year to integrate X, the student is called a βone
halfβ because: β«*34
*3-
π. ππ = [
*!
.
]*34
*3-
=
-
.
Β¨ I have heard of βone-halfβ I have never met one.
Β¨ This is not the same as βhalf-bloodsβ from Harry Potter, I have never met one of those either
Β¨ If you are a decent student and if it takes you two years to integrate X, the student is called a
βthree halfβ because: β«*3-
*3.
π. ππ = [
*!
.
]*3-
*3.
=
C
.
β
-
.
=
D
.
Β¨ (I was a 3/2, but I did not integrate X, my father did, my brother did, I am the black sheep of
the family)
Β¨ If you are a decent student and if it takes you three years to integrate X, the student is called a
βfive halfβ because: β«*3.
*3D
π. ππ = [
*!
.
]*3.
*3D
=
E
.
β
C
.
=
F
.
Β¨ If it takes you four years to integrate X, the student is called a βseven halfβ because:
β«*3D
*3C
π. ππ = [
*!
.
]*3D
*3C
=
-G
.
β
E
.
=
H
.
Β¨ Being called a βseven halfβ is an insult
108
109. Luc_Faucheux_2020
Another example: can you integrate X ? - III
Β¨ Oh also if you integrate π not in ππ but in ππ‘, you are called βendetteβ, or in debt
Β¨ OK, so that was a little digression
Β¨ Letβs get back to the matter at hands.
Β¨ If π is not stochastic (also called deterministic), this is the usual calculus that we are used to,
and so:
Β¨ β« π. ππ =
*!
.
+ πΆ
Β¨ What happens if π is now a stochastic variable?
Β¨ The truth is that I have never met anyone who can integrate a stochastic variable (I have also
never met a βone halfβ), and so usually people always treat the problem from the other way,
you start with a guess of what the integral is, you use ITO lemma and then you check in an
iterative manner
109
110. Luc_Faucheux_2020
Another example: can you integrate X ? - IV
Β¨ If we have a function πΉ(π), Ito lemma is the following:
Β¨ Ito (1951) guessed that you can write ππ₯ = π π₯, π‘ . ππ‘ + π π₯, π‘ . ππ§ as Ξ΄π₯ = π π₯, π‘ . πΏπ‘ +
π π₯, π‘ . πΏπ§
Β¨ If πΉ(π₯) a funcyon of x, the corresponding SDE as a result of βTaylorβ expansion in ITO is:
Β¨ Bear in mind that this is really not a Taylor expansion, it is just ITO lemma that looks like a
Taylor expansion where you kept some terms and not others
Β¨ πΏπΉ =
)9
)!
. πΏπ₯ +
-
.
.
)!9
)!! . π.. πΏπ‘
Β¨ πΏπΉ =
)9
)*
. πΏπ +
-
.
.
)!9
)*! . πΏπ.
Β¨ Letβs use πΉ π = π. as a good guess
Β¨ πΉ π = π.,
)9
)*
= 2π,
)!9
)*! = 2, we then get: πΏ π. = 2π. πΏπ +
-
.
. 2. πΏπ.
110
111. Luc_Faucheux_2020
Another example: can you integrate X ? - V
Β¨ πΏ π. = 2π. πΏπ +
-
.
. 2. πΏπ.
Β¨ In the case of the Geometric Brownian motion (Hull): ππ = ππππ
Β¨ πΏ π. = 2π. πΏπ +
-
.
. 2. (ππ). πΏπ‘
Β¨ πΏ π. = 2π. πΏπ + (ππ). πΏπ‘
Β¨ And so: β« π. ππ = β«{
; *!
.
β
-
.
. (ππ). πΏπ‘}
Β¨ β« π. ππ = [
*!
.
] β
-
.
β«(ππ). πΏπ‘
Β¨ With the usual convention that π π‘ = 0 = 0, in the ITO convention:
Β¨ β«+34
+3=
π. ππ =
*(=)!
.
β
-
.
β«+34
+3=
(ππ). πΏπ‘
111
112. Luc_Faucheux_2020
Another example: can you integrate X ? - VI
Β¨ Things are a little different in the Stratonovitch convention:
Β¨ Strato guessed that you can write ππ₯ = π π₯, π‘ . ππ‘ + π π₯, π‘ . ππ
as Ξ΄π₯ = π π₯, π‘ . πΏπ‘ + π π₯ + πΏπ₯/2, π‘ . πΏπ
Β¨ The SDE for πΉ(π₯) in Stratonovitch convention is (using what is known as ITO calculus):
Β¨ πΏπΉ =
)9
)!
. πΏπ₯ +
-
.
.
)!9
)!! . π.. πΏπ‘ +
-
.
.
)9
)!
.
)5
)!
. π. πΏπ‘
Β¨ We know this is wrong, but letβs just illustrate how wrong it is:
Β¨ Rewriting it without the drift term we get:
Β¨ πΏπ = π π +
;*
.
, π‘ . πΏπ = π π . πΏπ +
-
.
.
)5
)!
. πΏπ. πΏπ
Β¨ πΏπ = π π +
;*
.
, π‘ . πΏπ = π π . πΏπ +
-
.
.
)5
)!
. π π . πΏπ‘
Β¨ πΏπ = π π . πΏπ +
-
.
.
)5
)!
. π π . πΏπ‘ in Stratonovitch while Ito had: πΏπ = π π . πΏπ
112
115. Luc_Faucheux_2020
Another example: can you integrate X ? - X
Β¨ πΏπΉ =
)9
)*
. π π . πΏπ +
-
.
.
)!9
)*! . π π .. πΏπ‘ +
-
.
.
)9
)*
.
)5
)*
. π. πΏπ‘
Β¨ In the case of the simple Geometric Brownian motion (Hull): ππ = ππππ
Β¨ Using the guess πΉ π = π.
Β¨ πΏ(π.) = 2π. ππ. πΏπ +
-
.
. 2. (ππ). πΏπ‘πΏπ‘ +
-
.
. 2π. π. ππ. πΏπ‘
Β¨ πΏ(π.) = 2π. πΏπ + 2. (ππ).. πΏπ‘
Β¨ In Ito we had : πΏ π. = 2π. πΏπ +
-
.
. 2. (ππ).. πΏπ‘
Β¨ So using ITO: β«+34
+3=
π. ππ =
*(=)!
.
β
-
.
β«+34
+3=
(ππ).. πΏπ‘
Β¨ Using Stratonovitch: β«+34
+3=
π. ππ =
*(=)!
.
β β«+34
+3=
(ππ).. πΏπ‘
115
116. Luc_Faucheux_2020
Another example: can you integrate X ? - Xa
Β¨ If we were to look at the simple Brownian motion case:
Β¨ ππ = ππ
Β¨ ITO: πΏ π. = 2π. πΏπ +
-
.
. 2. πΏπ.
Β¨ πΏ π. = 2π. πΏπ + πΏπ‘
Β¨ And so: β« π. ππ = β«{
; *!
.
β
-
.
. πΏπ‘}
Β¨ β« π. ππ = [
*!
.
] β
-
.
β« πΏπ‘
Β¨ With the usual convention that π π‘ = 0 = 0, in the ITO convention:
Β¨ β«+34
+3=
π. ππ =
*(=)!
.
β
-
.
π
116
117. Luc_Faucheux_2020
Another example: can you integrate X ? - Xb
Β¨ β«+34
+3=
π. ππ =
*(=)!
.
β
-
.
π
Β¨ Note that we know this to be consistent since the ITO integral is a martingale (or a trading
strategy)
Β¨ We will go over this again at more length but we have:
Β¨ πΌ β«+34
+3=
π. ππ = 0 = πΌ
* = !
.
β πΌ
-
.
π = πΌ
* = !
.
β
-
.
π
Β¨ And we recover the usual dispersion expectation for the simple Brownian motion:
Β¨ πΌ π π . = π
117
118. Luc_Faucheux_2020
Another example: can you integrate X ? - Xc
Β¨ If we were to look at the simple Brownian motion case:
Β¨ ππ = ππ π π = 1 so
)5
)*
= 0
Β¨ STRATO: πΏπΉ =
)9
)*
. π π . πΏπ +
-
.
.
)!9
)*! . π π .. πΏπ‘ +
-
.
.
)9
)*
.
)5
)*
. π. πΏπ‘
Β¨ πΏ π. = 2π. πΏπ + πΏπ‘ This is exactly the same as ITO
Β¨ So we get the strange result that in BOTH ITO and STRATO we will recover for the simple
Brownian motion:
Β¨ β«+34
+3=
π. ππ =
*(=)!
.
β
-
.
π
Β¨ This is clearly wrong, and once again the error was in βusing a STRATO convention in the ITO
calculusβ, and not even that, as we took βITO calculusβ as βdoing regular Taylor expansions
like in regular calculus and just keeping some terms and neglecting some other termsβ
118
119. Luc_Faucheux_2020
Another example: can you integrate X ? - XI
Β¨ HOWEVER, remember the formula in the simple Wiener case : π = π
Β¨ πππ π΄ππ(π) = πΌππ π +
-
.
. π πΌπΈππ΄ππ(π%)
Β¨ In the case of π = π, π% = 1
Β¨ πππ π΄ππ π = πΌππ π +
-
.
. π πΌπΈππ΄ππ(1) with
Β¨ π πΌπΈππ΄ππ 1 = β«+34
+3=
1. ππ‘ = π
Β¨ So Ito : β«+34
+3=
π. ππ =
*(=)!
.
β
-
.
β«+34
+3=
1. πΏπ‘ or β«+34
+3=
π. ππ =
*(=)!
.
β
-
.
π
Β¨ Stratonovitch: β«+34
+3=
π β ππ = β«+34
+3=
π. ππ +
-
.
π =
*(=)!
.
β
-
.
π +
-
.
π =
*(=)!
.
Β¨ Startonovitch as expected follows in a formal manner the usual rules of calculus
119
120. Luc_Faucheux_2020
Another example: can you integrate X ? - XII
Β¨ So clearly we failed to integrate X, because we found the following wrong results:
Β¨ In the Geometric Brownian motion case, Strato does not match formally the usual rules of
calculus
Β¨ In the simple Brownian motion case, BOTH ITO and STRATO returns the same result
Β¨ This is not possible as we know that the ITO and STRATO integrals are different and we know
what the difference is (
-
.
. π πΌπΈππ΄ππ)
Β¨ But again, apologies if so far the mistake was obvious, but NEVER rely on usual rules of
calculus, or think that Stratanovitch is just βtaking the middle pointβ and that you can still
use ITO lemma or Taylor expansion in a nested manner. If you choose STRATO you CANNOT
use ITO calculus, you have to stay in STRATO calculus, and vice versa
Β¨ Also note that ITO lemma is very generic in (πΏπ). but when choosing a specific expression
forπ(π‘) as a function of the Brownian motion (Wiener process π(π‘)), we end up with very
different expressions, some tractable, some not so much
120
121. Luc_Faucheux_2020
Another example: can you integrate X ? - XIII
Β¨ The right way to do it is of course:
Β¨ ITO: πΏπ =
)$
)*
. ([). πΏπ +
-
.
.
)!9
)!! . ([). πΏπ.
Β¨ The results we obtained in the preceding slides for ITO are still correct
Β¨ STRATO: πΏπ =
)$
)*
. β . πΏπ
Β¨ And then we do get in the case of the simple Brownian motion: ππ = ππ
Β¨ πΉ π = π.
Β¨ πΏπ = 2π. β . πΏπ
Β¨ β«+34
+3=
π. β . ππ =
-
.
β«+34
+3=
2π. β . πΏπ =
-
.
β«+34
+3=
π π. = [
*!
.
]+34
+3=
Β¨ As expected if STRATO follows formally the usual rules of calculus
121
122. Luc_Faucheux_2020
Quick notes
Β¨ Usually when dealing with an SDE, people will try
Β¨ 1) get back to an SDE where the stochastic scaling does not depend on the stochastic
variable. For example, when dealing with ππ = π. π. ππ‘ + π. π. ππ, the natural road to
explore is writing something like
I<
<
= π. ππ‘ + π. ππ, and then try to βdefineβ what
I<
<
is.
Β¨ It seems intuitive that
I<
<
should have something to do with π(ln π ), so we would love to
write something like π(ππ π ) = π. ππ‘ + π. ππ, but it turns out that is not quite right,
because ππ π is convex as a function of π, and π is stochastic, not deterministic
Β¨ So always re-derive ITO lemma to make sure you are not dropping terms in the βTaylor
expansionβ
Β¨ 2) try to get rid of the term in from of the ππ§, because then you are not dealing with a SDE
anymore, but with a PDE. This is what Black Sholes did by adding a βdelta hedgeβ, and off to
a Nobel prize they went
122
123. Luc_Faucheux_2020
Quick notes - II
Β¨ We also see the famous βconvexity adjustmentβ that we looked at in the Options deck.
Β¨ ππ π is negatively convex as a function of the stochastic variable
Β¨ So from an intuition point of view as we saw
Β¨ < ππ π > β ππ < π >
Β¨ Actually we know that : < ππ π > = πΌ(ππ π ) β€ ππ πΌ(π) = ππ < π >
Β¨ So it would make sense that around the point πΌ(π) the function ππ π would not behave as
the βregularβ function ππ πΌ(π)
Β¨ Note that the distinction though, the convexity adjustment was coming from integrating
over the possible outcomes at a given time of the stochastic variable. Here we are
integrating over the time (over the path over time of the stochastic variable). They are
related nonetheless.
Β¨ Obviously if you have the expression that resulted from integrating over the path, you can
now use it to integrate over the distribution
123
124. Luc_Faucheux_2020
Quick notes - III
Β¨ Just to make it explicit.
Β¨ β«+3+&
+3+'
ππΉ(π π‘ ) = β«+3+6
+3+5 )9
)*
. ([). ππ(π‘) +
-
.
β«+3+6
+3+5 )!9
)!! π π‘ . (ππ).
Β¨ πΏπΉ =
)9
)*
. πΏπ +
-
.
.
)!9
)!! . (πΏπ)., which is the celebrated Ito lemma (chain rule)
Β¨ πΉ π = ln(π),
)9
)*
= 1/π,
)!9
)*! = β1/π.
Β¨ In the case of the simple Brownian motion: ππ = ππ
Β¨ πΏ(πππ) =
-
1
. πΏπ β
-
.
.
-
1! . πΏπ‘ this is quite ugly to deal with
Β¨ In the case of the Geometric Brownian motion (Hull) ππ = π. ππ
Β¨ πΏ πππ =
-
*
. π. πΏπ β
-
.
.
-
*! . π.. πΏπ‘ = πΏπ β
-
.
. πΏπ‘ this is quite nice and easy to deal with
124
125. Luc_Faucheux_2020
Quick notes - IV
Β¨ So for the log function and in the case of a geometric Brownian motion, we have
Β¨ πΏ πππ = πΏπ β
-
.
. πΏπ‘
Β¨ Or more rigorously:
Β¨ β«+3+&
+3+'
ππΏπ(π π‘ ) = πΏπ π π‘5 β πΏπ(π π‘6 ) =
Β¨ πΏπ π π‘5 β πΏπ π π‘6 = β«+3+6
+3+5
ππ π‘ β
-
.
β«+3+6
+3+5
ππ‘ = π π‘5 β π π‘6 β
-
.
(π‘5 β π‘6)
Β¨ One could be tempted to identify
-
.
. πΏπ‘ as a convexity adjustment (which it is in some way,
since if the function was not convex, i.e.
)!9
)*! = 0, this term would not appear), but it is not
exactly the one we are dealing with in the option deck, as that one also depends on the
specific distribution being used.
125
126. Luc_Faucheux_2020
Quick notes - V
Β¨ Still rather crudely (but rigorous, as we will show in section V on the GBM)
Β¨ ππ = π. ππ careful, this is not the same as writing π π‘ = exp(π π‘ )
Β¨ πΌ π π‘5 = π π‘6
Β¨ πΏπ π π‘5 β πΏπ π π‘6 = β«+3+6
+3+5
ππ π‘ β
-
.
β«+3+6
+3+5
ππ‘ = π π‘5 β π π‘6 β
-
.
(π‘5 β π‘6)
Β¨ πΌ πΏπ π π‘5 β πΏπ π π‘6 = πΌ{π π‘5 β π π‘6 β
-
.
(π‘5 β π‘6)}
Β¨ πΌ πΏπ π π‘5 β πΏπ π π‘6 = πΌ β
-
.
π‘5 β π‘6 = β
-
.
(π‘5 β π‘6)
Β¨ πΌ πΏπ π π‘5 = πΌ πΏπ π π‘6 β
-
.
π‘5 β π‘6 = πΏπ π π‘6 β
-
.
(π‘5 β π‘6)
Β¨ πΌ πΏπ π π‘5 = πΏπ πΌ π π‘5 β
-
.
(π‘5 β π‘6)
Β¨ This is indeed the convexity adjustment (again makes sense, it is the second order)
126
127. Luc_Faucheux_2020
Quick notes - VI
Β¨ Just to make it explicit.
Β¨ β«+3+&
+3+'
ππΉ(π π‘ ) = β«+3+6
+3+5 )9
)*
. ([). ππ(π‘) +
-
.
β«+3+6
+3+5 )!9
)!! π π‘ . (ππ).
Β¨ πΏπΉ =
)9
)*
. πΏπ +
-
.
.
)!9
)!! . (πΏπ)., which is the celebrated Ito lemma (chain rule)
Β¨ πΉ π = π.,
)9
)*
= 2π,
)!9
)*! = 2
Β¨ In the case of the simple Brownian motion: ππ = ππ
Β¨ πΏ(π.) = 2π. πΏπ +
-
.
. 2. πΏπ‘
Β¨ In the case of the Geometric Brownian motion (Hull) ππ = π. ππ
Β¨ πΏ π. = 2π. π. πΏπ +
-
.
. 2. π.. πΏπ‘ = 2 π. πΏπ + (π.). πΏπ‘
127
128. Luc_Faucheux_2020
Quick notes - VII
Β¨ So for the square function and in the case of a simple Brownian motion, we have
Β¨ πΏ(π.) = 2π. πΏπ +
-
.
. 2. πΏπ‘
Β¨ Or more rigorously:
Β¨ β«+3+&
+3+'
ππ. = π.(π‘5) β π.(π‘6) =
Β¨ π. π‘5 β π. π‘6 = β«+3+6
+3+5
2π π‘ . [ . ππ π‘ + β«+3+6
+3+5
ππ‘
Β¨ π. π‘5 β π. π‘6 = β«+3+6
+3+5
2π π‘ . ([). ππ π‘ + (π‘5 β π‘6)
128
129. Luc_Faucheux_2020
Quick notes - VIII
Β¨ Still rather crudely (but rigorous, as we will show in section V on the GBM)
Β¨ ππ = ππ
Β¨ πΌ π π‘5 = π π‘6
Β¨ π. π‘5 β π. π‘6 = β«+3+6
+3+5
2π π‘ . ([). ππ π‘ + π‘5 β π‘6
Β¨ πΌ π. π‘5 β π. π‘6 = πΌ{β«+3+6
+3+5
2π π‘ . ([). ππ π‘ + π‘5 β π‘6 }
Β¨ πΌ π. π‘5 β π. π‘6 = πΌ π‘5 β π‘6 = (π‘5 β π‘6)
Β¨ πΌ π. π‘5 = πΌ π. π‘6 + π‘5 β π‘6 = π. π‘6 + (π‘5 β π‘6)
Β¨ πΌ π. π‘5 = πΌ π π‘5
. + (π‘5 β π‘6)
Β¨ This is indeed the convexity adjustment (again makes sense, it is the second order)
Β¨ Since the square function is positively convex we would expect the convexity adjustment to
be positive
129