Skip to Main Content
Purpose

The purpose of this paper is to show the existence results for adapted solutions of infinite horizon doubly reflected backward stochastic differential equations with jumps. These results are applied to get the existence of an optimal impulse control strategy for an infinite horizon impulse control problem.

Design/methodology/approach

The main methods used to achieve the objectives of this paper are the properties of the Snell envelope which reduce the problem of impulse control to the existence of a pair of right continuous left limited processes. Some numerical results are provided to show the main results.

Findings

In this paper, the authors found the existence of a couple of processes via the notion of doubly reflected backward stochastic differential equation to prove the existence of an optimal strategy which maximizes the expected profit of a firm in an infinite horizon problem with jumps.

Originality/value

In this paper, the authors found new tools in stochastic analysis. They extend to the infinite horizon case the results of doubly reflected backward stochastic differential equations with jumps. Then the authors prove the existence of processes using Envelope Snell to find an optimal strategy of our control problem.

The main motivation of this paper is to prove the existence of an optimal strategy which maximizes the expected profit of a firm in an infinite horizon problem with jumps. More precisely, let a Brownian motion (Wt)t0 and an independent Poisson measure μ(dt,de) defined on a probability space (Ω,A,) and let F be the right continuous complete filtration generated by the pair (W,μ). Assume that a firm decides at stopping times to change its technology to determine its maximum profit. Let {1,2} be the possible technologies set. A right continuous left limited stochastic process X models the firm log value and a process (ξt,t0) taking its values in {1,2} models the state of the chosen technology. The firm net profit is represented by a function f, the switching technology costs are represented by c1,2 and c2,1,β>0 is a discount coefficient. Then, the problem is to find an increasing sequence of stopping times α^:=(τn^)n1, where τ^1=0, optimal for the following impulse control problem

where A denotes the set of admissible strategies. The Snell envelope tools show that the problem reduces to the existence of a pair of right continuous left limited processes (Y1,Y2). This idea originates from Hamadène and Jeanblanc [1]. Their results are extended to infinite horizon case and mixed processes (namely jump-diffusion with a Brownian motion and a Poisson measure). In [1] the authors considered a power station which has two modes: operating and closed. This is an impulse control problem with switching technology without jump of the state variable. They solved the starting and stopping problem when the dynamics of the system are the ones of general adapted stochastic processes.

The existence of (Y1,Y2) is established via the notion of doubly reflected backward stochastic differential equation. In this context, another interest of our work is to extend to the infinite horizon case the results of doubly reflected backward stochastic differential equations with jumps. Specifically, a solution for the doubly reflected backward stochastic differential equation associated to a stochastic coefficient g, a null terminal value and a lower (resp. an upper) barrier (Lt)t0(resp.(Ut)t0) is a quintuplet of F-progressively measurable processes (Yt,Zt,Vt,Kt+,Kt)t0 which satisfies

(1)

where μ˜ is the compensated measure of μ.

Another specificity of this paper is to promote a constructive method of the solution of a BSDEs with two barriers. Specifically, we do not assume the so called Mokobodski's hypothesis. Indeed this one is not so easy to check (see e.g. [2] in finite horizon and continuous case). Our assumptions are more natural and easy to check on the barriers in practical cases.

The notion of backward stochastic differential equation (BSDE) was studied by Pardoux and Peng [3] (meaning in such a case L=,U=+ and K±=0). To our knowledge, they were the first to prove the existence and uniqueness of adapted solutions, under suitable square-integrability and Lipschitz-type condition assumptions on the coefficients and on the terminal condition. Several authors have been attracted by this area that they applied in many fields such as Finance [1, 4–6], stochastic games and optimal control [7–10], and partial differential equations [11].

The existence and the uniqueness of BSDE solutions with two reflecting barriers and without jumps have been first studied by Cvitanic and Karatzas [4] (generalization of El Karoui et al. [5]) applied in Finance area by El Karoui et al. [6]. There is a lot of contributions on this subject since then, consisting essentially in weakening the assumptions, adding jumps and considering an infinite horizon.

The extension to the case of BSDEs with one reflecting barrier and jumps has been studied by Hamadène and Ouknine [8] considering a finite horizon T=1. The authors show the existence and uniqueness of the solution using the penalization scheme and the Snell envelope tools. They stress the connection between such reflected BSDEs and integro-differential mixed stochastic optimal control. The authors' assumptions are: the terminal value is a square integrable random variable, the drift coefficient function g(t,ω,y,z,v) is uniformly Lipschitz with respect to (y,z,v) and the obstacle (St)t1 is a right continuous left limited process whose jumps are totally inaccessible. Hamadène and Ouknine [12] deal with reflected BSDEs in finite horizon, the barrier being right continuous left limited and progressively measurable. Hamadène and Hassani [9] proved existence and uniqueness results of local and global solutions for doubly reflected BSDEs driven by a Brownian motion and an independent Poisson measure in finite horizon. The authors applied these results to solve the related zero-sum Dynkin game.

Here the model is inspired from the papers [5, 8–10, 12]. But their results do not apply directly to the situation which here requires an infinite horizon. Moreover we connect the reflected BSDE with the impulse control problem. All these papers provide a solution to the reflected BSDE problem which are here extended to the case of infinite horizon by adding a discount coefficient and imposing admissibility conditions of strategies. In this paper, the drift function is assumed to be Lipschitz and non-increasing in y. It is proved that the reflected BSDE solutions are limit of Cauchy sequences in appropriate complete metric spaces. Another interesting area is the one of oblique reflections, meaning a multimodal switching problem, see for instance [13–15]. El Asri [14] considers the same problem proposed by Hamadène and Jeanblanc [1] and extends it to the infinite horizon case without jump of the state variable, namely a power station which produces electricity and has several modes of production (the lower, the middle and the intensive modes). Naturally, the switching from one mode to another induces costs. The optimal switching problem is solved by means of probabilistic tools such as the Snell envelop of processes and reflected backward stochastic differential equations. Moreover their proofs are based on the verification theorem and the system of variational inequalities that we do not use.

Our purpose is similar to the one in [16], but instead of using Snell envelope and fixed point theorem as they do, here the two barriers case is solved using comparison theorem in one barrier case and adding some assumptions on the drift coefficient g.

This paper is composed of six sections. Section 2 presents the impulse control problem and describes the corresponding model. Section 3 introduces a pair of right continuous left limited processes (Y1,Y2) that allows one to exhibit an optimal strategy. Section 4 extends the doubly reflected BSDEs tools in the infinite horizon setting with jumps: first the case of a single barrier with general Lipschitz drift is solved, then a comparison theorem is proved, finally the uniqueness and the existence of solution for the doubly reflected BSDE under suitable assumptions are proved in case of drift non depending on state (y,z,v). Section 5 proves the existence of the required pair (Y1,Y2), and provides an application of these doubly reflected BSDE to a switching problem. Finally, with some simulations, the results allow to define an optimal strategy in Section 6. An appendix is devoted to an extension of Gronwall's lemma and some technical results.

Let (Ω,F,) be a filtered complete probability space with a right continuous complete filtration F=(Ft)t0, generated by the two following mutually independent processes:

  1. a1dimensional Brownian motion W=(Wt)t0.

  2. a point process Nt:=0tEeμ(ds,de) associated with a Poisson random measure μ on +×E, where E=\{0}, for some m1 endowed with its Borel σ-algebra , with compensator ν(dt,de)=dtλ(de), for a σ-finite measure λ on (E,),E(1|e|2)λ(de)<;μ˜:=μν denotes the compensated measure associated with μ.

Assume that a firm decides at random times to switch the technology in order to maximize its profit: the firm switches from the technology 1 to the technology 2 along a sequence of stopping times. An impulse control strategy is defined as a sequence α:=(τn)n1, where (τn)n1 is a sequence increasing to infinity of F-stopping times with τ1=0. The sequence (τn) models the impulse time sequence of the system as follows: for every n0,τ2n is the time when the firm moves from technology 1 to technology 2 and τ2n+1 is the time when the firm goes from 2 to 1. A càdlàg process (ξt) taking its values in {1,2} is defined by

(2)

Given K>0 and a measurable map γ:×E such that

(3)

the firm value is defined as St:=expXt,t0, where (Xt) is the càdlàg process

(4)

where X0 is the initial condition, b: and σ: are two measurable functions satisfying the K-Lipschitz condition (thus the sublinear growth condition).

The instantaneous net profit of the firm is given in terms of a positive function f, depending on the technology in use and the value of the firm. Let c2,1 and c1,2 be the positive switching technology costs, ci,j if one passes from technology i to technology j, with regular enough assumptions which will be specified later. One considers a discount coefficient β>0 then, the profit associated with a strategy α is defined as

and the expected profit of the firm is defined by

(5)
Definition 2.1.

The strategy α:=(τn)n1 is admissible if:

belong to L1(Ω,F,). We denote by A the set of admissible strategies.

Here, the impulse control problem is to prove the existence of an admissible strategy α^ which maximizes the expected profit:

(6)

The following notations will be used:

  1. T:={θ:Fstoppingtime},Tt:={θT:θt}.

  2. P:={ Fprogressivelymeasurablecàdlàgprocesses}.

  3. C2:={(Xt)t0P:suchthatE[supt0|Xt|2]<}.

  4. 1:={(Xt)t0P:suchthatE[0|Xt|2dt]<}.

  5. 2:={(Xt)t0P: such thatE[0|Xt|2dt]<}.

  6. Pd the σ algebra of F-predictable sets on Ω×[0,+[.

  7. L2:{V:Ω×[0,+]×E,Pdmeasurables.t.E[0E|Vs(e)|2λ(de)ds]<}

  8. Lp:=Lp(Ω,F,),p=1,2.

  9. p:=p(Ω,F,),p=1,2.

  10. Class [D] : {processesU:(Uθ,θT)uniformlyintegrable}.

Section 5 shows that the problem reduces to the existence of a pair of càdlàg processes (Y1,Y2) using the Snell envelope tools: this idea originates from Hamadène and Jeanblanc [1]. The existence of (Y1,Y2) is established in Section 5 via the reflected BSDEs tools. Indeed, the solution of the reflected BSDE corresponds to the value function of an optimal stochastic control problem and these processes allow to build an optimal switching strategy. We based on [17] to use the fundamental optimal control concepts.

Proposition 3.1.

Assume that there exist two right continuous left limited, regular (meaning that the predictable projection coincide with the left limit) -valued processes Y1=(Yt1)t0 and Y2=(Yt2)t0 of class [D] and satisfying the properties

(7)
(8)

where f(i,.) are positive functions satisfying 0eβsf2(i,Xs)dsL1,i=1,2. Then Y01=supαAK(α,1,x). Moreover, the strategy α^=(τn)n0 defined as follows:

is optimal for the impulse control problem (6).

The proof is based on the properties of the Snell envelope. The scheme of the proof is similar to the one in [18] and also [14,  Appendix A, p. 246] as soon as the processes Yi are regular. As a consequence of (7) and (8), remark that almost surely

(9)

In this section, the results from [10] are extended to infinite horizon reflected backward stochastic differential equations with general jumps, showing existence and uniqueness of an infinite horizon solution, imposing additional assumptions on the drift function and using appropriate estimates of the process Y. The following assumptions are done:

  1. (H1): A map g:Ω×[0,+[×1+d×L2(E,,λ;) which is F-progressively measurable and:

where the norm of L2(E,,λ;) is defined as v2:=Ev2(e)λ(de).

  1. (H1): An F-progressively measurable map g:Ω×[0,+[ such that 0eβsg2(s)dsL1,

  2. (H2): Let the barriers (Lt)t0 and (Ut)t0 be F-progressively measurable continuous real valued processes satisfying

To prove the existence of the solution for doubly reflected BSDE with jumps and infinite horizon, we first consider the case of a single barrier (Section 4.1) then a comparison theorem is proved in Section 4.2.

In this subsection, the case of infinite horizon reflected BSDE with one barrier and general jumps is considered.

Definition 4.1.

Let (eβ.g,L) be given. A solution of the reflected BSDE associated to (eβ.g,L) is a quadruplet of processes (Y,Z,V,K) satisfying for any t0:

  1. YC2, Z2 and VL2,

  2. almost surely

(10)
  • (3)

    almost surely LtYt,

  • (4)

    (Kt) is a non-decreasing process satisfying E[(0dKs)2]<,K0=0, and for any t

We then prove the following:

Theorem 4.2.

Let (eβ.g,L) satisfy Hypotheses (Hi),i=1,2. Then there exists a unique process (Y,Z,K,V) solution to the BSDE associated to (eβ.g,L).

Proof: (1) As a first step, the uniqueness of the solution is insured: if there exist two solutions, the proof of uniqueness is a standard one. For instance, look at Theorem 4.8 proof.

  • (2)

    Under the hypothesis E[supt(Lt)2]<,Theorem 2.1 [10] can be applied: there exists a quadruplet (YT,ZT,KT,VT) verifying YTC2,ZT2,VTL2, (actually restricted to t[0,T]) and tT:

(11)
(12)

Considering TS,S,T+, one has sT:

(13)

Applying Itô's formula to the process s(YsSYsT)2 between t and T yields

(14)

Using (YsSLs)dKsS=(YsTLs)dKsT=0 and LsYsS and YsT, one has

so we get

(15)

Considering the decomposition: g(s,YsS,ZsS,VsS)g(s,YsT,ZsT,VsT)=g(s,YsS,ZsS,VsS)g(s,YsT,ZsS,VsS)+g(s,YsT,ZsS,VsS)g(s,YsT,ZsT,VsS)+g(s,YsT,ZsT,VsS)g(s,YsT,ZsT,VsT), the Lipschitz property of the function g, the Cauchy-Schwarz inequality and the non-increasing property of the map yg(t,y,z,v) for any (t,z,v) and α>0 lead to

Thus for any α>0:

(16)

Remark that Δs(YTYS) includes the jumps of the Poisson measure μ. So

(17)

Then, since YS,YTC2,ZS,ZT2 and VS,VTL2, the third line in (16) is a martingale; thus taking the expectation of both sides with α=2C yields for any tT

(18)

On the one hand, Lemma 7.2 , we obtain for any ε>0,T and any S:

(19)

where ϕ(T):=1βg2eβT+1εEsupsT(Ls+)2+εE(TSdKsS)2 as defined in (61). Using Gronwall's lemma, inequality (19) becomes

On the other hand, we have

and from the Lipschitz property, we get

Using estimation (19), there exists a constant M, such that for any T,S:

If we subtract from ϕ(T) the term εE(TSdKsS)2 we get

(20)

This implies that the expectation on the left tends to zero uniformly when ε is chosen small enough: indeed, since supsLs+L2, by Lebesgue's monotone convergence EsupsT(Ls+)2 tends to 0 when T tends to infinity. Globally ϕ(T)0 when T tends to infinity and we obtain using (19) that the sequence (YT) is a Cauchy sequence which converges in L2(Ω) to the process Y. Thus Lemma 7.2 concludes that, t being fixed, (YtT,Tt) is a Cauchy sequence in L2(Ω,Ft,), its limit defines the Ft-measurable random variable Y(t,.). It is a family of random variables. We later prove that actually the limit Y is a process.

  • (3)

    Turning to Z and V, to deal with the convergence in 2 respectively in L2, An argument similar to (63) shows that the sequence (ZT) is a Cauchy sequence in 2, its limit defines a process Z which belongs to 2 and (VT) is a Cauchy sequence in L2, its limit defines a process V which belongs to L2.

  • (4)

    We now prove that there exists a process YC2 which is the limit of a Cauchy sequence in C2.

    (a) Coming back to (16), for all α>0, we get

The Burkholder-Gundy-Davis inequality gives the existence of a constant C1>0 such that

for all γ>0. Similarly

Gathering these bounds yields

(21)

Choosing α and γ such that 1Cαβ2C1γ>0, using Lemma 7.2 and the facts that (ZT,Tt) is a Cauchy sequence in 2, and (VT,Tt) is a Cauchy sequence in L2, then E[suptT(YtSYtT)2] goes to 0 when S and T go to infinity.

  • (5)

    Now one proves the other items of the proposition: Item (2) According to (4.1) for all t1<t2T

(22)

and due to the almost sure convergence of a subsequence of (YT,ZT,VT) and the continuity of the function g, the right hand side of Eqn (22) converges almost surely.

Thus t1t2dKs is defined as the L2 and almost sure limit of the right hand side of (22). Hence, for almost sure limit, we get the reflected BSDE (10).

Item (3) For any Tt, one has LtYtT, and using almost convergence of a subsequence, one deduces Item (3).

Item (4) The L2 convergence in (22) proves that tdKsL2. Moreover, for all T using (12), we get:

(23)

On the one hand, for fixed (ω,t)Ω×[0,T] the left continuous and right limited function sYsLs is the uniform limit on [0,t] of a sequence (fk(ω),k) of step functions:

We now deal with the successive bounds

(24)

For (ω,t) fixed above, for any ε>0 there exists N(ω,t) such that

so the first and third terms in (24) are bounded

(25)

Remark that limT(KtT+Kt)(ω)=2εKt(ω).

We now fix kN(ω,t), and we remark that for any step function h:

Thus when T goes to infinity the second term in (24) satisfies

(26)

For any ε, using (25) and (26) the limit of (24) when T goes to infinity is bounded by 2εKt(ω). This yields the fact that limT0t(YsLs)dKsT=0t(YsLs)dKs.

Finally using (23) we get

Thus

which goes to 0 when T goes to infinity according to the convergence of YT to Y in C2 and of KT in L2. So the proof of (4) is done.

In case of a deterministic function g, meaning g is defined on +××d, an alternative proof of Theorem 4.3 (under the same hypotheses) can be provided using penalization method, as for instance Section 6 in [6] concerning continuous case, but here directed by a pair Brownian motion-Poisson measure. We associate to (gk(s,y,z):=eβsg(s,y,z)+k(yLs)) where the function gk satisfies Assumption (H1), since gk is obviously non decreasing and uniformly Lipschitz, the solution (Yk,Zk,Vk) in (C2,2,L2) of the following BSDE

(27)

Since kgk is non decreasing, the standard comparison theorem proves that actually, for any fixed t(Ytk) is a non-decreasing sequence in L2, so it is almost surely and in L2 convergent to the random variable Yt:=limkYtk. Using similar arguments as those ones in (4.1) (Yk) is a Cauchy sequence in C2 so the limit defines the C2 process Y. Now it is standard [19] to prove the existence of a non decreasing process K such that

and the existence of Z,V(2,L2) such that

(28)

This alternative method allows us to prove the following result.

Proposition 4.3.

Under Hypotheses (H1,Hi,i=2), g being defined on +×Ω, one has

(29)

Proof: The uniqueness of the solution (step (i) in the proof of Theorem 4.2) insures that this solution is the limit of the penalized Eqn (27): Y is the limit of the non-decreasing sequence (Yk).

Reproducing Step 2 in the proof of Theorem 3.1 [16] leads for any k to

so (Ytk+0teβsg(s)ds)t is the Snell envelope of the process Jk:t0teβsg(s)ds+YtkLt which is increasing almost surely towards the process J:t0teβsg(s)ds+YtLt. Remark that both Jk and J are of class [D] since both are uniformly bounded with 0eβs|g(s)|ds+supt|Lt|L1.

Let us denote as SN(Y) the Snell envelope of process Y. Then Lemma A.1 in  Appendix [10, 12] allows to commute the increasing limit and the essential supremum: on the left hand side, YtkYt almost surely, on the right hand side SN(Jk)tSN(J)t which achieves the proof. ■

From now on, we consider a function g defined on +×Ω satisfying Assumption (H1).

The following is an extension of Lemma 2.4 in [20]: in our case g is defined only on +×Ω but the BSDE is directed by a mixed Brownian-Poisson process:

Lemma 4.4.

For n0,let (Yn,Zn,Vn) be the solution of the single barrier reflected BSDE associated to the barrier teβt|g(t)|n(yUt)+, where Ut=c2,1eβt and YTn=0,supt(Lt+)L2. Then almost surely for all t0,

Proof: The proof is similar to the one in [18].

The next step follows from Theorem 3.2 [20] or Proposition 4.12 [18].

Lemma 4.5.

Let (ρ,θ,V˜,Π) be the solution of the reflected BSDE associated to the barriers L and U:teβt|g(t)|βc2,1eβt. Then there exists a constant C such that

(30)
(31)

Proof: (1) By definition, we have

Using Itô's formula, one has

(32)

The last term on the right hand side of (32) is bounded: for any ε>0

Gathering these bounds and using Assumption (H1) yield

(33)

Let

Using extended Gronwall's Lemma 7.1 one has

(34)

Let us denote ψ(t):=φ(t)+εE[(tdΠs)2],ψ being a decreasing function.

(2)Coming back to (33) one has

and from (34) setting γ=1β:
(35)
Now one turns to the estimate of Π:
So
Using (34) and (35):
This yields (30) and (31), as soon as ε is chosen such that

The following proposition is an extension of Theorem 2.2 in [10] to infinite horizon.

Proposition 4.6.

Assume that (Y,Z,V,K) and (Y,Z,V,K) are solutions of the reflected BSDE with jumps (10) associated with (g,L) and (g,L), satisfying Assumptions (Hi,i=1,2),g being defined on +×Ω××d,g being defined on +×Ω××d×L2, and assume in addition that

Then, YtYt-almost surely.

If moreover g is defined on +×Ω××d, then KtKtt0,p.s.

Proof: Theorem 2.2 in [10] proves that for any T,almost surely, tT,YtTYtT and in the case where f does not depend on v, dKtTdKtT.

Theorem 4.2 proof gives us the almost sure convergence of YT,KT,Y'T,KT, so the inequalities are preserved when T goes to infinity.■

Here we summarize the results concerning the reflected BSDEs: In case of a function g defined on +×Ω satisfying (H1), the functions

teβtg(t)n(yUt)+,eβt|g(t)|n(yUt)+,eβt|g(t)|βc2,1eβs satisfy Hypothesis (H1): Lipschitz property and non increasingness with respect to y.

  1. The F-progressively measurable process (Yn,Zn,Vn,Kn) which is the unique solution of the reflected BSDE associated with (eβt|g(t)|n(yUt)+,L) satisfies

(36)
  • (2)

    The F-progressively measurable process (ρ,θ,V˜,Π) which is the unique solution of the reflected BSDE associated with (eβt|g(t)|E[supst|us||Ft],L) satisfies

(37)

Thank to Lemma 4.4, one has the following inequalities:

So as a consequence of Proposition 4.6, one has

(38)

where Yn and Kn are introduced in (27). Finally, Lemma 4.5 proves that for all t and all n,

(39)

Now one considers the problem of reflection with respect to two barriers L and U in the case of drift g being defined on +×Ω and satisfying (H1).

Definition 4.7.

Let (eβ.g,L,U) be given. A solution of the double reflected BSDE associated to (eβ.g,L,U) is a quintuplet of processes (Y,Z,V,K+,K) satisfying for any t0:

  1. YC2 and Z2,VL2,

  2. almost surely

(40)
  • (3)

    almost surely LtYtUt,

  • (4)

    (Kt±) are non-decreasing processes satisfying E[(0dKs±)2]< and for any t

Theorem 4.8.

Let (eβ.g,L,U) satisfying Hypotheses (H1),(H2), then there exists a unique solution (Y,Z,K+,K,V) to Eqn (4.7).

The proof is given in the following subsections.

4.3.1 Uniqueness of the solution

As a first result, one proves the uniqueness of solution when it exists.

proposition 4.9.

If there exists a solution of (40) satisfying Items (1) to (4), it is unique.

Proof: The proof of uniqueness is detailed, even if it is really standard, for stressing the role of the assumption Ls<Us. One assumes that there exist two solutions (Yi,Zi,Vi,K±i),i=1,2. Then they satisfy

One has

Using Item (4) (YsiLs)dKs+i=0 and (YsiUs)dKsi=0, the last line satisfies

(41)

since LsYsiUs.

It follows that for any t

So Y1=Y2,Z1=Z2, V1=V2 and as a consequence K+1K1=K+2K2. Thus there exists a finite variation process h=K+1K+2=K1K2 satisfying h(0)=0,(YsLs)dhs=0 and (YsUs)dhs=0. But the assumption Ls<Us contradicts these equalities if h0 : indeed as soon as dhs0,(YsLs)=0 and (YsUs)=0 so Ls would be equal to Us. This concludes the proof of uniqueness.

4.3.2 Existence of the solution for double barrier reflected BSDE with jumps

Here one uses the so called penalization method: Let g satisfying (H1) be the drift parameter and introduce h(t,y)=eβtg(t)n(yUt)+ which obviously satisfies (H1).

So according to Theorem 4.2, Hypothesis (H2) still being in force, for each n*, there exists a unique solution (Yn,Zn,Vn,Kn) of the reflected BSDE associated with (eβtg(t,ω)n(yUt)+,L), meaning

(42)

From Proposition 4.6, the sequence (Yn,n1) (resp Kn,n1) is non increasing (resp. non-decreasing), let us denote Y,K+ their almost sure limits, consequence of monotonicity.

From the inequality LtYtYt1, it follows that Yt=limnYtn belongs to L2 for all t.

The proof of Theorem 4.8 is done in five steps.

  • Step 1: There exists a constant C0 such that n0 and t0, one has

Its formula yields

(43)

By definition of the solution

Then, since LsYsn,YsnLsnYsn(YsnUs)+dsnLs(YsnUs)+ds , so t,n:

Thus, one has

Using the Cauchy-Schwarz inequality, for any ϵ>0, one has for any t and n

On the other hand, with (38), Lemmas 4.4 and 4.5, for any t and n one has:

(44)

Similarly for any c1>0 one has

(45)

Note that the last line in the right hand side of (4.3) admits a zero expectation, and embedding the inequalities (44), (45) and (17) in the expectation of (4.3):

(46)

where k is the function defined as follows:

So one has

Gronwall's Lemma 7.1 is now used with D=E[c110eβs|g(s)|2ds+ϵ(k(0))2+ϵ1sups0(Ls)2] and ψ(s)=c1eβs so

and

Then one has a bound for (46)

(47)

This bound and (44) end the proof.

  • Step 2: limnYtnUt and limnE[supt0|(YtnUt)+|]=0.

The proof is an adaptation of the one given in Step 3 [20, p. 169].

Let (Y˜n,Z˜n,V˜n,K˜n) be the solution of the reflected BSDE with jumps associated to (eβsg(s)n(yUs),L): so since eβsg(s)n(yUs)+eβsg(s)n(yUs) and both applications (s,y)eβsg(s)n(yUs)+ and eβsg(s)n(yUs) satisfy obviously (H1),Proposition 4.6 implies that -a-s YnY˜n and dK˜ndKn.

Let T< and ν be a stopping time such that: tν<. Itô's formula is applied to the process (ensY˜sn,s0) between ν and Tν:

This yields to

Using that, t,LtY˜tnY˜t1L1, one has limTen(Tν)Y˜Tνn=0. This yields for any n:

Since U is right continuous then almost surely and in L1

In addition, one has

then due to Assumption (H1)

Finally with (38)

This last bound νen(sν)dΠs goes to 0 when n goes to infinity using Lebesque monotonous convergence Theorem. Consequently

Therefore limnYνnlimnY˜νnUν P-a.s.

From this and “Section Theorem” [21, p. 220], it follows that, a.s.,YtUt,t and then (YtnUt)+0 almost surely.

We now denote by Xp the predictable projection for any X. Since YnY, then YnpYp and YpUp. So we deduce that YnpYpUp, the semi-martingale U is regular and Lemma 7.3 proves that the processes Yn are regular so YnU= YnpUpYpUp0. It follows that limn(YtnUt)+=0 for all t almost surely.

Consequently, from a weak version of the Dini theorem [22, p. 202], one deduces that supt0(YtnUt)+0 a.s. as n. Finally Lebesgue dominated convergence Theorem implies

  • Step 3: There exist an F-adapted process Z=(Zt)t0 and an F-predictable process V=(Vt)t0 such that

By Itô's formula one has for any pn0 and for all t,

(48)

where Ktn denotes n0t(YsnUs)+ds.

Since pn, then YpYn,dKndKp, so

According to (7) in [20] (YspYsn)(YsnUs)+(YspUs)+(YsnUs)+, so

(49)

Look at sups(YspUs)+0n(YsnUs)+ds, product of sups(YspUs)+ going to 0 when p in L2 (Step 2) and of 0n(YsnUs)+ds which is for all n bounded by the integrable random variable 0[eβsβc1,0]ds (see Lemma 4.4):

(50)

The second term in (49) is symmetrical and the sum is going to 0 in L1.

Finally, taking the expectation of the left hand side in (48) and using (17)

(51)

It follows that (Zn)n0 and (Vn)n0 are Cauchy sequences in complete spaces then there exist processes Z and V, respectively F-progressively measurable and P-measurable such that the sequences (Zn)n0 and (Vn)n0 converge respectively toward Z in 2 and V in L2.

  • Step 4: limn,pE[supt0|YtnYtp|2]=0 so limnYn defines a process in C2.

Using Yn and Yp definitions, np (so dKndKp) and applying Itô's formula between 0 and t to the process t(YtnYtp)2 one has:

(52)
  • (1)

    First look at

For any c>0, the right hand side of this inequality is smaller than

  • (2)

    Using (49), the expectation of the last term in (52) is bounded:

which actually goes to 0 when n and p go to infinity using (50).

Concerning the supremum with respect to t of the absolute value of second line in (52) the Burkholder-Davis-Gundy and Cauchy-Schwarz inequalities are used: there exists a universal constant C1 such that for any constant c>0:

Similarly one has t0tE[(YsnYsp)(Vsn(e)Vsp(e))]μ˜(ds,de) is an F-martingale (see [8], p. 4) and once again the Burkholder-Davis-Gundy and Cauchy-Schwarz inequalities are used:

Using that supst|Ys|supst|Ys| and gathering all these bounds, it yields for any t:

Choosing c such that c(1+2C1)<1 and using the limit (50), the processes Zn, Vn are Cauchy sequences respectively in 2,L2 and the almost surely convergent monotonous sequences (Y0n),(0dKsn), (0d(Kc)sn) are Cauchy sequences in L2 so is the sequence (sΔsKn=0dKsn0d(Kc)sn). Thus the sequence (Yn) is a Cauchy sequence in C2. This concludes Step 4 and proves item (1):

Moreover, since for all tYt is an almost sure limit of Ytn and (Yn) is C2 Cauchy sequence, one has two progressively measurable cadlag processes which are modification of each other so that Y=(Yt)t0 is an F-adapted right continuous left limited process belonging to C2 .

  • Step 5: Existence of K, Item (4), Item (3)

By definition of Kn, for any n0 and t0:

(53)

So, the right hand side of (53) converges almost surely and in L2 to

(54)

and the non-decreasing process K can be defined almost surely and in L2:

This proves Item (2) and the existence of the non-decreasing process K in L2 such that 0tdKsL2.

Then, using the differential of Equation (53) and multiplying by YsUs yield almost sure convergence:

The right hand side is almost surely finite since it is equal to

Remark that the sequence (YsUs)(YsnUs)+ goes almost surely to (YsUs)(YsUs)+, and multiplied by n the limit cannot be finite unless (YsUs)+=0, thus Item (4) is proved:

(55)

Finally Item (3) is a consequence of

  1. the fact LtYtn for any n and t, and the almost sure convergence of sequence (Ytn), so LtYt,

  2. above (55) gives YtUt.

In this section we use Proposition 3.1, and Theorem 4.8 with g:(t,ω)f(1,Xt(ω))f(2,Xt(ω)) satisfying Assumption (H1), a null terminal value, and barriers Lt=c1,2eβt0,Ut=c2,1eβt0, satisfying Assumptions (H2). There exists a progressively measurable process (Y,Z,K+,K,V) such that:

So the main result can be proved: the existence of processes (Y1,Y2) introduced in Proposition 3.1. This is the extension of Theorem 3.2 [1, p. 186] to the infinite horizon set up with jumps.

Theorem 5.1.

Assume that f(1,Xt) and f(2,Xt) are positive, tf(i,Xt),i=1,2, satisfy (H1), Lt:=eβtc1,2 and Ut:=eβtc2,1 satisfies (H2). Then there exists a couple of -valued processes (Yt1,Yt2)t0 satisfying the assumptions in Proposition 3.1, in particular (7) and (8) meaning:

Proof: Theorem 4.8 is applied with g(t)=f(1,Xt)f(2,Xt),Lt=c1,2eβt0Ut=eβtc2,1. Since the random variables t+dKs± are integrable and f(i,Xs),i=1,2 satisfy (H1), the following processes will be checked to satisfy Proposition 3.1 assumptions: Yi are positive right continuous left limited regular processes of class [D] satisfying (7) and (8). The following processes are proposed:

  1. First one remarks that Yti0 as conditional expectation of non-negative random variables.

  2. Second

are sum of an F-martingale minus a right continuous left limited finite variation process so these processes are right continuous left limited.

  • (3)

    Third one has E[supt0|Yti|2]<,i=1,2: indeed, using the facts that f(i,.) and 0tdKs± are positive,

The facts that 0dKs±L2, Assumption (H1) and (0eβsf(i,Xs)ds)21β0eβsf2(i,Xs)ds belongs to L1, proves that the martingale Mi which bounds Yi is uniformly square integrable. Thus Burkholder-Davis-Gundy inequality applied to this square integrable martingale M proves that E[supt0|Yti|2]<. As a byproduct, the process Yi is of class [D] since for any stopping time θ, 0Yθisupt0|Yti|L2.

  • (4)

    Fourthly Yi are regular using the same argument as in [12]: the regularity of Yi is equivalent to the regularity of K±, and this one is equivalent to the regularity of Y defined by the system (S).Lemma 7.3 in  Appendix insures this property.

One now turns to the checking of (7) and (8). Theorem 4.34 [23, p. 189], applied to the semi martingale Ht:=Wt+Nt=Wt+0tEeμ(ds,de), with characteristics C=1,ν(ω;dt×de)=dtλ(de) and ΔBt(ω)=ΔtH(ω)=ΔtN(ω), there exists a couple of F-progressively measurable processes (Z1,V1)2×L2 such that for any t:

Using the third inequality of system (S), one has Ytc1,2eβt, and replacing Yt by Yt1Yt2, one has Yt1c1,2eβt+Yt2. Similarly, the fourth equality of system (S), meaning 0.(Yt+eβtc1,2)dKt+=0, replacing Yt by Yt1Yt2 shows

As a result, the quadruplet (Y1,Z1,V1,K+) satisfies the single barrier reflected BSDE:

Then Equality (29) in Proposition 4.3 is applied with Lt=c1,2eβt+Yt2. Since E[supt0|Yt2|2]<, the hypothesis E[supt0(Lt)2]< is satisfied and one has

Similarly, using the third inequality of system (S), one has Ytc2,1eβt, and once again Equality (29) is used with Lt=c2,1eβt+Yt1. Since E[supt0|Yt1|2]<, the hypothesis E[supt0(Lt)2]< is satisfied and one has

hence the existence of the asked couple (Y1,Y2).

Remark 5.2.

Since Yt=Yt1Yt2,t0, according to Proposition 3.1, an optimal strategy α^=(τn)n0 is defined by

Recall that the optimal strategy α^=(τ^n)n0 is completely defined by the process Y and is obtained when Y reached successively the barriers L and U. As a result, solving numerically this strategy amounts to simulating sample path trajectories of the process Y. In recent years, several techniques have been proposed for the numerical solution of the process Y (for example the quantization algorithm, Malliavin calculus). Here the approximation by regression is chosen, which is well explained in [24, 25]. Our method is totally different from the method used in [26] which is based on the approximation of the Brownian and Poisson processes by a random walk. Recall once again that here the process X is the diffusion (4). For this application, a simple case of stochastic differential equation with jump is considered: Let b,σ are constant drift and diffusion coefficients; μ˜(ds,de) gives an information about the jump: the probability of the jump happening at time t and the relative amplitude of the jump. It will be represented by a log-normal random variables, λ is the yearly average of the number of jumps. Thus the firm log-value is modeled as

By using the classical Euler scheme for sample path trajectories of the process X where λ=3,x0=1 and T=1, one has: (see Figures 1 and 2).

Figure 1

b=0.01,σ=0.2

Figure 2

b=1,σ=2

Let us now focus on our problem: namely, how to simulate the process Y, and therefore the optimal strategy. Recall that

which satisfy Hypotheses (H1) and (H2).

First of all, when t tends to infinity, Yt goes to 0, so a finite horizon T should be fixed such that ti=iTn,i=n,,0. More specifically, below the numerical samples show that as soon as t1, the length of interval (Lt,Ut) is negligible.

Yt(Lt,Ut) so the error is bounded by UtLt, the order of which being eβt.

To approximate the backward component Y, the following discretization approximation scheme is introduced, for 0=t0<t1<<tn=T:

(56)

where Eti=E[.|Fti]. To approximate the conditional expectation, here is adopted the Longstaff-Schwarz algorithm [25] which uses a regression technique (Least-Square Monte Carlo method). Taking the parameters β=0.5 , X0=1,b=1,σ=2, and the profits/costs functions

the evolution of Y is observed. Previously all the assumptions have to be checked:

  • (1)

    One notes that with Xt=bt+σWt+Ntλt, : Assumption (H1) is satisfied since f(i,x)=a+x±, so E[(a+Xt±)2]2a2+2E[(Xt2)]2a2+6(b2t2+σ2t+λt) thus E[0eβtf2(i,Xs)ds]0eβt[2a+6(b2t2+σ2t+λt)]dt<.

Interpretation: Recall once again that the optimal strategy α^=(τ^n)n0 is obtained when Y reached successively the barriers L and U. In Figures 3 and 4, the costs are higher than in Figures 5 and 6. In Figures 3 and 4, it could be not interesting to switch the technology. It is preferable that the firm takes the precaution of keeping long enough the technology 1, which will enable to obtain suitable expected profit.

Figure 3

Lt=0.5e2t,Ut=0.4e2t

Figure 3

Lt=0.5e2t,Ut=0.4e2t

Close modal
Figure 4

Lt=0.5e2t,Ut=0.4e2t

Figure 4

Lt=0.5e2t,Ut=0.4e2t

Close modal
Figure 5

Lt=0.02e2t,Ut=0.01e0.2t

Figure 5

Lt=0.02e2t,Ut=0.01e0.2t

Close modal
Figure 6

Lt=0.02e2t,Ut=0.01e2t

Figure 6

Lt=0.02e2t,Ut=0.01e2t

Close modal

In the case of reasonable costs, as in Figures 5 and 6, the firm can switch the technology more often: actually at times τ00.15 and τ10.97 (Figure 5), respectively in Figure 5, the firm can switch the technology at times τ00.05 and τ10.23.

The authors would like to thank Monique Jeanblanc for her constructive comments and suggestions to improve the quality of our work.

[1]
Hamadène
S
,
Jeanblanc
M
.
On the starting and stopping problem: application in reversible investments
.
Math Oper Res.
2007
;
32
(
1
):
182
-
92
.
[2]
Hamadène
S
,
Hassani
M
,
Ouknine
Y
.
Backward SDEs with two rcll reflecting barriers without Mokobodski's hypothesis
.
Bull Sci Math.
2010
;
134
:
874
-
99
.
[3]
Pardoux
E
,
Peng
SG
.
Adapted solution of a backward stochastic differential equation
.
Syst. Control Lett.
1990
;
14
:
55
-
61
.
[4]
Cvitanic
J
,
Karatzas
I
.
Backward stochastic differential equations with reflection and Dynkin games
.
Ann Probab.
1996
;
24-4
:
2024
-
56
.
[5]
El Karoui
N
,
Pen
S
,
Quenez
MC
.
Backward stochastic differential equations in finance
.
Math Finance.
1997
;
7
(
1
):
1
-
71
.
[6]
El Karoui
N
,
Kapoudjian
C
,
Pardoux
E
,
Peng
S
,
Quenez
MC
.
Reflected solutions of backward SDE's and related obstacle problems for SDE's
.
Ann Probab.
Chicago: Institute of Mathematical Statistics
.
1997
;
25
(
2
):
702
-
37
.
[7]
Hamadène
S
,
Lepeltier
JP
,
Wu
Z
.
Infinite horizon reflected backward stochastic differential equations and applications in mixed control and game problems
.
Probab Math Stat.
1999
;
19
(
2
):
211
-
34
.
[8]
Hamadène
S
,
Ouknine
Y
.
Reflected backward stochastic differential equation with jumps and random obstacle
,
Electron J Probab.
2003
;
8
(
2
):
1
-
20
.
[9]
Hamadène
S
,
Hassani
M
.
BSDEs with two reflecting barriers driven by a Brownian and a Poisson noise and related Dynkin game
,
Electron J Probab.
2006
;
11
(
5
):
121
-
45
.
[10]
Hamadène
S
,
Wang
H
.
BSDE's with two RCLL obstacles driven by Brownian motion and Poisson measure and a related mixed zero-sum game
.
Stoch Process Appl.
2009
;
119
(
9
):
2881
-
912
.
[11]
Pardoux
E
,
Peng
SG
. Backward stochastic differential equations and quasilinear parabolic partial differential equations. In:
Rozovskii
B.
and
Sowers
R.
(Eds).
Stochastic differential equations and their applications, Lect. Not. Cont. Inf. Sci.
Springer
.
1992
;
176
:
200
-
17
.
[12]
Hamadène
S
,
Ouknine
Y
.
Reflected backward SDEs with general jumps
.
Teor Veroyatnost i Primenen.
2015
;
60-22
:
357
-
76
.
[13]
Chassagneux
JF
,
Elie
R
,
Kharroubi
I
.
Discrete time approximation of multidimensional BSDEs with oblique reflections
,
Ann Appl Probab.
2012
;
22
:
971
-
1007
.
[14]
El Asri
B
.
Optimal multi-modes switching problem in infinite horizon
.
Stochast Dynam.
2010
;
10-2
:
231
-
61
.
[15]
Hu
Y
,
Tang
S
.
Multi-dimensional bsde with oblique reflection and optimal switching
.
Probab Theor Relat Field.
Springer Verlag.
2010
;
147
(
1-2
):
89
-
121
.
[16]
Akdim
K
,
Ouknine
Y
.
Infinite horizon reflected backward SDEs with jumps and right continuous left limited obstacle
.
Stochastic Anal Appl.
2006
;
24
:
1239
-
61
.
[17]
El Karoui
N
.
Les aspects probabilistes du Contrôle Stochastique
.
Lect Notes Math
.
Berlin
:
Springer-Verlag
;
1981
:
876
.
[18]
Amami
R
.
Application of doubly reflected BSDEs to an impulse control problem
.
Optim J Math Program Oper Res.
2013
;
62
(
11
):
1525
-
52
.
[19]
Essaky
EH
.
Reflected backward stochastic differential equation with jumps and right continuous left limited obstacle
.
Bull Sci Math.
2008
;
132
:
690
-
710
.
[20]
Hamadène
S
,
Lepeltier
JP
,
Matoussi
A
.
Double barrier reflected backward SDE's with continuous coefficient
.
Pitman Res Notes Math Ser.
1997
;
364
:
161
-
75
.
[21]
Dellacherie
C
,
Meyer
PA
.
Probabilités et Potentiel
.
Chap. I-IV
.
Paris
:
Hermann
;
1980
.
[22]
Dellacherie
C
,
Meyer
PA
.
Probabilités et Potentiel
.
Chap. V-VIII
.
Paris:
Hermann
;
1982
.
[23]
Jacod
J
,
Shiryaev
AN
.
Limit Theorems for Stochastic Processes
. (2nd ed.)
Springer-Verlag
;
2003
.
[24]
Huynh
HT
,
Lai
VS
,
Soumaré
I
.
Stochastic simulation and applications in finance with Matlab programs
.
John Wiley & Sons
;
2008
.
[25]
Longstaff
F
,
Schwartz
E
.
Valuing American options by simulation: a simple least-squares
.
Rev Financ Stud.
Spring, Oxford University.
2001
;
1-14
:
113
-
47
.
[26]
Dumitrescu
R
,
Labart
C
.
Numerical approximation of doubly reflected BSDEs with jumps and RCLL obstacles
.
J Math Anal Appl.
Elsevier.
2016
;
442
(
1
):
206
-
43
.
[27]
Abidi
H
,
Amami
R
,
Pontier
M
.
Infinite horizon impulse control problem with continuous costs, numerical solutions
.
Stochastics.
2017
;
Taylor & Francis
,
89
(
6–7
):
1039
-
60
.
[28]
Abidi
H
,
Amami
R
,
Pontier
M
.
Infinite horizon impulse control problem with jumps using doubly reflected BSDEs
:
Preprint, HAL Archives-ouvertes.fr
,
Available from:
https://hal.archives-ouvertes.fr/hal-01547004v1/document.
[29]
Chesney
M
,
Jeanblanc
M
,
Yor
M
.
Mathematical methods for financial Markets
:
Springer
;
2009
.

For sake of completeness, references being out of our knowledge, here is provided an extension of Gronwall's lemma.

Lemma 7.1. Let g and ψ be positive functions, let D be a positive constant satisfying t>0f(t)D+tψ(s)f(s)ds, then

  1. if ψL1(+),t,f(t)Dexptψ(s)ds,

  2. if D=0, then f(t)=0.

Lemma 7.2. Assume that f and L satisfy respectively (H) and (H2). let (Y,Z,K) be the solution of the RBSDE: YT=0,

where YC2, Z2, LtYt,dK. is a positive measure such that E(0TdKs)2< and tTeβs(YsLs)dKs=0,a.s. Then,

(57)

where ϕ(t):=1β||f||2eβt+1εEsupst(Ls+)2+εE(tTdKs)2,

(58)

and

Proof. Ito's formula and tT(YsLs)dKs=0 show

(59)

Using the Lipschitz property of g, we obtain

(60)

It follows that

Moreover, for any ε>0:

(we use 2ab1εa2+εb2). Applying Gronwall's lemma (see Lemma 7.1) to bound tE[Yt2] with ψ(t)=(4C2+2C+1)eβt and

(61)

Since ϕ is decreasing, we get

(62)

Using (60) and (62), we get:

(63)

where H=(4C2+2C+1)exp(4C2+2C+1β). Since ϕ is decreasing, we get

Similarly we get

Lemma 7.3. The solutions of the reflected BSDE (Theorem 4.2) and of the double reflected BSDE (Theorem 4.8) are regular.

Proof: Let T be a finite stopping time and (Tn) be a non decreasing sequence of stopping times going to T. Using [VI 50 p. 125] [22], a sufficient and necessary condition for Y to be “regular” (meaning Y=Yp) is

If the process Y is a solution to reflected BSDE, we get

So a sufficient condition is: for any Fpredictable stopping time τ,E[ΔτK]=0. Under Assumption (H2) this condition is satisfied since under these hypotheses K± are continuous.

Published in Arab Journal of Mathematical Sciences. Published by Emerald Publishing Limited. This article is published under the Creative Commons Attribution (CC BY 4.0) licence. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial and non-commercial purposes), subject to full attribution to the original publication and authors. The full terms of this licence may be seen at http://creativecommons.org/licences/by/4.0/legalcode

or Create an Account

Close Modal
Close Modal