A discrete-time stochastic process is a collection of random variables indexed over a countable set, usually time points separated by equal intervals. In other words, in a discrete-time stochastic process, events occur at fixed, distinct time intervals.
On the other hand, a continuous-time stochastic process is defined over an uncountable set, like the real line or an interval. In a continuous-time stochastic process, events can occur at any point within the continuous time interval.
Here are their mathematical notations:
Discrete-time stochastic process {Xn},Β nββββ, where Xn is the value of the process at time n.
Continuous-time stochastic process {Xt},Β tβββ[0,βT], where Xt is the value of the process at time t.
Examples:
1. Discrete-time stochastic process: Random walk
A random walk is a simple discrete-time stochastic process where at each time step n, the process moves either up or down by a random amount. A one-dimensional random walk can be defined as:
Xnβ=βXnβ
ββ
1β
+β
ΞΎn
Here, Xn is the position of the walk at time n, and ΞΎn is a random variable representing the step, which can take values β Β±β 1 with equal probability.
2. Continuous-time stochastic process: Brownian motion
A Brownian motion or Wiener process is a widely used continuous-time stochastic process for modeling random behavior. It is defined by the following properties:
- X0β=β0, the process starts at time tβ=β0 with an initial value of 0.
- Independent increments: For any 0ββ€βsβ<βtββ€βT, the increment Xtβ ββ Xs is independent of the past values {Xuβ:βuββ€βs}.
- Normally distributed increments: Xtβ ββ XsββΌβπ©(0,βΟ2(tβ ββ s)) (i.e., the distribution of the increment is normal with a mean of 0 and variance proportional to the time difference).
- Continuous paths: The sample paths of the process (the realizations of Brownian motion) are continuous in t.
In conclusion, discrete-time and continuous-time stochastic processes differ in the way they are indexed, with the former being indexed by countable sets and the latter by uncountable sets (usually time intervals). Examples include random walks (discrete-time) and Brownian motion (continuous-time).