Fast R implementation of Gillespie's Stochastic Simulation Algorithm

⛓️ Teaching material on Markov processes

🔁 Stationary distributions for arbitrary finite state Markov processes, including specializations for the Moran, Wright-Fisher, and other processes, exact (when possible) and approximate computations

Modeling population movements within neighborhoods in Brooklyn using a Markov process

Simulate and visualize Kendall random walks and related distributions. Available on CRAN

A book about Markov processes

String generator based on Markov process

MATLAB implementation of all the Operations Research algorithms and problems solved by me.

Random word generation using Random Markov Processes

🦜 DISCOTRESS 🦜 is a software package to simulate and analyse the dynamics on arbitrary Markov chains

Learn to get started using DISCOTRESS with these tutorials! Then apply to your own Markov chains in ecology 🦜🌴 economics 💸📈 biophysics 🧬🦠 and more!

Kalman Filter algorithm simulation with Markov process for state estimation.

Academic random processes couse

Implementation of a Denoising Diffusion Probabilistic Model with some mathematical background.

An Open Source Tool for Analyzing Discrete Markov Chains.

A package for temporal point process modeling, simulation and inference (unmaintained)

a spark version of probability suffix tree based on markov process

Gevo (Graph EVOlution) - Python implentation of Markov process simulations on model graphs.

Maximum Entropy (MaxEnt) parameter inference in biological networks.

Python code for posterior sampling of a semi-Markov Jump Process