ll-posedness of the inverse problem and sparse noisy data are two major challenges in the modeling of high-dimensional spatiotemporal processes. We present a Bayesian inference method with a strongly regularized posterior to overcome these challenges, enabling joint state-parameter estimation and quantifying uncertainty in the estimation. We demonstrate the method on a physically motivated nonlinear stochastic partial differential equation arising from paleoclimate construction.