TY - JOUR
T1 - Bayesian geophysical inversion using invertible neural networks
AU - Zhang, Xin
AU - Curtis, Andrew
N1 - Accepted manuscript no embargo.
PY - 2021/7/1
Y1 - 2021/7/1
N2 - Constraining geophysical models with observed data usually involves solving nonlinear and non-unique inverse problems. Mixture density networks (MDNs) provide an efficient way to estimate Bayesian posterior probability density functions (pdf's) that represent the non-unique solution. However it is difficult to infer correlations between parameters using MDNs, and in turn to draw samples from the posterior pdf. We introduce an alternative to resolve these issues: invertible neural networks (INNs). These are simultaneously trained to represent uncertain forward functions and to solve Bayesian inverse problems. In its usual form, the method does not account for uncertainty caused by data noise and becomes less effective in high dimensionality. To overcome these issues, in this study we include data noise as additional model parameters and train the network by maximising the likelihood of the data used for training. We apply the method to two types of imaging problems: 1D surface wave dispersion inversion and 2D travel time tomography, and compare the results to those obtained using Monte Carlo and MDNs. Results show that INNs provide comparable posterior pdfs to those obtained using Monte Carlo, including correlations between parameters, and provide more accurate marginal distributions than MDNs. After training, INNs estimate posterior pdfs in seconds on a typical desktop computer. Hence they can be used to provide efficient solutions for repeated inverse problems using different data sets. Even accounting for training time, our results also show that INNs can be more efficient than Monte Carlo methods for solving inverse problems only once.
AB - Constraining geophysical models with observed data usually involves solving nonlinear and non-unique inverse problems. Mixture density networks (MDNs) provide an efficient way to estimate Bayesian posterior probability density functions (pdf's) that represent the non-unique solution. However it is difficult to infer correlations between parameters using MDNs, and in turn to draw samples from the posterior pdf. We introduce an alternative to resolve these issues: invertible neural networks (INNs). These are simultaneously trained to represent uncertain forward functions and to solve Bayesian inverse problems. In its usual form, the method does not account for uncertainty caused by data noise and becomes less effective in high dimensionality. To overcome these issues, in this study we include data noise as additional model parameters and train the network by maximising the likelihood of the data used for training. We apply the method to two types of imaging problems: 1D surface wave dispersion inversion and 2D travel time tomography, and compare the results to those obtained using Monte Carlo and MDNs. Results show that INNs provide comparable posterior pdfs to those obtained using Monte Carlo, including correlations between parameters, and provide more accurate marginal distributions than MDNs. After training, INNs estimate posterior pdfs in seconds on a typical desktop computer. Hence they can be used to provide efficient solutions for repeated inverse problems using different data sets. Even accounting for training time, our results also show that INNs can be more efficient than Monte Carlo methods for solving inverse problems only once.
U2 - https://agupubs.onlinelibrary.wiley.com/doi/10.1029/2021JB022320?af=R
DO - https://agupubs.onlinelibrary.wiley.com/doi/10.1029/2021JB022320?af=R
M3 - Article
SN - 2169-9313
VL - 126
JO - Journal of Geophysical Research. Solid Earth
JF - Journal of Geophysical Research. Solid Earth
IS - 7
M1 - e2021JB022320
ER -