Toggle Main Menu Toggle Search

Open Access padlockePrints

Statistical Disaggregation --- a Monte Carlo Approach for Imputation under Constraints

Lookup NU author(s): Professor Hongsheng DaiORCiD, Professor Murray Pollock

Downloads


Licence

This work is licensed under a Creative Commons Attribution 4.0 International License (CC BY 4.0).


Abstract

Equality-constrained models naturally arise in problems in which measurements are taken at different levels of resolution. The challenge in this setting is that the models usually induce a joint distribution which is intractable. Resorting to instead sampling from the joint distribution by means of a Monte Carlo approach is also challenging. For example, a naive rejection sampler does not work when the probability mass of the constraint is zero. A typical example of such constrained problems is to learn energy consumption for a higher resolution level based on data at a lower resolution, e.g., to decompose a daily reading into readings at a finer level. We introduce a novel Monte Carlo sampling algorithm based on Langevin diffusions and rejection sampling to solve the problem of sampling from equality-constrained models. Our method has the advantage of being exact for linear constraints and naturally deals with multimodal distributions on arbitrary constraints. We test our method on statistical disaggregation problems for electricity consumption datasets, and our approach provides better uncertainty estimation and accuracy in data imputation compared with other naive/unconstrained methods.


Publication metadata

Author(s): Hu S, Dai H, Meng F, Aslett L, Pollock M, Roberts G

Publication type: Article

Publication status: Published

Journal: Scandinavian Journal of Statistics

Year: 2025

Volume: 52

Issue: 3

Pages: 1376-1421

Print publication date: 01/09/2025

Online publication date: 09/05/2025

Acceptance date: 24/04/2025

Date deposited: 28/04/2025

ISSN (print): 0303-6898

ISSN (electronic): 1467-9469

Publisher: Wiley-Blackwell Publishing Ltd.

URL: https://doi.org/10.1111/sjos.12790

DOI: 10.1111/sjos.12790


Altmetrics

Altmetrics provided by Altmetric


Funding

Funder referenceFunder name
EP/V009478/1
EP/X027872/1
EP/X028100/1
EP/X028712/1
EP/Y014650/1
EPSRC grants Bayes for Health (R018561), CoSInES (R034710)
EP/X028119/1
EPSRC
UKRI

Share