DTSC - GTSA - Papershttp://hdl.handle.net/10016/171772019-09-22T21:15:17Z2019-09-22T21:15:17ZTwo adaptive rejection sampling schemes for probability density functions log-convex tailsMartino, LucaMíguez Arenas, Joaquínhttp://hdl.handle.net/10016/172002019-05-09T13:40:48Z2011-11-21T00:00:00ZTwo adaptive rejection sampling schemes for probability density functions log-convex tails
Martino, Luca; Míguez Arenas, Joaquín
Monte Carlo methods are often necessary for the implementation of optimal Bayesian estimators. A fundamental technique that can be used to generate samples from virtually any target probability distribution is the so-called rejection sampling method, which generates candidate samples from a proposal distribution and then accepts them or not by testing the ratio of the target and proposal densities. The class of adaptive rejection sampling (ARS) algorithms is particularly interesting because they can achieve high acceptance rates. However, the standard ARS method can only be used with log-concave target densities. For this reason, many generalizations have been proposed. In this work, we investigate two different adaptive schemes that can be used to draw exactly from a large family of univariate probability density functions (pdf's), not necessarily log-concave, possibly multimodal and with tails of arbitrary concavity. These techniques are adaptive in the sense that every time a candidate sample is rejected, the acceptance rate is improved. The two proposed algorithms can work properly when the target pdf is multimodal, with first and second derivatives analytically intractable, and when the tails are log-convex in a infinite domain. Therefore, they can be applied in a number of scenarios in which the other generalizations of the standard ARS fail. Two illustrative numerical examples are shown.
Documento depositado en el repositorio arXiv.org. Versión: arXiv:1111.4942v1 [stat.CO]
2011-11-21T00:00:00ZOn the Generalized Ratio of Uniforms as a Combination of Transformed Rejection and Extended Inverse of Density SamplingMartino, LucaLuengo García, DavidMíguez Arenas, Joaquínhttp://hdl.handle.net/10016/171752019-05-09T13:40:47Z2012-08-11T00:00:00ZOn the Generalized Ratio of Uniforms as a Combination of Transformed Rejection and Extended Inverse of Density Sampling
Martino, Luca; Luengo García, David; Míguez Arenas, Joaquín
In this work we investigate the relationship among three classical sampling techniques: the inverse of density (Khintchine's theorem), the transformed rejection (TR) and the generalized ratio of uniforms (GRoU). Given a monotonic probability density function (PDF), we show that the transformed area obtained using the generalized ratio of uniforms method can be found equivalently by applying the transformed rejection sampling approach to the inverse function of the target density. Then we provide an extension of the classical inverse of density idea, showing that it is completely equivalent to the GRoU method for monotonic densities. Although we concentrate on monotonic probability density functions (PDFs), we also discuss how the results presented here can be extended to any non-monotonic PDF that can be decomposed into a collection of intervals where it is monotonically increasing or decreasing. In this general case, we show the connections with transformations of certain random variables and the generalized inverse PDF with the GRoU technique. Finally, we also introduce a GRoU technique to handle unbounded target densities.
Documento depositado en el repositorio arXiv.org. Versión: arXiv:1205.0482v6 [stat.CO]
2012-08-11T00:00:00Z