mailitics

Tag: smc

  • Power-SMC: Low-Latency Sequence-Level Power Sampling for Training-Free LLM Reasoning

    Power-SMC: Low-Latency Sequence-Level Power Sampling for Training-Free LLM Reasoning arXiv:2602.10273v1 Announce Type: new Abstract: Many recent reasoning gains in large language models can be explained as distribution sharpening: biasing generation toward high-likelihood trajectories already supported by the pretrained model, rather than modifying its weights. A natural formalization is the sequence-level power distribution $pi_alpha(ymid x)propto p_theta(ymid…

  • Tuning Sequential Monte Carlo Samplers via Greedy Incremental Divergence Minimization

    Tuning Sequential Monte Carlo Samplers via Greedy Incremental Divergence Minimization arXiv:2503.15704v1 Announce Type: new Abstract: The performance of sequential Monte Carlo (SMC) samplers heavily depends on the tuning of the Markov kernels used in the path proposal. For SMC samplers with unadjusted Markov kernels, standard tuning objectives, such as the Metropolis-Hastings acceptance rate or the…