Efficient, Regularized, and Scalable Algorithms for Multiscale Coarse-Graining