We give a conceptual explanation of universal deformation formulas for unital associative algebras and prove some results on the structure of their moduli spaces. We then generalize universal deformation formulas to other types of algebras and their diagrams