In this paper, we characterize vertex algebras (in the appropriate sense) as algebras over a certain graded co-operad. We also discuss some applications and categorical ramifications of this characterization.