We report on ultrafast photoluminescence spectroscopy of blue and red-emitting silicon nanostructures. Our results indicate that a dominant part of the blue and red emission comes from two distinct species with different energy states structures.