A complete linear model for the Yarkovsky thermal force on spherical asteroid fragments