If the two cups are the same/equal in all regards the spoon makes the difference in heat loss. Metal spoon is a good conductor, heat conducts up the spoon handle. Radiant and convection losses occur in the surrounding air. Metal becomes a “heat sink”.
Spoon will feel warmer to the touch than a pottery or foam cup that is not a good conductor.