YES, ANY PLAYER MAY TAKE A PENALTY KICK!

Question:
Understand that substitution can take place during any stoppage.

I would like to check can the substitute which just come in, can he takes the penalty kick, corner kick, or throw in?

i saw my fellow referee did not allow the substitute player who just come into the field of play to take the penalty kick and sometimes do not allow the substitute player who just come into the field of play to take the throw in and corner kick.

please advise and clear my doubts.

USSF answer (August 14, 2008):
There is no reason that the new player cannot take the penalty kick or other restart as soon as he or she has entered the field in compliance with the requirements of Law 3.

Note:
The questioner and his colleague are not from the United States and thus are not confused by the high school rule that does not allow a newly-subbed in player to take a penalty kick. The high school rules do not place any other restrictions on newly-subbed in players taking other restarts.