How Does Exploring the Exciting Work? Full Explanation