Spoiler:He needs the red ball first, and you have to trade it with him. Have you found the man infront of the carpet that looks like the matchbook you got in your inventory?