Spoiler:You have to ask him for the leaves. You will have to do him a favor before he will give them to you.