Took me ages to work it out.
Spoiler:You have to use the bit of flag you got from the mast, and use it with the ink in the captains office, then you use it as a black spot to the guy with the talisman.
Hope that helps and if you dont know how to use it then I can post that aswell.