Those little set screws are soft metal. You might try finding a flathead screwdriver just a smidge larger than the diameter of the hole, tapping it into the round hole using a hammer, then twisting it out. If you have access to an "Easy Out", that is really what you need. You can get a small set at Harbor Freight for under $10.