I tried that, they removed the plug. Tho i suppose it depends what you use, concrete would work.
Don't forget to check for nests first, apparently they worse when trapped.

Good luck, hope you can do it without killing.