OOC: The plan sounds good. A torch burning in the front lawn may frighten anyone off, so perhaps best to keep it ready to unleash.
As for the ladder. It is attached, but Farmer Woldrack hands you an axe, points to two latch bolts, and tells you that with a clear chop you can detach it easily enough. He seems happy with the fact that this means he would have to repair it, as long as you only do it if you have to (this counts as a single round action and will succeed with DC 10 strength check - so should be easy). Scaling the ladder would take 2 rounds, so you would get 2 attempts.