The timeline as I understand it:
Day 4: arrive at Hengistead, visit the keep, meet Lord P, dinner at the tavern.
Day 5: Get weapon and armour fixed, sleep in, potter around town, meet the locals, whatever takes your fancy (the bakery is supposed to be quite good).
Day 6: Head to the castle...