If you are a fantasy Nerd you will be just fine. :)
I admit I am a history Major, But I don't think its that hard. if you want a more introductory book about the Crusades ( and one that is a LOT of fun to read) Read " Dungeon, Fire and sword, By Robinson. It focuses a lot on the Knights Templar