My concern for you with Priority Boarding and young children is what are you going to do after you board early? Your room will probably not be ready for several hours, so no napping space. How will you entertain the 3 year old? If you choose a later boarding time, then you can eat lunch and (hopefully!) not soon after, your room may be ready.