The bit about passive perception being the 'floor' of your perception confuses the differences between active and passive skill uses. In no way should both results be used simultaneously.
Passive perception is used as a DC for creatures sneaking up on you and, perhaps, whether or not you notice...