Sounds as if the plasterboard was a cheap fix in the past; i've got one wall like that covering bomb damage.
You should be alright to strip the PB, make good the brickwork and plaster over, usually a hit or miss grate does for chimney ventilation half a metre above the floor.
Fix the top first if there might be bird access unless you like listening to a bird starving to death!