How exactly is the loner flaw worded? Is it possible to still swap out your acquire familiar ability for the metamagic specialist feature after taking the loner flaw (assuming it merely prevents you from acquiring a familiar, rather than making you lose access to said ability altogether)?