Nope. Charge specifically says, you can't take any further actions this turn unless you spend an action point to take an extra action.
So you can charge a minion, drop it, use an action point to activate swift charge and take out another one. That's it.