To remove an expired or faulty creditcard, please add a valid creditcard first. You can do this in the Billing screen. To navigate to the Billing screen, click in the left bar on Settings and choose the tab Billing.
Below you can see that you can only Add a new card.
After a new card has been added. You can promote the recently added card to Default.
Now you can delete the old card.
The recently added card remains.