To remove an extension group, select it from the panel, then click on the button on the bottom-right corner of the panel. You will be asked to confirm your action.
If you do not want to remove this group, click the Cancel button as shown above.