To remove a widget from the dashboard, click on the menu on the top right of each widget and select Remove from Dashboard.
To delete a widget completely, select Settings --> Widgets from the left menu bar. Locate the widget and click Delete. This will remove the widget and the dataset (if the dataset is not linked to other widgets).