It seems like I can not update a theme's name.
1. Navigate to the Themes view from the left sidebar
2. Click on "Add Theme"
3. Click on the edit icon next to the theme name
4. Edit the theme name and hit enter
The name will be updated.
The whole page refreshes.