Hey @Brylan, I hope you're well today!
It sounds like perhaps the default folder path for the backed up folders might not have reverted back to the OS system folders in this case.
We can manually reset the default folder path of Desktop, Downloads and Documents, which will allow you to then delete the My PC folder.
To reset the folder path, please follow the steps outlined in my post here. The steps will be the same for each backed up folder.
Before deleting the "My PC" folder though, please make sure to move out any of the files within the folder to another location on your computer, if you haven't already.
Let me know how it goes!