Windows won't let you delete, move, or rename a file if a program is using it. Frustratingly, it also won't tell you which program is using the file so that you can solve the problem.

I decided to organize my music directory and was plagued by "Can't rename/move this directory as it's in use by another program".