Are you getting a locked file error when deleting/renaming it?
On Windows, try Process Explorer or filemon. Also, check if you have some OS utlities running that may have placed a lock on it (anti-virus, OS backup/copy, etc...). You may also check Windows Event log for errors.