How can I recover the "deleted" pictures?

When I rotate my photos why are they deleted? When I rename a picture after the "deleted" pic, it tells me that the file name already exists. I search the computer for the missing pic and it says no match can be found. Where did the "deleted" picture go? I never clicked delete and there is nothing in the recycle bin.