Well, I doubt they knew that, so I suppose the more likely cases are...

The culprit wanted to frame someone specifically and left the gun as evidence, or the culprit was unused to guns and dropped it before escaping. They weren't able to go back and retrieve it in time without looking suspicious.

[Does that sound about right?]