I suppose it is necessary to build a timeline of events. If we imply that the murder occurred in the parlor, then it means that the culprit transported the body, with the bullet still lodged in, to the park.

[ he shrugs ] Therefore, the bullet would travel with the Lady, but the killer would...hide the casing in the ice cream. [ that still makes 0 sense to him. ]