Can I delete a member's message?

Yes. Click the three dot icon on the top right of the message, then select Delete.