When I delete messages from my device, and choose "mailbox and handheld" It doesn't delete on my computer

Sounds like you are using a blackberry... you need to give it a few minutes to resync between the mailbox and handheld.