The seahorse is beneficial only to the tank that it is currently in. You need it in the beginning, but not later. However, it is impossible to discard, so after you are advanced, it will just take up space, in what ever tank you put it in.
No you can delete the seahorse but after that you can' buy a seahorse anymore