Check all connections very well. The marine environment is really nasty for corrosion. Not just rust, but the electrical terminals seem to get nasty quickly.
This is really good advice. I had a similar problem last summer and my positive cable end was completely corroded, while my negative was perfect. There can be a lot of moisture in a boat.
Check everything before you start replacing things.