I agree with your friends. I think it is a couple of thousand too high. I also think you will outgrow it quickly. That is a decision you will have to figure out.
As far as the boat, there are no issues with the 04 that I am aware of except for the bad vinyl. That was resolved by 05. They did make the change to drive by wire in '05, FWIW.
40th Anniversaary X14
'97 Prostar 190 - LT-1 (For Sale)
Prior boats - 2009 X14, 2008 X14, 2005 197, 1988 Tristar 190, 1989 Prostar.