I just removed both of mine a couple weeks ago to replace the impellers. If you're sure all the screws are out -- some heads can get buried in the carpeting -- then just pull! (My starboard rear panel also has the shower hookup.
2005 X2, Viper Red, MCX, OJ TZ-X5 prop, PPass, rear 750 sacs, KGB, IBS, Bennett Wake Plate, custom wake shaper
(previous) 2001 X5, 1991 TriStar 190