1. it starts with port 1, if you want that different, you have to hack some files. I'd say don't bother about it. It increments for each additional server, since you cannot have multiple servers on one and the same port.
2. Did you install X on the Fedora box? VNC is not like Terminal Services, you just 'break in' on an existing session. If that session is not X-bound, you'll get no fancy graphics
Indeed, SSH is much faster in that case.
What is it that you want to do with the linux box? Most of the time a headless (X-less) install is more than enough, since you just instruct the box what to do and use it's services from another workstation. Or is it that you want to try out one of the various display managers? I don't think VNC makes you happy in that case...