[LPDad]

Yep, (sorry it took so long for me to see this)
I have (basically) the same setup-- 1 DSL (ppoe)line and 2 computers (sometimes more) to share.

I have a 4 port Linksys router (which connects to the DSL modem and keeps the ppoe connection alive) into which I can plug any number of computers directly. It is a very simple setup, it works great. Use the XP wizard to configure all of the computers into a local LAN (make an xp wizard disk and use it on the w98 or wME machines). All of the computers can talk to each other, share drives and even printers. you do not have to keep the ics computer on all the time--> the only item that is on all the time is the modem and the Linksys router. Any computer can access the net at any time.
You can do the same thing using a netgear router. Either way if you connect the computers to the router with cat5 cable then you can do the whole setup for about $50-$75 + the cost of whatever cable you need. If you decide to go the wireless route (get a wireless router + a wireless card for each computer) then the cost is more in the range of $200 or so.
Let me know if you need more info or if you have more questions.