Shirin,
You remember correctly. you drive into the park (right next to the Lewes-Cape May Ferry Terminal) and go down to the Beach area (right next to the Pilot Tower) and you can walk out to get a great view of the Lighthouses.
We were there in Nov 2001 on our way back from Annapolis.
Dennis