Do I need a separate visa to visit Paris, if I have a visa to visit Belgium?
No, you are good. Visa for any country of the Schengen area are good for the whole area.