These boat launches will get you on to the Potomac and Anacostia (the two rivers meet at DC’s southern tip). Additional options for getting on the river with or without your own boat can be found at http://www.riverexplorer.com/boat_ramp_map.php4.
Gravelly Point (free)
Columbia Island Marina ($5, 24 hours a day)
Anacostia Park (free)