A recycler told me they don't want volatiles (paint thinner, gasoline, etc.) because it is dangerous to the processing they do to the oil. Another told me they don't care (brake fluid, mineral spirits, etc. are okay) as long as it is organic. I suppose it depends on the particular recycler and what they do with fluid after collecting.
For all recyclers, handyman said it best - treat it like motor oil.