you will not hurt them with a towel/rag and glass cleaner.
When I help my buddy tint car windows(part time) we scrap the glass with a razor to make sure it is 100% clean. The rear window is a pain since you cant use a razor on the defrosters. We use light steel wool. Never once messed up a defroster grid that way, so rags and towels are no worry!!!