Cut your losses- get some used cams and followers - this guy isn't doing you any favors, the cams will fail prematurly once the hardening is ground through, but they will probably last through the warranty period meanwhile putting metal through the engine.
To answer your original questio- how smooth do they need to be- they need to be as smooth as a crank
To answer your original questio- how smooth do they need to be- they need to be as smooth as a crank