While running, if you disconnect the wire from the solenoid on the bottom of the carb, it should stop immediately. If it does not there is a problem with the solenoid. The only purpose of that solenoid is to prevent "dieseling" and/or backfiring after shutoff.
Also when is the last time you checked / cleaned the cooling fins, as overheating can cause stuff like this.