That is correct. Until the element is hot (either from the heater, or the engine itself), you're likely running in open-loop mode (i.e. squirt as much gas in the cylinder as possible until the ECU knows the engine is safe).
That O2 sensor will not read right unless it is hot. The heater inside helps with a quicker readings. After you drive a while it is not necessary, but it will still throw a code.
In Louisiana Summertime, you have time on your side to leisurely get another one.
Afterwards, clear the codes.
I bought a new Denso sensor online for our 1998 Civic EX and it was approx $75 and it was the exact sensor.... NOT a universal O2 sensor that just happened to fit. The car still gets 40+ MPG after 250K miles.
BTW, make sure you check the exhaust manifold for cracks cause this is a well known problem on the 1996-2000 Civic.