Do I have to cover concrete ornaments over winter?

No, in general; iif it is exposed to salt debris (side of the road) then vinyl or burlap can be used to shield it from the salt.  No standing water should remain on/in the piece.  Proper drainage is always very important.