USB port on the board or on your computer is broken?
If the USB port on the board is broken, you can buy an external USB to RS-232 (logic level) board and connect that to the RX & TX pins.
Note that depending on how the on-board USB port failed, the failed components may be holding the TX or RX pins in a state that prevent the external USB to RS-232 from functioning. If you are certain the on-board USB port has failed, the power line to the existing USB bridge chip should be cut or lifted.
In the end, it may be less expensive to purchase another TTGO Display-T.