The only half-height, single-slot RTX cards I know of are Quadros.
[Nvidia's Single-Slot Low-Profile Pro GPU Has 8GB of Memory | Tom's Hardware]
If you mean one of these [https://www.amazon.com/ASUS-Graphics-DisplayPort-Connector-Axial-tech/dp/B08GL4YJK6] It’s supposedly equivalent in performance, but needs a full-height, dual-slot. If your case has one of those, the only question left is noise-threshold.
Fully Silent PCs has done some work on this [https://www.fullysilentpcs.com/product/asus-gtx-1650/?v=7516fd43adaa] if you can tolerate a price jump, but it may also exceed dual-slot compatibility(?).
It doesn’t look like their case has any Thunderbolt ports on it.
[FUJITSU Desktop ESPRIMO D9010 : Fujitsu Global]