Connectx-4 Lx 2x 25GbE with ASPM support + idle power consumption measurements

If LnkCap: shows ASPM support your card should be fine.
I had similar situation on sketchy chinese erying motherboard.
You could try different motherboard or play with settings in configuration menu.