Hm, I am working on the workstation directly. Why should there be any influence from RDP related drivers?
Or course, RDP is enabled on the machine.
The driver comes directly from DELL. I know, it is not the version latest stated on nvidia website. However, it should be verified for CAD and professional use.
Windows by default switches to Basic Display Adapter when you use RDP for the first time. This sets the onboard graphics as primary.
Creates no end of fuckin problems and requires a reboot to resolve.
The servers we administrate have the BMC physically disabled to prevent this behavior (and secure the machines for compliance).
Itās newer than the one Nvidia suggests. Also, did you set the multi tasking options from the thread I linked to?
Itās only 4 settings you have to set in total, but a world of difference with multi GPU configurations.
1 Like
Anyhow, I have started logging the workstation with LatencyMon, maybe, it makes a bit more sense to anybody.
I have also started disconnecting USB perfirals, especially one DELL monitor, which had a Realtek eth adapter.
Does it make any sense to start disabling devices like nvidia High Definition Audio, which are not in use?
CONCLUSION
Your system appears to be having trouble handling real-time audio and other tasks. You are likely to experience buffer underruns appearing as drop outs, clicks or pops. One or more DPC routines that belong to a driver running in your system appear to be executing for too long. Also one or more ISR routines that belong to a driver running in your system appear to be executing for too long. One problem may be related to power management, disable CPU throttling settings in Control Panel and BIOS setup. Check for BIOS updates.
LatencyMon has been analyzing your system for 5:14:25 (h:mm:ss) on all processors.
SYSTEM INFORMATION
Computer name: CYSWS0004
OS version: Windows 11, 10.0, version 2009, build: 22631 (x64)
Hardware: Precision 7920 Tower, Dell Inc.
BIOS: 2.42.0
CPU: GenuineIntel Intel(R) Xeon(R) Gold 6226R CPU @ 2.90GHz
Logical processors: 32
Processor groups: 1
Processor group size: 32
RAM: 130719 MB total
CPU SPEED
Reported CPU speed (WMI): 2893 MHz
Reported CPU speed (registry): 2893 MHz
Note: reported execution times may be calculated based on a fixed reported CPU speed. Disable variable speed settings like Intel Speed Step and AMD Cool N Quiet in the BIOS setup for more accurate results.
MEASURED INTERRUPT TO USER PROCESS LATENCIES
The interrupt to process latency reflects the measured interval that a usermode process needed to respond to a hardware request from the moment the interrupt service routine started execution. This includes the scheduling and execution of a DPC routine, the signaling of an event and the waking up of a usermode thread from an idle wait state in response to that event.
Highest measured interrupt to process latency (Āµs): 8530.70
Average measured interrupt to process latency (Āµs): 30.957016
Highest measured interrupt to DPC latency (Āµs): 8520.80
Average measured interrupt to DPC latency (Āµs): 9.595259
REPORTED ISRs
Interrupt service routines are routines installed by the OS and device drivers that execute in response to a hardware interrupt signal.
Highest ISR routine execution time (Āµs): 4612.932596
Driver with highest ISR routine execution time: Wdf01000.sys - Kernel Mode Driver Framework Runtime, Microsoft Corporation
Highest reported total ISR routine time (%): 0.000404
Driver with highest ISR total time: HDAudBus.sys - High Definition Audio Bus Driver, Microsoft Corporation
Total time spent in ISRs (%) 0.000733
ISR count (execution time <250 Āµs): 1199745
ISR count (execution time 250-500 Āµs): 0
ISR count (execution time 500-1000 Āµs): 6
ISR count (execution time 1000-2000 Āµs): 0
ISR count (execution time 2000-4000 Āµs): 0
ISR count (execution time >=4000 Āµs): 0
REPORTED DPCs
DPC routines are part of the interrupt servicing dispatch mechanism and disable the possibility for a process to utilize the CPU while it is interrupted until the DPC has finished execution.
Highest DPC routine execution time (Āµs): 6830.770826
Driver with highest DPC routine execution time: Wdf01000.sys - Kernel Mode Driver Framework Runtime, Microsoft Corporation
Highest reported total DPC routine time (%): 0.014684
Driver with highest DPC total execution time: dxgkrnl.sys - DirectX Graphics Kernel, Microsoft Corporation
Total time spent in DPCs (%) 0.050762
DPC count (execution time <250 Āµs): 17424142
DPC count (execution time 250-500 Āµs): 0
DPC count (execution time 500-10000 Āµs): 53567
DPC count (execution time 1000-2000 Āµs): 45
DPC count (execution time 2000-4000 Āµs): 114
DPC count (execution time >=4000 Āµs): 8
REPORTED HARD PAGEFAULTS
Hard pagefaults are events that get triggered by making use of virtual memory that is not resident in RAM but backed by a memory mapped file on disk. The process of resolving the hard pagefault requires reading in the memory from disk while the process is interrupted and blocked from execution.
NOTE: some processes were hit by hard pagefaults. If these were programs producing audio, they are likely to interrupt the audio stream resulting in dropouts, clicks and pops. Check the Processes tab to see which programs were hit.
Process with highest pagefault count: ekrn.exe
Total number of hard pagefaults 104027
Hard pagefault count of hardest hit process: 103677
Number of processes hit: 29
powercfg /h off - goodbye hibernation
Is your ESET enabled with full remote management including remote desktop?
Did you reinstall after the GPU swap?
Does this problem exist from cold boot, or only after itās been on for a bit?
2 Likes
I think, my settings are identical to that post youĀ“ve referenced. I have not made any changes to this multitasking section:
Ok, the Basic Display Driver is however activated only when I am connecting to the workstation directly. Currently even under hidden and not active, but I might be mistaken.
Yes, fully locked and centrally managed.
GPU swap was followed directly with Safe boot + DDU with full nvidia wipe. Followed by a clean nvidia driver deployment from nvidia website.
After cold boot, the machine is quite fluid and I am not experiencing those issues. Only after a starting opening tabs and doing normal work the WS gets laggy.
That all looks good. Try suspending ESET for an hour (offline) and see if anything changes.
FOUND IT!
Thatās a powercfg setting.
Machine is going to sleep and staying there (else, youād get seg faults)
You are running remote desktop on your computer right? iāve seen rdp in the running apps list. That is what i mean. when you remote desktop into another computer a driver is being used to show that other computer screen.
You can check if that issue is caused by the rdp by not running it and seeing if that solves the issue.
1 Like
Hi guys,
maybe, one more note. Previously I was running a Precision 3660 with i7-12700K as my daily driver. It was connected to 6 Monitors, running a RTX A2000 + built in intel GPU. Was working like a charm without any issues described in this thread.
Why I am referencing - it is configured 1:1 as the 7920 via GPO, same ESET settings and everything else.
I have those workstations besides each other. When simply switchen screens to 3660, everything is beautiful and fluent.
Can it be that the CPU makes such a difference in this case?
Thanks
Boris.
I am not sure, what you meant here. The workstation never hybernates, it is not allowed at all.
Actually, they are running 24/7.
Thank you
Boris
Power Scheme GUID: e9a42b02-d5df-448d-aa00-03f14749eb61 (Ultimate Performance)
Subgroup GUID: 0012ee47-9041-4b5d-9b77-535fba8b1442 (Hard disk)
GUID Alias: SUB_DISK
Power Setting GUID: 6738e2c4-e8a5-4a42-b16a-e040e769756e (Turn off hard disk after)
GUID Alias: DISKIDLE
Minimum Possible Setting: 0x00000000
Maximum Possible Setting: 0xffffffff
Possible Settings increment: 0x00000001
Possible Settings units: Seconds
Current AC Power Setting Index: 0x00000000
Current DC Power Setting Index: 0x00000000
Subgroup GUID: 02f815b5-a5cf-4c84-bf20-649d1f75d3d8 (Internet Explorer)
Power Setting GUID: 4c793e7d-a264-42e1-87d3-7a0d2f523ccd (JavaScript Timer Frequency)
Possible Setting Index: 000
Possible Setting Friendly Name: Maximum Power Savings
Possible Setting Index: 001
Possible Setting Friendly Name: Maximum Performance
Current AC Power Setting Index: 0x00000001
Current DC Power Setting Index: 0x00000000
Subgroup GUID: 0d7dbae2-4294-402a-ba8e-26777e8488cd (Desktop background settings)
Power Setting GUID: 309dce9b-bef4-4119-9921-a851fb12f0f4 (Slide show)
Possible Setting Index: 000
Possible Setting Friendly Name: Available
Possible Setting Index: 001
Possible Setting Friendly Name: Paused
Current AC Power Setting Index: 0x00000000
Current DC Power Setting Index: 0x00000001
Subgroup GUID: 19cbb8fa-5279-450e-9fac-8a3d5fedd0c1 (Wireless Adapter Settings)
Power Setting GUID: 12bbebe6-58d6-4636-95bb-3217ef867c1a (Power Saving Mode)
Possible Setting Index: 000
Possible Setting Friendly Name: Maximum Performance
Possible Setting Index: 001
Possible Setting Friendly Name: Low Power Saving
Possible Setting Index: 002
Possible Setting Friendly Name: Medium Power Saving
Possible Setting Index: 003
Possible Setting Friendly Name: Maximum Power Saving
Current AC Power Setting Index: 0x00000000
Current DC Power Setting Index: 0x00000002
Subgroup GUID: 238c9fa8-0aad-41ed-83f4-97be242c8f20 (Sleep)
GUID Alias: SUB_SLEEP
Power Setting GUID: 29f6c1db-86da-48c5-9fdb-f2b67b1f44da (Sleep after)
GUID Alias: STANDBYIDLE
Minimum Possible Setting: 0x00000000
Maximum Possible Setting: 0xffffffff
Possible Settings increment: 0x00000001
Possible Settings units: Seconds
Current AC Power Setting Index: 0x00000000
Current DC Power Setting Index: 0x00000258
Power Setting GUID: 94ac6d29-73ce-41a6-809f-6363ba21b47e (Allow hybrid sleep)
GUID Alias: HYBRIDSLEEP
Possible Setting Index: 000
Possible Setting Friendly Name: Off
Possible Setting Index: 001
Possible Setting Friendly Name: On
Current AC Power Setting Index: 0x00000001
Current DC Power Setting Index: 0x00000001
Power Setting GUID: 9d7815a6-7ee4-497e-8888-515a05f02364 (Hibernate after)
GUID Alias: HIBERNATEIDLE
Minimum Possible Setting: 0x00000000
Maximum Possible Setting: 0xffffffff
Possible Settings increment: 0x00000001
Possible Settings units: Seconds
Current AC Power Setting Index: 0x00000000
Current DC Power Setting Index: 0x00000000
Power Setting GUID: bd3b718a-0680-4d9d-8ab2-e1d2b4ac806d (Allow wake timers)
GUID Alias: RTCWAKE
Possible Setting Index: 000
Possible Setting Friendly Name: Disable
Possible Setting Index: 001
Possible Setting Friendly Name: Enable
Possible Setting Index: 002
Possible Setting Friendly Name: Important Wake Timers Only
Current AC Power Setting Index: 0x00000001
Current DC Power Setting Index: 0x00000001
Subgroup GUID: 2a737441-1930-4402-8d77-b2bebba308a3 (USB settings)
Power Setting GUID: 48e6b7a6-50f5-4782-a5d4-53bb8f07e226 (USB selective suspend setting)
Possible Setting Index: 000
Possible Setting Friendly Name: Disabled
Possible Setting Index: 001
Possible Setting Friendly Name: Enabled
Current AC Power Setting Index: 0x00000001
Current DC Power Setting Index: 0x00000001
Subgroup GUID: 4f971e89-eebd-4455-a8de-9e59040e7347 (Power buttons and lid)
GUID Alias: SUB_BUTTONS
Power Setting GUID: a7066653-8d6c-40a8-910e-a1f54b84c7e5 (Start menu power button)
GUID Alias: UIBUTTON_ACTION
Possible Setting Index: 000
Possible Setting Friendly Name: Sleep
Possible Setting Index: 001
Possible Setting Friendly Name: Hibernate
Possible Setting Index: 002
Possible Setting Friendly Name: Shut down
Current AC Power Setting Index: 0x00000000
Current DC Power Setting Index: 0x00000000
Subgroup GUID: 501a4d13-42af-4429-9fd1-a8218c268e20 (PCI Express)
GUID Alias: SUB_PCIEXPRESS
Power Setting GUID: ee12f906-d277-404b-b6da-e5fa1a576df5 (Link State Power Management)
GUID Alias: ASPM
Possible Setting Index: 000
Possible Setting Friendly Name: Off
Possible Setting Index: 001
Possible Setting Friendly Name: Moderate power savings
Possible Setting Index: 002
Possible Setting Friendly Name: Maximum power savings
Current AC Power Setting Index: 0x00000000
Current DC Power Setting Index: 0x00000002
Subgroup GUID: 54533251-82be-4824-96c1-47b60b740d00 (Processor power management)
GUID Alias: SUB_PROCESSOR
Power Setting GUID: 893dee8e-2bef-41e0-89c6-b55d0929964c (Minimum processor state)
GUID Alias: PROCTHROTTLEMIN
Minimum Possible Setting: 0x00000000
Maximum Possible Setting: 0x00000064
Possible Settings increment: 0x00000001
Possible Settings units: %
Current AC Power Setting Index: 0x00000064
Current DC Power Setting Index: 0x00000005
Power Setting GUID: bc5038f7-23e0-4960-96da-33abaf5935ec (Maximum processor state)
GUID Alias: PROCTHROTTLEMAX
Minimum Possible Setting: 0x00000000
Maximum Possible Setting: 0x00000064
Possible Settings increment: 0x00000001
Possible Settings units: %
Current AC Power Setting Index: 0x00000064
Current DC Power Setting Index: 0x00000064
Subgroup GUID: 7516b95f-f776-4464-8c53-06167f40cc99 (Display)
GUID Alias: SUB_VIDEO
Power Setting GUID: 3c0bc021-c8a8-4e07-a973-6b14cbcb2b7e (Turn off display after)
GUID Alias: VIDEOIDLE
Minimum Possible Setting: 0x00000000
Maximum Possible Setting: 0xffffffff
Possible Settings increment: 0x00000001
Possible Settings units: Seconds
Current AC Power Setting Index: 0x00000e10
Current DC Power Setting Index: 0x00000258
Power Setting GUID: aded5e82-b909-4619-9949-f5d71dac0bcb (Display brightness)
GUID Alias: VIDEONORMALLEVEL
Minimum Possible Setting: 0x00000000
Maximum Possible Setting: 0x00000064
Possible Settings increment: 0x00000001
Possible Settings units: %
Current AC Power Setting Index: 0x00000050
Current DC Power Setting Index: 0x00000050
Power Setting GUID: f1fbfde2-a960-4165-9f88-50667911ce96 (Dimmed display brightness)
Minimum Possible Setting: 0x00000000
Maximum Possible Setting: 0x00000064
Possible Settings increment: 0x00000001
Possible Settings units: %
Current AC Power Setting Index: 0x00000032
Current DC Power Setting Index: 0x00000032
Power Setting GUID: fbd9aa66-9553-4097-ba44-ed6e9d65eab8 (Enable adaptive brightness)
GUID Alias: ADAPTBRIGHT
Possible Setting Index: 000
Possible Setting Friendly Name: Off
Possible Setting Index: 001
Possible Setting Friendly Name: On
Current AC Power Setting Index: 0x00000000
Current DC Power Setting Index: 0x00000000
Subgroup GUID: 9596fb26-9850-41fd-ac3e-f7c3c00afd4b (Multimedia settings)
Power Setting GUID: 03680956-93bc-4294-bba6-4e0f09bb717f (When sharing media)
Possible Setting Index: 000
Possible Setting Friendly Name: Allow the computer to sleep
Possible Setting Index: 001
Possible Setting Friendly Name: Prevent idling to sleep
Possible Setting Index: 002
Possible Setting Friendly Name: Allow the computer to enter Away Mode
Current AC Power Setting Index: 0x00000001
Current DC Power Setting Index: 0x00000000
Power Setting GUID: 10778347-1370-4ee0-8bbd-33bdacaade49 (Video playback quality bias)
Possible Setting Index: 000
Possible Setting Friendly Name: Video playback power-saving bias
Possible Setting Index: 001
Possible Setting Friendly Name: Video playback performance bias
Current AC Power Setting Index: 0x00000001
Current DC Power Setting Index: 0x00000000
Power Setting GUID: 34c7b99f-9a6d-4b3c-8dc7-b6693b78cef4 (When playing video)
Possible Setting Index: 000
Possible Setting Friendly Name: Optimize video quality
Possible Setting Index: 001
Possible Setting Friendly Name: Balanced
Possible Setting Index: 002
Possible Setting Friendly Name: Optimize power savings
Current AC Power Setting Index: 0x00000000
Current DC Power Setting Index: 0x00000001
Subgroup GUID: e73a048d-bf27-4f12-9731-8b2076e8891f (Battery)
GUID Alias: SUB_BATTERY
Power Setting GUID: 5dbb7c9f-38e9-40d2-9749-4f8a0e9f640f (Critical battery notification)
GUID Alias: BATFLAGSCRIT
Possible Setting Index: 000
Possible Setting Friendly Name: Off
Possible Setting Index: 001
Possible Setting Friendly Name: On
Current AC Power Setting Index: 0x00000001
Current DC Power Setting Index: 0x00000001
Power Setting GUID: 637ea02f-bbcb-4015-8e2c-a1c7b9c0b546 (Critical battery action)
GUID Alias: BATACTIONCRIT
Possible Setting Index: 000
Possible Setting Friendly Name: Do nothing
Possible Setting Index: 001
Possible Setting Friendly Name: Sleep
Possible Setting Index: 002
Possible Setting Friendly Name: Hibernate
Possible Setting Index: 003
Possible Setting Friendly Name: Shut down
Current AC Power Setting Index: 0x00000002
Current DC Power Setting Index: 0x00000002
Power Setting GUID: 8183ba9a-e910-48da-8769-14ae6dc1170a (Low battery level)
GUID Alias: BATLEVELLOW
Minimum Possible Setting: 0x00000000
Maximum Possible Setting: 0x00000064
Possible Settings increment: 0x00000001
Possible Settings units: %
Current AC Power Setting Index: 0x0000000a
Current DC Power Setting Index: 0x0000000a
Power Setting GUID: 9a66d8d7-4ff7-4ef9-b5a2-5a326ca2a469 (Critical battery level)
GUID Alias: BATLEVELCRIT
Minimum Possible Setting: 0x00000000
Maximum Possible Setting: 0x00000064
Possible Settings increment: 0x00000001
Possible Settings units: %
Current AC Power Setting Index: 0x00000005
Current DC Power Setting Index: 0x00000005
Power Setting GUID: bcded951-187b-4d05-bccc-f7e51960c258 (Low battery notification)
GUID Alias: BATFLAGSLOW
Possible Setting Index: 000
Possible Setting Friendly Name: Off
Possible Setting Index: 001
Possible Setting Friendly Name: On
Current AC Power Setting Index: 0x00000001
Current DC Power Setting Index: 0x00000001
Power Setting GUID: d8742dcb-3e6a-4b3c-b3fe-374623cdcf06 (Low battery action)
GUID Alias: BATACTIONLOW
Possible Setting Index: 000
Possible Setting Friendly Name: Do nothing
Possible Setting Index: 001
Possible Setting Friendly Name: Sleep
Possible Setting Index: 002
Possible Setting Friendly Name: Hibernate
Possible Setting Index: 003
Possible Setting Friendly Name: Shut down
Current AC Power Setting Index: 0x00000000
Current DC Power Setting Index: 0x00000000
Power Setting GUID: f3c5027d-cd16-4930-aa6b-90db844a8f00 (Reserve battery level)
Minimum Possible Setting: 0x00000000
Maximum Possible Setting: 0x00000064
Possible Settings increment: 0x00000001
Possible Settings units: %
Current AC Power Setting Index: 0x00000007
Current DC Power Setting Index: 0x00000007
set this guy to disabled
Disable sleep states in UEFI
Is there an UPS connected?
Hi there,
all sleep settings are disabled in BIOS.
UPS is connected, there is a 2200VA APC SmartuUPS with line interactive regulation. However, no USB is connected, so the WS is unaware of a presence of an UPS.
Current plan is to make a clean Windows Install. If it would make any difference, I have no clue at all.
I have currently uninstalled all software from the machine, even VMWARE Workstation PRO 17. ALL unnecessary USB devices are disconnected or disabled. No effect on performance.
Is there any possible conclusion, that simply my CPUs are out of date with not suitable performance for my day-to-day work?
Thanks,
Boris.
1 Like
good for this troubleshooting, but bad practice for prod
clean shutdowns are vital
Highly doubt as dual 6226Rās are roughly on par with a 5000 series Threadripper pro, i9-12900KF, I5-14600K, etc.
Iād grab another drive and start a clean install with all drivers loaded then run passmark (no setup time)
Tweak and tune in UEFI then rebuild your workstation and retesting until you find the problem child.
Also recommend regular system backups so you donāt have to start over as I suspect 1 program made kernel/regedits that borked the original install
2 Likes
P.S. do all this BEFORE joining the domain as GPOās are known to fuck stuff up
2 Likes
At work I have a Dell 7920 with dual xeon 6230r used for fem simulations. We were always the slower between the software users, even with 6+6 64 gb ram dimms (all channel populated).
I read some similar issues online and i investigated for some solutions.
I found the problem core to core latency due to cpu intercommunication (look online github and other similar themes).
To make the long story short we removed the second cpu and the related ram and pci objects and magically we got among the fastest in the users group.
I donāt know if this can also be your problem but it could be, two cpu system are not ideal for most users.
I hope this can help.
Ciao Giuseppe.
(post deleted by author)