Dual R9700's AMD VLLM-Container woes

High-Performance Computing Machine Learning, LLMs, & AI
,
21

Yes, and I believed I’ve maxed out the capabilities for this WRX80 system.

Bytes Per Direction 268435456
Unidirectional copy peak bandwidth GB/s [Local read / Remote write] (GPU-Executor: GFX)
 SRC+EXE\DST    CPU 00       GPU 00    GPU 01
  CPU 00  ->     46.11        21.51     21.46

  GPU 00  ->     28.20       301.24     28.09
  GPU 01  ->     28.20        28.09    300.94
                           CPU->CPU  CPU->GPU  GPU->CPU  GPU->GPU
Averages (During UniDir):       N/A     21.48     28.20     28.09

Bidirectional copy peak bandwidth GB/s [Local read / Remote write] (GPU-Executor: GFX)
     SRC\DST    CPU 00       GPU 00    GPU 01
  CPU 00  ->       N/A        20.97     20.95
  CPU 00 <-        N/A        27.94     27.93
  CPU 00 <->       N/A        48.90     48.88


  GPU 00  ->     27.94          N/A     27.59
  GPU 00 <-      20.98          N/A     27.60
  GPU 00 <->     48.91          N/A     55.19

  GPU 01  ->     27.93        27.60       N/A
  GPU 01 <-      20.93        27.58       N/A
  GPU 01 <->     48.86        55.18       N/A
                           CPU->CPU  CPU->GPU  GPU->CPU  GPU->GPU
Averages (During  BiDir):       N/A     24.45     24.44     27.59
1 Like