Does anyone have access to Epyc 7773x with at least 512Gb of RAM to test a specific workload?
7773x are now available relatively cheap on Ebay and I am trying to understand if AMD 3D Vcache is beneficial for my specific task and if it is worth it to replace my 7713P.
The test would only take 15 minutes most and it’s opensource from GitHub.
Link and deets?
Usage would be:
./bladebit --threads 64 --count 5 --farmer-key ad65cab5777776b47a54cc2947e2089c8743d0374dcbca44ed98baee55d045fd2a1c9a7b4fd6dfdd71701648bfd67340 --pool-key 8f4b9db4409333ece47f2024e33946d6d312cc0207b704aae63f2fa38eecf0fb8dc658a9fdd41ff1bcf6aa9bda016fb9 --verbose ramplot <output_directory>
This command will create 5 plots - I need average time.
Thank you very much!
Edit: Also I need the version of OS used - to replicate it on my 7713 for the clearest comparison.
Hey Wendell! Will you be able to run it?
You are my only hope to not risk wasting 5 grands!
Working on this later todsy
fedora 36, kernel 6
Bladebit Chia Plotter
Version : 2.0.1-dev
Git Commit : 9fac46aff0476e829d476412de18497a3a2f7ed8
Compiled With: gcc 12.2.1
[Global Plotting Config]
Will create 5 plots.
Thread count : 64
Warm start enabled : false
NUMA disabled : false
CPU affinity disabled : false
Farmer public key : ad65cab5777776b47a54cc2947e2089c8743d0374dcbca44ed98baee55d045fd2a1c9a7b4fd6dfdd71701648bfd67340
Pool public key : 8f4b9db4409333ece47f2024e33946d6d312cc0207b704aae63f2fa38eecf0fb8dc658a9fdd41ff1bcf6aa9bda016fb9
Output path : …/foo
System Memory: 495/503 GiB.
Memory required: 416 GiB.
Allocating buffers.
Generating plot 1 / 5: 3778b272b0961895c9277566d3157e7fdc73387599eebd66eafb3b567ce68d31
Running Phase 1
Generating F1…
Finished F1 generation in 14.47 seconds.
Sorting F1…
Finished F1 sort in 6.65 seconds.
Forward propagating to table 2…
Pairing L/R groups…
Finished pairing L/R groups in 10.1000 seconds. Created 4294949663 pairs.
Average of 236.1397 pairs per group.
Computing Fx…
Finished computing Fx in 8.4480 seconds.
Sorting entries…
Finished sorting in 18.46 seconds.
Finished forward propagating table 2 in 37.24 seconds.
Forward propagating to table 3…
Pairing L/R groups…
Finished pairing L/R groups in 5.7790 seconds. Created 4294879850 pairs.
Average of 236.1358 pairs per group.
Computing Fx…
Finished computing Fx in 8.5270 seconds.
Sorting entries…
Finished sorting in 12.22 seconds.
Finished forward propagating table 3 in 26.76 seconds.
Forward propagating to table 4…
Pairing L/R groups…
Finished pairing L/R groups in 5.7930 seconds. Created 4294842281 pairs.
Average of 236.1338 pairs per group.
Computing Fx…
Finished computing Fx in 8.7050 seconds.
Sorting entries…
Finished sorting in 12.07 seconds.
Finished forward propagating table 4 in 26.81 seconds.
Forward propagating to table 5…
Pairing L/R groups…
Finished pairing L/R groups in 5.7730 seconds. Created 4294639873 pairs.
Average of 236.1226 pairs per group.
Computing Fx…
Finished computing Fx in 9.3790 seconds.
Sorting entries…
Finished sorting in 12.05 seconds.
Finished forward propagating table 5 in 27.44 seconds.
Forward propagating to table 6…
Pairing L/R groups…
Finished pairing L/R groups in 5.7750 seconds. Created 4294314042 pairs.
Average of 236.1047 pairs per group.
Computing Fx…
Finished computing Fx in 8.4710 seconds.
Sorting entries…
Finished sorting in 12.94 seconds.
Finished forward propagating table 6 in 27.42 seconds.
Forward propagating to table 7…
Pairing L/R groups…
Finished pairing L/R groups in 5.7650 seconds. Created 4293588249 pairs.
Average of 236.0648 pairs per group.
Computing Fx…
Finished computing Fx in 8.3150 seconds.
Finished forward propagating table 7 in 14.31 seconds.
Finished Phase 1 in 181.11 seconds.
Running Phase 2
Prunning table 6…
Finished prunning table 6 in 0.25 seconds.
Prunning table 5…
Finished prunning table 5 in 9.05 seconds.
Prunning table 4…
Finished prunning table 4 in 8.61 seconds.
Prunning table 3…
Finished prunning table 3 in 8.48 seconds.
Prunning table 2…
Finished prunning table 2 in 8.43 seconds.
Finished Phase 2 in 35.01 seconds.
Running Phase 3
Compressing tables 1 and 2…
Finished compressing tables 1 and 2 in 39.69 seconds
Table 1 now has 3429359600 / 4294949663 entries ( 79.85% ).
Compressing tables 2 and 3…
Finished compressing tables 2 and 3 in 40.20 seconds
Table 2 now has 3439777932 / 4294879850 entries ( 80.09% ).
Compressing tables 3 and 4…
Finished compressing tables 3 and 4 in 40.46 seconds
Table 3 now has 3465907974 / 4294842281 entries ( 80.70% ).
Compressing tables 4 and 5…
Finished compressing tables 4 and 5 in 41.22 seconds
Table 4 now has 3532582252 / 4294639873 entries ( 82.26% ).
Compressing tables 5 and 6…
Finished compressing tables 5 and 6 in 43.29 seconds
Table 5 now has 3712918772 / 4294314042 entries ( 86.46% ).
Compressing tables 6 and 7…
Finished compressing tables 6 and 7 in 26.02 seconds
Table 6 now has 4293588249 / 4293588249 entries ( 100.00% ).
Finished Phase 3 in 230.89 seconds.
Running Phase 4
Writing P7.
Finished writing P7 in 0.31 seconds.
Writing C1 table.
Finished writing C1 table in 0.01 seconds.
Writing C2 table.
Finished writing C2 table in 0.00 seconds.
Writing C3 table.
Finished writing C3 table in 0.32 seconds.
Finished Phase 4 in 0.64 seconds.
Finished plotting in 447.66 seconds (7.46 minutes).
Generating plot 2 / 5: 72bff858a8ccc4ccaa2070d28fe95e4a4b52027838567847c345dfdeacc824f1
Running Phase 1
Generating F1…
Finished F1 generation in 0.81 seconds.
Sorting F1…
Finished F1 sort in 9.14 seconds.
Forward propagating to table 2…
Pairing L/R groups…
Finished pairing L/R groups in 9.3240 seconds. Created 4294955677 pairs.
Average of 236.1400 pairs per group.
Computing Fx…
Finished computing Fx in 8.1780 seconds.
Waiting for last plot to finish being written to disk…
Previous plot …/foo/plot-k32-2022-11-17-10-00-3778b272b0961895c9277566d3157e7fdc73387599eebd66eafb3b567ce68d31.plot.tmp finished writing to disk:
Table 1 pointer : 4096 ( 0x0000000000001000 )
Table 2 pointer : 14839353344 ( 0x00000003747e9000 )
Table 3 pointer : 28821860352 ( 0x00000006b5eab000 )
Table 4 pointer : 42910576640 ( 0x00000009fdab7000 )
Table 5 pointer : 57270321152 ( 0x0000000d5593c000 )
Table 6 pointer : 72363122688 ( 0x00000010d92da000 )
Table 7 pointer : 89816313856 ( 0x00000014e9783000 )
C1 table pointer : 107527368704 ( 0x0000001909217000 )
C2 table pointer : 107529089024 ( 0x00000019093bb000 )
C3 table pointer : 107529093120 ( 0x00000019093bc000 )
Sorting entries…
Finished sorting in 11.47 seconds.
Finished forward propagating table 2 in 29.28 seconds.
Forward propagating to table 3…
Pairing L/R groups…
Finished pairing L/R groups in 5.7670 seconds. Created 4294915453 pairs.
Average of 236.1378 pairs per group.
Computing Fx…
Finished computing Fx in 8.3660 seconds.
Sorting entries…
Finished sorting in 10.65 seconds.
Finished forward propagating table 3 in 25.02 seconds.
Forward propagating to table 4…
Pairing L/R groups…
Finished pairing L/R groups in 5.7550 seconds. Created 4294967296 pairs.
Average of 236.1406 pairs per group.
Computing Fx…
Finished computing Fx in 8.7030 seconds.
Sorting entries…
Finished sorting in 10.62 seconds.
Finished forward propagating table 4 in 25.31 seconds.
Forward propagating to table 5…
Pairing L/R groups…
Finished pairing L/R groups in 5.7680 seconds. Created 4294967296 pairs.
Average of 236.1406 pairs per group.
Computing Fx…
Finished computing Fx in 9.3540 seconds.
Sorting entries…
Finished sorting in 10.61 seconds.
Finished forward propagating table 5 in 25.96 seconds.
Forward propagating to table 6…
Pairing L/R groups…
Finished pairing L/R groups in 5.7690 seconds. Created 4294864649 pairs.
Average of 236.1350 pairs per group.
Computing Fx…
Finished computing Fx in 8.4690 seconds.
Sorting entries…
Finished sorting in 11.38 seconds.
Finished forward propagating table 6 in 25.85 seconds.
Forward propagating to table 7…
Pairing L/R groups…
Finished pairing L/R groups in 5.7770 seconds. Created 4294639628 pairs.
Average of 236.1226 pairs per group.
Computing Fx…
Finished computing Fx in 8.3330 seconds.
Finished forward propagating table 7 in 14.34 seconds.
Finished Phase 1 in 155.71 seconds.
Running Phase 2
Prunning table 6…
Finished prunning table 6 in 0.25 seconds.
Prunning table 5…
Finished prunning table 5 in 9.05 seconds.
Prunning table 4…
Finished prunning table 4 in 8.60 seconds.
Prunning table 3…
Finished prunning table 3 in 8.47 seconds.
Prunning table 2…
Finished prunning table 2 in 8.43 seconds.
Finished Phase 2 in 35.00 seconds.
Running Phase 3
Compressing tables 1 and 2…
Finished compressing tables 1 and 2 in 39.78 seconds
Table 1 now has 3429389755 / 4294955677 entries ( 79.85% ).
Compressing tables 2 and 3…
Finished compressing tables 2 and 3 in 40.27 seconds
Table 2 now has 3439860455 / 4294915453 entries ( 80.09% ).
Compressing tables 3 and 4…
Finished compressing tables 3 and 4 in 40.62 seconds
Table 3 now has 3466097529 / 4294967296 entries ( 80.70% ).
Compressing tables 4 and 5…
Finished compressing tables 4 and 5 in 41.27 seconds
Table 4 now has 3532978324 / 4294967296 entries ( 82.26% ).
Compressing tables 5 and 6…
Finished compressing tables 5 and 6 in 43.36 seconds
Table 5 now has 3713558941 / 4294864649 entries ( 86.47% ).
Compressing tables 6 and 7…
Finished compressing tables 6 and 7 in 26.00 seconds
Table 6 now has 4294639628 / 4294639628 entries ( 100.00% ).
Finished Phase 3 in 231.29 seconds.
Running Phase 4
Writing P7.
Finished writing P7 in 0.32 seconds.
Writing C1 table.
Finished writing C1 table in 0.01 seconds.
Writing C2 table.
Finished writing C2 table in 0.00 seconds.
Writing C3 table.
Finished writing C3 table in 0.32 seconds.
Finished Phase 4 in 0.65 seconds.
Finished plotting in 422.65 seconds (7.04 minutes).
Generating plot 3 / 5: d217721e59408550b1f0bd6d4da19c6eb02d952bb65e2c1f815d8a2836cb1242
Running Phase 1
Generating F1…
Finished F1 generation in 0.81 seconds.
Sorting F1…
Finished F1 sort in 9.29 seconds.
Forward propagating to table 2…
Pairing L/R groups…
Finished pairing L/R groups in 9.2500 seconds. Created 4294935112 pairs.
Average of 236.1389 pairs per group.
Computing Fx…
Finished computing Fx in 8.1780 seconds.
Waiting for last plot to finish being written to disk…
Previous plot …/foo/plot-k32-2022-11-17-10-08-72bff858a8ccc4ccaa2070d28fe95e4a4b52027838567847c345dfdeacc824f1.plot.tmp finished writing to disk:
Table 1 pointer : 4096 ( 0x0000000000001000 )
Table 2 pointer : 14839488512 ( 0x000000037480a000 )
Table 3 pointer : 28822327296 ( 0x00000006b5f1d000 )
Table 4 pointer : 42911817728 ( 0x00000009fdbe6000 )
Table 5 pointer : 57273176064 ( 0x0000000d55bf5000 )
Table 6 pointer : 72368582656 ( 0x00000010d980f000 )
Table 7 pointer : 89826050048 ( 0x00000014ea0cc000 )
C1 table pointer : 107541450752 ( 0x0000001909f85000 )
C2 table pointer : 107543171072 ( 0x000000190a129000 )
C3 table pointer : 107543175168 ( 0x000000190a12a000 )
Sorting entries…
Finished sorting in 11.58 seconds.
Finished forward propagating table 2 in 29.30 seconds.
Forward propagating to table 3…
Pairing L/R groups…
Finished pairing L/R groups in 5.7660 seconds. Created 4294882359 pairs.
Average of 236.1360 pairs per group.
Computing Fx…
Finished computing Fx in 8.3720 seconds.
Sorting entries…
Finished sorting in 10.64 seconds.
Finished forward propagating table 3 in 25.01 seconds.
Forward propagating to table 4…
Pairing L/R groups…
Finished pairing L/R groups in 5.7360 seconds. Created 4294910052 pairs.
Average of 236.1375 pairs per group.
Computing Fx…
Finished computing Fx in 8.6980 seconds.
Sorting entries…
Finished sorting in 10.62 seconds.
Finished forward propagating table 4 in 25.29 seconds.
Forward propagating to table 5…
Pairing L/R groups…
Finished pairing L/R groups in 5.7540 seconds. Created 4294906444 pairs.
Average of 236.1373 pairs per group.
Computing Fx…
Finished computing Fx in 9.3520 seconds.
Sorting entries…
Finished sorting in 10.68 seconds.
Finished forward propagating table 5 in 26.02 seconds.
Forward propagating to table 6…
Pairing L/R groups…
Finished pairing L/R groups in 5.7670 seconds. Created 4294753057 pairs.
Average of 236.1288 pairs per group.
Computing Fx…
Finished computing Fx in 8.4350 seconds.
Sorting entries…
Finished sorting in 11.49 seconds.
Finished forward propagating table 6 in 25.92 seconds.
Forward propagating to table 7…
Pairing L/R groups…
Finished pairing L/R groups in 5.7240 seconds. Created 4294533231 pairs.
Average of 236.1168 pairs per group.
Computing Fx…
Finished computing Fx in 8.3160 seconds.
Finished forward propagating table 7 in 14.27 seconds.
Finished Phase 1 in 155.91 seconds.
Running Phase 2
Prunning table 6…
Finished prunning table 6 in 0.25 seconds.
Prunning table 5…
Finished prunning table 5 in 9.05 seconds.
Prunning table 4…
Finished prunning table 4 in 8.62 seconds.
Prunning table 3…
Finished prunning table 3 in 8.48 seconds.
Prunning table 2…
Finished prunning table 2 in 8.43 seconds.
Finished Phase 2 in 35.02 seconds.
Running Phase 3
Compressing tables 1 and 2…
Finished compressing tables 1 and 2 in 39.77 seconds
Table 1 now has 3429383247 / 4294935112 entries ( 79.85% ).
Compressing tables 2 and 3…
Finished compressing tables 2 and 3 in 40.30 seconds
Table 2 now has 3439871456 / 4294882359 entries ( 80.09% ).
Compressing tables 3 and 4…
Finished compressing tables 3 and 4 in 40.55 seconds
Table 3 now has 3466083666 / 4294910052 entries ( 80.70% ).
Compressing tables 4 and 5…
Finished compressing tables 4 and 5 in 41.27 seconds
Table 4 now has 3532941187 / 4294906444 entries ( 82.26% ).
Compressing tables 5 and 6…
Finished compressing tables 5 and 6 in 43.26 seconds
Table 5 now has 3713475306 / 4294753057 entries ( 86.47% ).
Compressing tables 6 and 7…
Finished compressing tables 6 and 7 in 25.98 seconds
Table 6 now has 4294533231 / 4294533231 entries ( 100.00% ).
Finished Phase 3 in 231.13 seconds.
Running Phase 4
Writing P7.
Finished writing P7 in 0.31 seconds.
Writing C1 table.
Finished writing C1 table in 0.01 seconds.
Writing C2 table.
Finished writing C2 table in 0.00 seconds.
Writing C3 table.
Finished writing C3 table in 0.32 seconds.
Finished Phase 4 in 0.65 seconds.
Finished plotting in 422.71 seconds (7.05 minutes).
Generating plot 4 / 5: af4c8c746c426eefe030a4ff0cda17908946b905b53afddba3f4946a6de8263d
Running Phase 1
Generating F1…
Finished F1 generation in 0.81 seconds.
Sorting F1…
Finished F1 sort in 9.25 seconds.
Forward propagating to table 2…
Pairing L/R groups…
Finished pairing L/R groups in 9.2080 seconds. Created 4294967296 pairs.
Average of 236.1406 pairs per group.
Computing Fx…
Finished computing Fx in 8.1760 seconds.
Waiting for last plot to finish being written to disk…
Previous plot …/foo/plot-k32-2022-11-17-10-15-d217721e59408550b1f0bd6d4da19c6eb02d952bb65e2c1f815d8a2836cb1242.plot.tmp finished writing to disk:
Table 1 pointer : 4096 ( 0x0000000000001000 )
Table 2 pointer : 14839459840 ( 0x0000000374803000 )
Table 3 pointer : 28822339584 ( 0x00000006b5f20000 )
Table 4 pointer : 42911772672 ( 0x00000009fdbdb000 )
Table 5 pointer : 57272975360 ( 0x0000000d55bc4000 )
Table 6 pointer : 72368041984 ( 0x00000010d978b000 )
Table 7 pointer : 89825079296 ( 0x00000014e9fdf000 )
C1 table pointer : 107540037632 ( 0x0000001909e2c000 )
C2 table pointer : 107541757952 ( 0x0000001909fd0000 )
C3 table pointer : 107541762048 ( 0x0000001909fd1000 )
Sorting entries…
Finished sorting in 11.31 seconds.
Finished forward propagating table 2 in 28.99 seconds.
Forward propagating to table 3…
Pairing L/R groups…
Finished pairing L/R groups in 5.7730 seconds. Created 4294967296 pairs.
Average of 236.1406 pairs per group.
Computing Fx…
Finished computing Fx in 8.3750 seconds.
Sorting entries…
Finished sorting in 10.61 seconds.
Finished forward propagating table 3 in 24.99 seconds.
Forward propagating to table 4…
Pairing L/R groups…
Finished pairing L/R groups in 5.7530 seconds. Created 4294967296 pairs.
Average of 236.1406 pairs per group.
Computing Fx…
Finished computing Fx in 8.7090 seconds.
Sorting entries…
Finished sorting in 10.62 seconds.
Finished forward propagating table 4 in 25.32 seconds.
Forward propagating to table 5…
Pairing L/R groups…
Finished pairing L/R groups in 5.7500 seconds. Created 4294967296 pairs.
Average of 236.1406 pairs per group.
Computing Fx…
Thank you very much!
It’s two minutes per plot SLOWER than 7713p - something I absolutely did not expect! What memory is used on the system? Is it PC3200?
I read the process is severally memory bound, so I had hopes large cache may help.
Also may I post it on Chia community forum?
If I’m reading that correctly, it’s about 7 mins per plot? I think bladebit is a memory plotter too.
pc3200 yes, though it was with a slow ssd. I wasn’t 100% sure if it was disk plotting vs memory plotting.
I didn’t explicitly set the performance governor, re-running in “performance” mode
./bladebit --threads 64 --count 5 --farmer-key ad65cab5777776b47a54cc2947e2089c8743d0374dcbca44ed98baee55d045fd2a1c9a7b4fd6dfdd71701648bfd67340 --pool-key 8f4b9db4409333ece47f2024e33946d6d312cc0207b704aae63f2fa38eecf0fb8dc658a9fdd41ff1bcf6aa9bda016fb9 --verbose ramplot …/foo
Bladebit Chia Plotter
Version : 2.0.1-dev
Git Commit : 9fac46aff0476e829d476412de18497a3a2f7ed8
Compiled With: gcc 12.2.1
[Global Plotting Config]
Will create 5 plots.
Thread count : 64
Warm start enabled : false
NUMA disabled : false
CPU affinity disabled : false
Farmer public key : ad65cab5777776b47a54cc2947e2089c8743d0374dcbca44ed98baee55d045fd2a1c9a7b4fd6dfdd71701648bfd67340
Pool public key : 8f4b9db4409333ece47f2024e33946d6d312cc0207b704aae63f2fa38eecf0fb8dc658a9fdd41ff1bcf6aa9bda016fb9
Output path : …/foo
System Memory: 492/503 GiB.
Memory required: 416 GiB.
Allocating buffers.
Generating plot 1 / 5: a1ec6ba3d09a5003a3480c7493179c33818bbdfc882bfe59935bc67c22a6d690
Running Phase 1
Generating F1…
Finished F1 generation in 10.16 seconds.
Sorting F1…
Finished F1 sort in 6.66 seconds.
Forward propagating to table 2…
Pairing L/R groups…
Finished pairing L/R groups in 10.0210 seconds. Created 4294967296 pairs.
Average of 236.1406 pairs per group.
Computing Fx…
Finished computing Fx in 8.4540 seconds.
Sorting entries…
Finished sorting in 19.11 seconds.
Finished forward propagating table 2 in 37.82 seconds.
Forward propagating to table 3…
Pairing L/R groups…
Finished pairing L/R groups in 5.7780 seconds. Created 4294958864 pairs.
Average of 236.1402 pairs per group.
Computing Fx…
Finished computing Fx in 8.5350 seconds.
Sorting entries…
Finished sorting in 12.57 seconds.
Finished forward propagating table 3 in 27.12 seconds.
Forward propagating to table 4…
Pairing L/R groups…
Finished pairing L/R groups in 5.7760 seconds. Created 4294913293 pairs.
Average of 236.1377 pairs per group.
Computing Fx…
Finished computing Fx in 8.6860 seconds.
Sorting entries…
Finished sorting in 12.41 seconds.
Finished forward propagating table 4 in 27.10 seconds.
Forward propagating to table 5…
Pairing L/R groups…
Finished pairing L/R groups in 5.7640 seconds. Created 4294809030 pairs.
Average of 236.1319 pairs per group.
Computing Fx…
Finished computing Fx in 9.4090 seconds.
Sorting entries…
Finished sorting in 12.44 seconds.
Finished forward propagating table 5 in 27.85 seconds.
Forward propagating to table 6…
Pairing L/R groups…
Finished pairing L/R groups in 5.7740 seconds. Created 4294607806 pairs.
Average of 236.1209 pairs per group.
Computing Fx…
Finished computing Fx in 8.4610 seconds.
Sorting entries…
Finished sorting in 13.67 seconds.
Finished forward propagating table 6 in 28.14 seconds.
Forward propagating to table 7…
Pairing L/R groups…
Finished pairing L/R groups in 5.7190 seconds. Created 4294239510 pairs.
Average of 236.1006 pairs per group.
Computing Fx…
Finished computing Fx in 8.3270 seconds.
Finished forward propagating table 7 in 14.28 seconds.
Finished Phase 1 in 179.13 seconds.
Running Phase 2
Prunning table 6…
Finished prunning table 6 in 0.25 seconds.
Prunning table 5…
Finished prunning table 5 in 9.07 seconds.
Prunning table 4…
Finished prunning table 4 in 8.65 seconds.
Prunning table 3…
Finished prunning table 3 in 8.47 seconds.
Prunning table 2…
Finished prunning table 2 in 8.42 seconds.
Finished Phase 2 in 35.05 seconds.
Running Phase 3
Compressing tables 1 and 2…
Finished compressing tables 1 and 2 in 38.30 seconds
Table 1 now has 3429363327 / 4294967296 entries ( 79.85% ).
Compressing tables 2 and 3…
Finished compressing tables 2 and 3 in 38.94 seconds
Table 2 now has 3439858405 / 4294958864 entries ( 80.09% ).
Compressing tables 3 and 4…
Finished compressing tables 3 and 4 in 39.22 seconds
Table 3 now has 3466025751 / 4294913293 entries ( 80.70% ).
Compressing tables 4 and 5…
Finished compressing tables 4 and 5 in 39.95 seconds
Table 4 now has 3532783162 / 4294809030 entries ( 82.26% ).
Compressing tables 5 and 6…
Finished compressing tables 5 and 6 in 41.84 seconds
Table 5 now has 3713299788 / 4294607806 entries ( 86.46% ).
Compressing tables 6 and 7…
Finished compressing tables 6 and 7 in 26.35 seconds
Table 6 now has 4294239510 / 4294239510 entries ( 100.00% ).
Finished Phase 3 in 224.61 seconds.
Running Phase 4
Writing P7.
Finished writing P7 in 0.32 seconds.
Writing C1 table.
Finished writing C1 table in 0.01 seconds.
Writing C2 table.
Finished writing C2 table in 0.00 seconds.
Writing C3 table.
Finished writing C3 table in 0.32 seconds.
Finished Phase 4 in 0.65 seconds.
Finished plotting in 439.45 seconds (7.32 minutes).
Generating plot 2 / 5: 71cee042c9837e669c98f15b2a124053f45451f8b7245ffa4027682634404127
Running Phase 1
Generating F1…
Finished F1 generation in 0.82 seconds.
Sorting F1…
Finished F1 sort in 9.08 seconds.
Forward propagating to table 2…
Pairing L/R groups…
Finished pairing L/R groups in 9.6040 seconds. Created 4294923397 pairs.
Average of 236.1382 pairs per group.
Computing Fx…
Finished computing Fx in 8.6650 seconds.
Waiting for last plot to finish being written to disk…
Previous plot …/foo/plot-k32-2022-11-17-16-41-a1ec6ba3d09a5003a3480c7493179c33818bbdfc882bfe59935bc67c22a6d690.plot.tmp finished writing to disk:
Table 1 pointer : 4096 ( 0x0000000000001000 )
Table 2 pointer : 14839373824 ( 0x00000003747ee000 )
Table 3 pointer : 28822204416 ( 0x00000006b5eff000 )
Table 4 pointer : 42911404032 ( 0x00000009fdb81000 )
Table 5 pointer : 57271963648 ( 0x0000000d55acd000 )
Table 6 pointer : 72366313472 ( 0x00000010d95e5000 )
Table 7 pointer : 89822150656 ( 0x00000014e9d14000 )
C1 table pointer : 107535892480 ( 0x0000001909a38000 )
C2 table pointer : 107537612800 ( 0x0000001909bdc000 )
C3 table pointer : 107537616896 ( 0x0000001909bdd000 )
Sorting entries…
Finished sorting in 12.20 seconds.
Finished forward propagating table 2 in 30.76 seconds.
Forward propagating to table 3…
Pairing L/R groups…
Finished pairing L/R groups in 5.7340 seconds. Created 4294837530 pairs.
Average of 236.1335 pairs per group.
Computing Fx…
Finished computing Fx in 8.3670 seconds.
Sorting entries…
Finished sorting in 10.95 seconds.
Finished forward propagating table 3 in 25.29 seconds.
Forward propagating to table 4…
Pairing L/R groups…
Finished pairing L/R groups in 5.7430 seconds. Created 4294706509 pairs.
Average of 236.1263 pairs per group.
Computing Fx…
Finished computing Fx in 8.6870 seconds.
Sorting entries…
Finished sorting in 10.96 seconds.
Finished forward propagating table 4 in 25.62 seconds.
Forward propagating to table 5…
Pairing L/R groups…
Finished pairing L/R groups in 5.7400 seconds. Created 4294474198 pairs.
Average of 236.1135 pairs per group.
Computing Fx…
Finished computing Fx in 9.4330 seconds.
Sorting entries…
Finished sorting in 10.95 seconds.
Finished forward propagating table 5 in 26.36 seconds.
Forward propagating to table 6…
Pairing L/R groups…
Finished pairing L/R groups in 5.7630 seconds. Created 4293916698 pairs.
Average of 236.0829 pairs per group.
Computing Fx…
Finished computing Fx in 8.4640 seconds.
Sorting entries…
Finished sorting in 12.18 seconds.
Finished forward propagating table 6 in 26.64 seconds.
Forward propagating to table 7…
Pairing L/R groups…
Finished pairing L/R groups in 5.7460 seconds. Created 4292762784 pairs.
Average of 236.0194 pairs per group.
Computing Fx…
Finished computing Fx in 8.2930 seconds.
Finished forward propagating table 7 in 14.27 seconds.
Finished Phase 1 in 158.83 seconds.
Running Phase 2
Prunning table 6…
Finished prunning table 6 in 0.25 seconds.
Prunning table 5…
Finished prunning table 5 in 9.07 seconds.
Prunning table 4…
Finished prunning table 4 in 8.65 seconds.
Prunning table 3…
Finished prunning table 3 in 8.47 seconds.
Prunning table 2…
Finished prunning table 2 in 8.42 seconds.
Finished Phase 2 in 35.06 seconds.
Running Phase 3
Compressing tables 1 and 2…
Finished compressing tables 1 and 2 in 38.30 seconds
Table 1 now has 3429325848 / 4294923397 entries ( 79.85% ).
Compressing tables 2 and 3…
Finished compressing tables 2 and 3 in 38.92 seconds
Table 2 now has 3439717438 / 4294837530 entries ( 80.09% ).
Compressing tables 3 and 4…
Finished compressing tables 3 and 4 in 39.23 seconds
Table 3 now has 3465761630 / 4294706509 entries ( 80.70% ).
Compressing tables 4 and 5…
Finished compressing tables 4 and 5 in 39.96 seconds
Table 4 now has 3532334036 / 4294474198 entries ( 82.25% ).
Compressing tables 5 and 6…
Finished compressing tables 5 and 6 in 41.98 seconds
Table 5 now has 3712511792 / 4293916698 entries ( 86.46% ).
Compressing tables 6 and 7…
Finished compressing tables 6 and 7 in 25.32 seconds
Table 6 now has 4292762784 / 4292762784 entries ( 100.00% ).
Finished Phase 3 in 223.69 seconds.
Running Phase 4
Writing P7.
Finished writing P7 in 0.32 seconds.
Writing C1 table.
Finished writing C1 table in 0.01 seconds.
Writing C2 table.
Finished writing C2 table in 0.00 seconds.
Writing C3 table.
Finished writing C3 table in 0.32 seconds.
Finished Phase 4 in 0.65 seconds.
Finished plotting in 418.24 seconds (6.97 minutes).
Generating plot 3 / 5: fc225e14dd7c94188f0d01084208d29c67e99fcc507e93f123b1520c9a58b018
Running Phase 1
Generating F1…
Finished F1 generation in 0.81 seconds.
Sorting F1…
Finished F1 sort in 9.05 seconds.
Forward propagating to table 2…
Pairing L/R groups…
Finished pairing L/R groups in 9.4330 seconds. Created 4294943392 pairs.
Average of 236.1393 pairs per group.
Computing Fx…
Finished computing Fx in 8.1780 seconds.
Waiting for last plot to finish being written to disk…
Previous plot …/foo/plot-k32-2022-11-17-16-48-71cee042c9837e669c98f15b2a124053f45451f8b7245ffa4027682634404127.plot.tmp finished writing to disk:
Table 1 pointer : 4096 ( 0x0000000000001000 )
Table 2 pointer : 14839214080 ( 0x00000003747c7000 )
Table 3 pointer : 28821471232 ( 0x00000006b5e4c000 )
Table 4 pointer : 42909597696 ( 0x00000009fd9c8000 )
Table 5 pointer : 57268334592 ( 0x0000000d55757000 )
Table 6 pointer : 72359481344 ( 0x00000010d8f61000 )
Table 7 pointer : 89809317888 ( 0x00000014e90d7000 )
C1 table pointer : 107516968960 ( 0x000000190882c000 )
C2 table pointer : 107518689280 ( 0x00000019089d0000 )
C3 table pointer : 107518693376 ( 0x00000019089d1000 )
Sorting entries…
Finished sorting in 12.21 seconds.
Finished forward propagating table 2 in 30.12 seconds.
Forward propagating to table 3…
Pairing L/R groups…
Finished pairing L/R groups in 5.7560 seconds. Created 4294857640 pairs.
Average of 236.1346 pairs per group.
Computing Fx…
Finished computing Fx in 8.3700 seconds.
Sorting entries…
Finished sorting in 10.95 seconds.
Finished forward propagating table 3 in 25.31 seconds.
Forward propagating to table 4…
Pairing L/R groups…
Finished pairing L/R groups in 5.7400 seconds. Created 4294655738 pairs.
Average of 236.1235 pairs per group.
Computing Fx…
Finished computing Fx in 8.6800 seconds.
Sorting entries…
It definitely is memory plotting according to log and key memplot is used. Apparently 7773X just sucks for plotting…
By the way Wendell if you ever have time - please try it on new Epycs! Just change --threads parameter to core count. Garold (bladebit author) says the plotter is memory bus bound above ~40 cores on Epyc Milan, so the idea was large cache would help, but somehow it didn’t. New Epycs have DDR5 - so we might see some interesting results. Especially taht 32 cores high speed piece with additional interlink chanel to io die.
Ok stand by
$ ./bladebit --threads 64 --count 5 --farmer-key ad65cab5777776b47a54cc2947e2089c8743d0374dcbca44ed98baee55d045fd2a1c9a7b4fd6dfdd71701648bfd67340 --pool-key 8f4b9db4409333ece47f2024e33946d6d312cc0207b704aae63f2fa38eecf0fb8dc658a9fdd41ff1bcf6aa9bda016fb9 --verbose ramplot …/foo
Bladebit Chia Plotter
Version : 2.0.1-dev
Git Commit : 9fac46aff0476e829d476412de18497a3a2f7ed8
Compiled With: gcc 11.3.0
[Global Plotting Config]
Will create 5 plots.
Thread count : 64
Warm start enabled : false
NUMA disabled : false
CPU affinity disabled : false
Farmer public key : ad65cab5777776b47a54cc2947e2089c8743d0374dcbca44ed98baee55d045fd2a1c9a7b4fd6dfdd71701648bfd67340
Pool public key : 8f4b9db4409333ece47f2024e33946d6d312cc0207b704aae63f2fa38eecf0fb8dc658a9fdd41ff1bcf6aa9bda016fb9
Output path : …/foo
System Memory: 1494/1511 GiB.
Memory required: 416 GiB.
Allocating buffers.
Generating plot 1 / 5: c22ad06aa2438692a47dc4dc4b979718beacf1c6d659148c0a6e0b2afcdbafef
Running Phase 1
Generating F1…
Finished F1 generation in 8.91 seconds.
Sorting F1…
Finished F1 sort in 5.69 seconds.
Forward propagating to table 2…
Pairing L/R groups…
Finished pairing L/R groups in 8.0830 seconds. Created 4294953257 pairs.
Average of 236.1399 pairs per group.
Computing Fx…
Finished computing Fx in 6.6840 seconds.
Sorting entries…
Finished sorting in 15.19 seconds.
Finished forward propagating table 2 in 30.06 seconds.
Forward propagating to table 3…
Pairing L/R groups…
Finished pairing L/R groups in 3.6580 seconds. Created 4294967296 pairs.
Average of 236.1406 pairs per group.
Computing Fx…
Finished computing Fx in 6.5440 seconds.
Sorting entries…
Finished sorting in 10.12 seconds.
Finished forward propagating table 3 in 20.42 seconds.
Forward propagating to table 4…
Pairing L/R groups…
Finished pairing L/R groups in 3.6480 seconds. Created 4294967296 pairs.
Average of 236.1406 pairs per group.
Computing Fx…
Finished computing Fx in 6.6700 seconds.
Sorting entries…
Finished sorting in 9.58 seconds.
Finished forward propagating table 4 in 20.00 seconds.
Forward propagating to table 5…
Pairing L/R groups…
Finished pairing L/R groups in 3.6410 seconds. Created 4294967296 pairs.
Average of 236.1406 pairs per group.
Computing Fx…
Finished computing Fx in 6.7140 seconds.
Sorting entries…
Finished sorting in 9.58 seconds.
Finished forward propagating table 5 in 20.03 seconds.
Forward propagating to table 6…
Pairing L/R groups…
Finished pairing L/R groups in 3.6540 seconds. Created 4294878077 pairs.
Average of 236.1357 pairs per group.
Computing Fx…
Finished computing Fx in 6.6240 seconds.
Sorting entries…
Finished sorting in 9.30 seconds.
Finished forward propagating table 6 in 19.67 seconds.
Forward propagating to table 7…
Pairing L/R groups…
Finished pairing L/R groups in 3.6410 seconds. Created 4294698651 pairs.
Average of 236.1259 pairs per group.
Computing Fx…
Finished computing Fx in 6.4100 seconds.
Finished forward propagating table 7 in 10.15 seconds.
Finished Phase 1 in 134.93 seconds.
Running Phase 2
Prunning table 6…
Finished prunning table 6 in 0.11 seconds.
Prunning table 5…
Finished prunning table 5 in 8.62 seconds.
Prunning table 4…
Finished prunning table 4 in 8.16 seconds.
Prunning table 3…
Finished prunning table 3 in 7.99 seconds.
Prunning table 2…
Finished prunning table 2 in 8.00 seconds.
Finished Phase 2 in 32.92 seconds.
Running Phase 3
Compressing tables 1 and 2…
Finished compressing tables 1 and 2 in 7.54 seconds
Table 1 now has 3429409270 / 4294953257 entries ( 79.85% ).
Compressing tables 2 and 3…
Finished compressing tables 2 and 3 in 7.68 seconds
Table 2 now has 3439937588 / 4294967296 entries ( 80.09% ).
Compressing tables 3 and 4…
Finished compressing tables 3 and 4 in 7.65 seconds
Table 3 now has 3466151312 / 4294967296 entries ( 80.70% ).
Compressing tables 4 and 5…
Finished compressing tables 4 and 5 in 7.74 seconds
Table 4 now has 3533005693 / 4294967296 entries ( 82.26% ).
Compressing tables 5 and 6…
Finished compressing tables 5 and 6 in 8.14 seconds
Table 5 now has 3713591941 / 4294878077 entries ( 86.47% ).
Compressing tables 6 and 7…
Finished compressing tables 6 and 7 in 8.92 seconds
Table 6 now has 4294698651 / 4294698651 entries ( 100.00% ).
Finished Phase 3 in 47.66 seconds.
Running Phase 4
Writing P7.
Finished writing P7 in 0.12 seconds.
Writing C1 table.
Finished writing C1 table in 0.00 seconds.
Writing C2 table.
Finished writing C2 table in 0.00 seconds.
Writing C3 table.
Finished writing C3 table in 0.12 seconds.
Finished Phase 4 in 0.24 seconds.
Finished plotting in 215.75 seconds (3.60 minutes).
Generating plot 2 / 5: 9574c72a4c65cf7ab755b5351117c37c8814e85b652cd711868266a009306685
Running Phase 1
Generating F1…
Finished F1 generation in 0.47 seconds.
Sorting F1…
Finished F1 sort in 3.66 seconds.
Forward propagating to table 2…
Pairing L/R groups…
Finished pairing L/R groups in 3.6450 seconds. Created 4294962094 pairs.
Average of 236.1403 pairs per group.
Computing Fx…
Finished computing Fx in 6.4350 seconds.
Waiting for last plot to finish being written to disk…
this is AMD EPYC 9374F 32-Core Processor x2
should I have run the other with 128 threads instead of 64? it was a 2x 7773 system.
3,6 minutes is absolute record, but at least on Milan generation two CPU systems are only 25% fast then single CPU. Could you run single 9374F with 32 threads? I suspect it will be only marginally slower.
ok, underway. though that suggests some architectural issue in software as I can get near 2x scaling with every other multithread process across 2 socket systems w/milan in any core count config
Probably.
Also about this:
Finished Phase 1 in 134.93 seconds
When Phase 1 can be done under 30 seconds - in theory Chia can be turned to proof of work because you can generate a plot that alway passes 1/512 filter - and actually only phase 1 matters - the rest is just compression. So in theory 4 times faster system than what you have now can be a substitute of 51 Tb os space. Not that I thing it can be remotely economical at this stage, but the day when they will have to increase minimum plot size and force everyone to replot is probably no more than 2 CPU generations apart. May be earlier if HBM on chip will be big enough to fit one table. Waiting impatiently new HBM Xeons!
(base) amd@nprp:~/bladebit/build-release$ ./bladebit --threads 32 --count 5 --farmer-key ad65cab5777776b47a54cc2947e2089c8743d0374dcbca44ed98baee55d045fd2a1c9a7b4fd6dfdd71701648bfd67340 --pool-key 8f4b9db4409333ece47f2024e33946d6d312cc0207b704aae63f2fa38eecf0fb8dc658a9fdd41ff1bcf6aa9bda016fb9 --verbose ramplot …/foo
Bladebit Chia Plotter
Version : 2.0.1-dev
Git Commit : 9fac46aff0476e829d476412de18497a3a2f7ed8
Compiled With: gcc 11.3.0
[Global Plotting Config]
Will create 5 plots.
Thread count : 32
Warm start enabled : false
NUMA disabled : false
CPU affinity disabled : false
Farmer public key : ad65cab5777776b47a54cc2947e2089c8743d0374dcbca44ed98baee55d045fd2a1c9a7b4fd6dfdd71701648bfd67340
Pool public key : 8f4b9db4409333ece47f2024e33946d6d312cc0207b704aae63f2fa38eecf0fb8dc658a9fdd41ff1bcf6aa9bda016fb9
Output path : …/foo
System Memory: 1495/1511 GiB.
Memory required: 416 GiB.
Allocating buffers.
Generating plot 1 / 5: 16dd6c8b7b3d2fa025228d4c1395e96ac546a5eae875f0d2505fb9254dd7c292
Running Phase 1
Generating F1…
Finished F1 generation in 8.20 seconds.
Sorting F1…
Finished F1 sort in 8.00 seconds.
Forward propagating to table 2…
Pairing L/R groups…
Finished pairing L/R groups in 11.2780 seconds. Created 4294967296 pairs.
Average of 236.1406 pairs per group.
Computing Fx…
Finished computing Fx in 13.1280 seconds.
Sorting entries…
Finished sorting in 16.11 seconds.
Finished forward propagating table 2 in 40.67 seconds.
Forward propagating to table 3…
Pairing L/R groups…
Finished pairing L/R groups in 7.1740 seconds. Created 4294945184 pairs.
Average of 236.1394 pairs per group.
Computing Fx…
Finished computing Fx in 13.0390 seconds.
Sorting entries…
Finished sorting in 13.33 seconds.
Finished forward propagating table 3 in 33.70 seconds.
Forward propagating to table 4…
Pairing L/R groups…
Finished pairing L/R groups in 7.1880 seconds. Created 4294953792 pairs.
Average of 236.1399 pairs per group.
Computing Fx…
Finished computing Fx in 13.3250 seconds.
Sorting entries…
Finished sorting in 12.49 seconds.
Finished forward propagating table 4 in 33.16 seconds.
Forward propagating to table 5…
Pairing L/R groups…
Finished pairing L/R groups in 7.1910 seconds. Created 4294960589 pairs.
Average of 236.1403 pairs per group.
Computing Fx…
Finished computing Fx in 13.4050 seconds.
Sorting entries…
Finished sorting in 12.49 seconds.
Finished forward propagating table 5 in 33.24 seconds.
Forward propagating to table 6…
Pairing L/R groups…
Finished pairing L/R groups in 7.1900 seconds. Created 4294914872 pairs.
Average of 236.1377 pairs per group.
Computing Fx…
Finished computing Fx in 13.1940 seconds.
Sorting entries…
Finished sorting in 11.89 seconds.
Finished forward propagating table 6 in 32.43 seconds.
Forward propagating to table 7…
Pairing L/R groups…
Finished pairing L/R groups in 7.1690 seconds. Created 4294903999 pairs.
Average of 236.1371 pairs per group.
Computing Fx…
Finished computing Fx in 12.7640 seconds.
Finished forward propagating table 7 in 20.09 seconds.
Finished Phase 1 in 209.48 seconds.
Running Phase 2
Prunning table 6…
Finished prunning table 6 in 0.17 seconds.
Prunning table 5…
Finished prunning table 5 in 3.29 seconds.
Prunning table 4…
Finished prunning table 4 in 3.02 seconds.
Prunning table 3…
Finished prunning table 3 in 3.00 seconds.
Prunning table 2…
Finished prunning table 2 in 3.04 seconds.
Finished Phase 2 in 12.60 seconds.
Running Phase 3
Compressing tables 1 and 2…
Finished compressing tables 1 and 2 in 10.01 seconds
Table 1 now has 3429415094 / 4294967296 entries ( 79.85% ).
Compressing tables 2 and 3…
Finished compressing tables 2 and 3 in 10.23 seconds
Table 2 now has 3439904112 / 4294945184 entries ( 80.09% ).
Compressing tables 3 and 4…
Finished compressing tables 3 and 4 in 10.12 seconds
Table 3 now has 3466110727 / 4294953792 entries ( 80.70% ).
Compressing tables 4 and 5…
Finished compressing tables 4 and 5 in 10.30 seconds
Table 4 now has 3533000331 / 4294960589 entries ( 82.26% ).
Compressing tables 5 and 6…
Finished compressing tables 5 and 6 in 10.82 seconds
Table 5 now has 3713660293 / 4294914872 entries ( 86.47% ).
Compressing tables 6 and 7…
Finished compressing tables 6 and 7 in 11.92 seconds
Table 6 now has 4294903999 / 4294903999 entries ( 100.00% ).
Finished Phase 3 in 63.41 seconds.
Running Phase 4
Writing P7.
Finished writing P7 in 0.16 seconds.
Writing C1 table.
Finished writing C1 table in 0.00 seconds.
Writing C2 table.
Finished writing C2 table in 0.00 seconds.
Writing C3 table.
Finished writing C3 table in 0.25 seconds.
Finished Phase 4 in 0.41 seconds.
Finished plotting in 285.89 seconds (4.76 minutes).
Generating plot 2 / 5: 6ae34160f2c27a7397c363077780777f660aefe51f7da83acd27892a776c61a0
Running Phase 1
Generating F1…
Finished F1 generation in 0.71 seconds.
Sorting F1…
Finished F1 sort in 6.36 seconds.
Forward propagating to table 2…
Pairing L/R groups…
Finished pairing L/R groups in 7.1770 seconds. Created 4294920146 pairs.
Average of 236.1380 pairs per group.
Computing Fx…
Finished computing Fx in 12.8420 seconds.
Waiting for l
Thnx! So roughly a bit cheaper 32 core Genoa does 1 minute faster than 64 core Milan.
will try the 96 core in a few days. I am 95% sure that if I create some hard partitions or pin processes, that I could get 1.8x-1.9x scaling of this figure by doing two jobs in parallel, one per socket and say (everything spawned from this command pin to socket 0/ from this command pin to socket 1)
and it would be close to 2x scaling