40 Comments

  1. malandanza
    January 27, 2017 @ 11:07 am

    Thus would be the perfect setup if you could run the cards undervolted. I’ve been mining for 4 years now in ubuntu rigs but only recently I had to switch to windoze because the lack of undervolt software in linux. My 7970s and 280Xs are undervolted already in bios but with my 290Xs and Furys I didn’t find it so easy to edit bios so I use software.

    Reply

    • Rolf
      February 20, 2017 @ 5:25 pm

      I agree with you about the undervolting. It can help reduce the amount of power used while keeping the hashrate the same.

      The best way to do it if you want to run in Linux for now is to change the BIOS in Windows then run it in Ubuntu. There may be a way to do this in Ubuntu also, but it is not something I have had the time to look into.

      I hope to be undervolting my cards in the next few months then writing an article on it.

      Reply

  2. CDSystems
    February 14, 2017 @ 8:47 pm

    Rolf,

    Great post. We will surely be using this as we craft our own build.

    My first thoughts surround the Power Supply 2:
    Can you give a noob like me some additional explanation of the purpose of this additional power supply?
    -Perhaps you could include some more pictures of how it interfaces with the Motherboard and the GPUs.

    Is it possible to run the entire machine from these power supplies? Why do we need to buy the “traditional” PSUs at all? Also what is the point of purchasing two of these additional HP power supplies?

    Reply

    • Rolf
      February 14, 2017 @ 9:03 pm

      The Radeon Fury X’s use a lot of electricity. probably about 275 watts per device. When I measure total power usage on the rig, it is about 1700 watts.

      The Antec 1300 watt power supply powers the motherboard, CPU, processor, and the riser card power for the 6 riser cards.

      The HP power supply, which only supplies 12 volts DC, is used to plug into the PCI-E plugs on 3 of the video cards, while the other 3 cards are powered by the Antec 1300 watt supply.

      If more power efficient GPU’s were used, like RX480’s or Nano’s, the the HP server power supply would not be necessary.

      Reply

  3. CDSystems
    February 14, 2017 @ 9:36 pm

    Ok that makes sense. Give me your thoughts on yet another alternative build.

    Your Build (94% efficiency on the main PSU):
    Antec 1300W power supply (efficiency at 94%) == $252
    HP Power Supply and Components == $81
    Total Power == 2500W
    Total Cost == $333

    Alternative Build (96% efficiency on the main PSU):
    EVGA 750W Titanium power supply (efficiency at 96%) == $150 https://www.amazon.com/dp/B018JYHB2S/ref=psdc_1161760_t3_B00EKJQM5E?th=1
    HP Power Supply and Components == $81
    Total Power == 1950W
    Total Cost == $231

    So with my alternative build we have efficiency on the main PSU that is 2% more efficient, the total power exceeds the power drawn from the rig (1700W at the wall), and you save $102.

    What am I missing here?

    Reply

    • Rolf
      February 14, 2017 @ 9:52 pm

      It sounds like you would power 4 of the GPU’s from the HP surplus server power supply and 2 of them from the 750 Watt EVGA. That should work just fine.

      You could try it, but don’t plug it into 120 VAC. Power supplies provide rated power at above 200 VAC, so you’ll get funny thing happening at the lower voltage.

      Also, if you look at the efficiency curve vs. rated load of power supplies, it is not flat. You tend to get the best efficiency at 60-70% of rated power. The extra cost on Titanium would be offset by a lower efficiency if you drive it too hard.

      Also, HP server power supplies are confusing. I have to double check the part numbers every time I get them to make sure I actually buy the 94% efficiency supplies.

      One of the best things you can do is get a few wattmeters. They are about $25 each on Amazon. Then build a few different designs and test the actual wall power used.

      Reply

  4. CDSystems
    February 14, 2017 @ 9:37 pm

    Sorry about the formatting. It seems to have disregarded any of the formatting that I tried to put there

    Reply

  5. CDSystems
    February 14, 2017 @ 10:51 pm

    Alright that all makes sense to me.

    Still save $20 even if you added a second HP power supply but you might start running out of room on those Power Distribution strips (so that would be prohibitive and thus it probably makes sense to do it like you originally explained).

    Thank you for the extra commentary.

    Reply

    • Rolf
      February 20, 2017 @ 5:27 pm

      As you run multiple power supplies on a single server, you have to be careful about small DC voltage level differences causing current within the cards or motherboard themselves.

      That’s why when I use a second power supply, like an HP, I use it just to power the PCI-E connectors on the GPU’s for 3 of the GPU’s, and nothing else. Everything else gets powered from the main power supply.

      Reply

  6. An Easy Way to GPU Mine Ether, Monero and Zcash | BTCMANAGER
    February 15, 2017 @ 8:49 am

    […] If you found the process of mining intriguing and want to take another step, get ready to get your hands dirty. After playing around with mining on a laptop with GPU’s, the next phase is to build a mining rig composed of multiple GPU’s, with an illustrative guide found here. […]

    Reply

  7. Spencer Gordon
    February 19, 2017 @ 3:39 am

    I am definitely interested in this! Are there any HP server PSUs that you know lf that are 80 plus titanium? I am willing to spend a bit more upfront to get the best efficiency and lowest wasted power. Also, is 8 the maximum number of gpus ubuntu can take?

    Reply

    • Rolf
      February 20, 2017 @ 6:17 pm

      Basically, you are looking for a HP common slot server power supply like a DPS-1200-FBA. Here is one on Amazon for $35 that works well:
      579229-001 – New Bulk HP 1200W CS Platinum Power Sup link http://amzn.to/2l1oUi5

      I like this more complete list from Gigampz for HP power supplies that rates them by efficiency. Gigampz adapter boards for HP power supplies work well also:
      http://www.gigampz.com/store/p19/Gigampz_CS_v2_Adapter_Board_%28DPS-1200FBA%2C_Common_Slot%2C_etc…%29.html

      Regarding the maximum number of GPU’s – I don’t go higher than 6, and I have not heard of any motherboards that can take more than 7 GPU’s. It is not just the physical PCI-E slots that are important, it is also the CPU and chipset resources. To that note, none of the newer Intel Skylake boards can take more than GPU’s, as far as I know.

      Reply

  8. CDSystems
    February 19, 2017 @ 10:30 pm

    We are purchasing a couple more rigs for our testing and we are going to use your build specifications that you recommended in your ZCash 6 GPU miner post.

    However, we were considering putting 7 GPUs on a rig instead of 6. Is there any reason why you did not do this for your own rigs?

    The only difference in the motherboard specs (that I can tell) is that your motherboard supports USB 3.1 and it is generally newer than the motherboards that have 7 PCIe slots. Do you think there is any noticeable difference between USB 3.1 and USB 3.0?

    Perhaps there is some other reason why you decided to choose your specific motherboard. If so, can you please elaborate?

    Our (potential) Motherboard:
    https://www.newegg.com/Product/Product.aspx?item=N82E16813128602

    Reply

  9. CDSystems
    February 19, 2017 @ 10:36 pm

    Please ignore the part about the USB 3.1 vs USB 3.0 — my apologies (this irrelevant) as your motherboard does not contain USB 3.1.

    sorry about that

    Reply

  10. Spencer Gordon
    February 21, 2017 @ 3:41 am

    Ok! Thank you!
    I’m looking at a brand new biostar motherboard, the Z270 GT6. It has 7 pcie slots of varying bandwidthand an m.2 slot. I’m going to use up the 7 slots first and then maybe try an m.2 to pcie adapter to make an 8th slot and try that. That would give me 8 gpus at once.
    I will check the psu list out for sure! I’m considering a super flower leadex titanium 1600w psu for my main psu, but they are not easily gotten in the us, so an evga or corsair titanium psu might be what i end up with.
    Lastly, what is the most powerful gpu for mining available today? I know the rx 480 is the most common now, but the fury is much more powerful. I’ve seen that the HD7990 is popular, as are the r9 290x and 390x. What about the r9 nano and fury x? Cost set aside, what is the most powerful gpu for mining available today?

    Reply

    • Rolf
      February 21, 2017 @ 8:04 am

      Spencer, I think you are not going to be happy with that motherboard. There is a problem with the Intel chipset used with the LGA 1151 skylake processors. Even though there are enough physical PCI-E slots to support many GPU’s, there are not enough internal PCI-E lanes to support more than 4 GPU’s.

      I tried this almost a year ago. As you start plugging in GPU’s, when you get to the 5th one, the computer won’t boot.

      Creating a mining rig with more than 4 GPU’s that works requires specific hardware and skill. After you get a 5 or 6 GPU mining rig working, you may be able to get a 7 rig GPU working with the MSI motherboard I used in the pictures above.

      But don’t buy a motherboard that uses the LGA 1151 processor from Intel. It won’t work for more than 4 GPU’s.

      Reply

  11. Spencer Gordon
    February 21, 2017 @ 12:12 pm

    The Celeron you chose for LGA 1150 has the exact same amount of PCIe lanes as the one for Kaby Lake. Also, the z270 chipset adds more lanes than the B85 chipset does.

    Reply

    • Rolf
      February 21, 2017 @ 1:46 pm

      Sounds like you’ve done your research. Please let me know when you get it working. I’d love to have another known good design that I can use in the future.

      Reply

  12. Spencer Gordon
    February 22, 2017 @ 1:53 am

    Absolutely! It may be awhile (money), but when I get it going you will be the first to know!
    With regard to gpus, is the fury the most powerful available? As I said I know there are many gpus of choice for each miner, some swearing by the older ones while others embracing the new ones. Sometimes there are obscure gpus (the r9 295×2, r9 nano), while some use nvidia cards. One question is why workstation gpus have not been accepted as well as mainstream gous. Comparing a radeon to a firepro, the firepro can do math much faster than the regular gpu, and some of the older ones like the w8000 or w9000 can be had for the same price as the radeon gpus. And what about the older quadro cards? I knkw you may not have all the answers, but I’m still getting into this and I want your opinions and thoughts!

    Reply

  13. CD Systems
    February 22, 2017 @ 12:01 pm

    You have to remember that the graphics cards, especially the compute focused cards are sometimes just too powerful for the job. You just don’t need all that compute power, the hashing algorithms are really simple algos. Plus, after looking at NVIDIA cards and buying some machines with GTX 1070s — I would not recommend NVIDIA cards for hashing purposes. You can rent those machines at a much higher premium to people looking for Machine Learning and AI compute resources. Stick to AMD. Also — R9 Fury X has been discontinued, and I heard a rumor that the R9 Nano is going to be discontinued here in the near future. So go get your hands on those cards (ebay) ASAP — they are great cards.

    Reply

  14. Spencer Gordon
    February 27, 2017 @ 3:15 am

    What do you mean “too powerful?” Wouldn’t more power be better?

    Reply

  15. will
    March 3, 2017 @ 1:55 am

    By “too powerful” I mean that they are made for Deep Learning and Artificial intelligence algorithms. The hash function for mining is a very simple algorithm, thus you will be paying a premium for these souped up cards and not getting the hash rate that you need to make up for the price.

    Reply

  16. Spencer Gordon
    March 4, 2017 @ 4:27 am

    I’ve always found it puzzling how that can happen. It seems like they would be able to ram through those simple calculations with ease, especially the older ones like the FireGL or Volta-era Quadros.
    I’m guessing the Fury is the king right now of raw power?

    Reply

  17. Mining Zcash and Zclassic with latest AMD Miners from Claymore and Optiminer - Block Operations
    March 4, 2017 @ 1:10 pm

    Reply

  18. CDSystens
    March 4, 2017 @ 2:37 pm

    Try it out with those others and let us know. It might work but I highly doubt it.

    Post a list of the cards you think might work and if I have the time and money, I’ll purchase and test them and report back here. No guarantees though.

    Reply

  19. Spencer Gordon
    March 15, 2017 @ 2:09 am

    Sorry for the late reply!
    I’m not sure about a total list, but I would probably say the Firepro S series and FireGL from AMD/ATi, and the earlier Quadro and Tesla cards from nvidia, such as the Tesla-architecture models. I’m also curious as to whether the CPU mining programs could be adapted for use on Xeon Phi coproccesor cards. They are available for a few hundred on ebay, so maybe when I get a suitable system going I could take a shot at that. Lastly, I’d be interested in trying to port some of those cpu miners to POWER by IBM. It seems much better for computation, and could be interesting. Couple that with some gpus and/or maybe FPGA cards and it could turn out very well! Or be a huge waste of money but sometimes risks are needed to be taken! Plus, I love messing with hardware, so I’m looking forward to trying these!

    Reply

  20. Jose
    April 9, 2017 @ 7:59 pm

    Hello sir, i have built a rig with 6 r9 furys using the mobo biostar tb85. But there is a problem cant get more than 5 gpu working, windows isnt recognizing the six. im using win 10 x64 pro. i have tried everything and still cant get it work. I dont know if you can help me with that. i already have another rig with r9 furys but im using the asrock h81 and i didnt have problems. so i dont really know what could be the problem using the biostar tb85.

    Reply

    • Rolf
      April 9, 2017 @ 8:05 pm

      Reply

      • Jose
        April 9, 2017 @ 8:39 pm

        Sir, i tried the BIOS settings couple minutes ago, still just recognizing 5 gpu. didnt you change the pciex1 to gen1? i saw in the link they are all on auto. im kinda frustrating because i have two rigs with r9 furys and biostar tb85 with the same problem. I has used asrock h81 before. You are the one person which i see using r9 furys with tb85 and didnt have problems. any suggest? Thanks for your reply.

        Reply

    • CDSystems
      April 10, 2017 @ 10:42 am

      Jose,

      Can you shoot me a DM on Bitcointalk? CDMKUltra

      I’ll try to help you with this.

      Will

      Reply

  21. Luis
    May 15, 2017 @ 12:24 pm

    Rolf,

    It is not clear to me how to run both PSU at the same time. Could you make a detailed explanation? It is necessary an extra adapter like the Add2PSU?

    Please check out this cable adapter:
    18AWG PCI-E 6pin to Dual 8-pin Y-Splitter Extension Cable 2X (6+2pin) Cable
    http://bit.ly/2riZ1Oo

    Maybe I’m wrong but because this adapter is designed to power up the GPU riser boards as well as the GPU itselves… I guess it’s possible to run all 6 GPU to the HP DPS-1200FB and use a smaller ATX PSU to run the motherboard, CPU, etc.

    According to this… My hypothetical config would be something like this:
    – HP DPS-1200FB ($30)
    – X5 Breakout Board Adapter compatible with HP DPS-1200FB or Delta DPS-2400AB: $24
    – 18AWG PCI-E 6pin to Dual 8-pin Y-Splitter Extension Cable 2X (6+2pin) Cable: $ 25 by 6 units
    – EVGA 450 B1 80+ BRONZE 450W PSU (http://amzn.to/2pO1SxA): $35
    Total investment: $84

    Do you think this config is feasible?

    Thanks for your help!

    Reply

  22. MindALot
    May 17, 2017 @ 9:27 pm

    Case/motherboard screws… you left out case screws from the list (for those of us who don’t have an extra set of motherboard risers/screws.

    (If it’s there I cannot see it).

    I messed up and went with 1070’s. Which uses less power (I have 2 of them limited to 115w) – but.. I underbought the power supply for the motherboard. It is a 430 watt PSU. It _should_ have enough power (hoping to only need about 220 watt from the high risers).. but I don’t have enough high end connections (mostly sata, and a few molex on the same line – with no way to change the molex to pcie power connection the high riser wants).

    Thoughts on how to fix my build?

    Reply

  23. Vital
    July 4, 2017 @ 9:47 am

    Great article! Please write instruction for nvidia cards) thank you and great from Ukraine.

    Reply

  24. masood
    September 23, 2017 @ 9:51 am

    Dear Freind
    i have some problem and i need ur help , after installation step by step Z-cash on ubuntu 16.04 , and start ./mine.sh i have this pm “OpenCL error: Failed to list OpenCL platforms! (Unknown OpenCL error -1001)”
    thanks Alot
    Masood

    Reply

  25. Jose Guedez
    September 27, 2017 @ 1:53 pm

    Buenas tardes, he configurado mi archivo mine.sh de la siguiente manera:

    #!/bin/bash

    # General options

    # The following line did not have any effect on my system but might reduce CPU usage on some.
    # export GPU_SYNC_OBJECTS=1
    export GPU_FORCE_64BIT_PTR=1

    # Example pools

    # Flypool (encrypted connection):
    # uses cash address as use
    #stratum+tcp://zec.coinmine.pl:7007
    #USER=
    #PASSWORD=

    # Nicehash:
    # uses bitcoin address as user
    #POOL=equihash.usa.nicehash.com:3357
    #USER=19STEagfLfbb1XdTF9NCf5kmxZHGchSiZj
    #PASSWORD=x

    # suprnova.cc
    #POOL=zec.suprnova.cc:2142
    #USER=Weblogin.Worker
    #PASSWORD=WorkerPassword

    cd “$(dirname “$0″)”
    while true
    do
    ./optiminer-zcash -s stratum+tcp://zec.coinmine.pl -u Jguedezunefa.elrusso91 -p */nueva001*/ –watchdog-timeout 30 –watchdog-cmd “./watchdog-cmd.sh”
    if [ $? -eq 134 ]
    then
    break
    fi
    done

    when running

    [email protected]:~/optiminer-zcash$ sudo ./mine.sh
    sudo: ./mine.sh: orden no encontrada

    Reply

  26. 使用GPU轻松挖掘以太币,门罗币和零币 – 君乐日志
    November 6, 2017 @ 12:31 am

    […] 如果你发现了挖矿的乐趣,并且想要更加专业化,那你就需要放开手脚了。你在完成用笔记本GPU挖矿之后,下一个阶段就是建立一个由多个GPU组成的群组。说明指南点击这里。 […]

    Reply

  27. Giuseppe
    March 6, 2018 @ 11:27 am

    Hi Rolf,
    Is hardware cooling an issue? Why you are using air cooling and not liquid cooling?
    With liquid cooling you could also overclock the GPUs.

    Reply

  28. BobDodds
    April 13, 2018 @ 12:12 am

    That HP power supply is a 240v, so it is only an 800w psu on 120v. I learned this from comments on several of them for sale on amazon. I was about to buy one, and everything else on your list. I ended up with a Thermaltake 1500w for about the same price as your pair of psu’s. People were describing low performance and the type of issues you face with so many of your risers acting up, could be your HP psu.

    Giuseppe, I have wonderred about water cooling because I have not run into a single mention of water cooling for mining! I used to build desktops and even water cooled the hard drives–raid arrays–stupid but I get obsessed. Yeah, we ought to be watercooling for mining man.

    Reply

Leave a Reply

Your email address will not be published. Required fields are marked *