arm is very primed to take a lot of market share of server market from intel. Amazon is already very committed on making their graviton arm cpu their main cpu, which they own a huge lion share of the server market on alone.
for consumers, arm adoption is fully reliant on the respective operating systems and compatibility to get ironed out.
Linux works great on ARM, I just want something similar to most mini-ITX boards (4x SATA, 2x mini-PCIe, and RAM slots), and I’ll convert my DIY NAS to ARM. But there just isn’t anything between RAM-limited SBCs and datacenter ARM boards.
For servers, AWS Graviton seems to be pretty solid. I honestly don’t need top performance and could probably get away with a Quartz64 SBC, I just don’t want to worry about RAM and would really like 16GB. I just need to server a dozen or so docker containers with really low load, and I want to do that with as little power as I can get away with for minimum noise. It doesn’t need to transcode or anything.
Man so many SBCs come so close to what you’re looking for but no one has that level of I/O. I was just looking at the ZimaBlade / ZimaBoard and they don’t quite get there either: 2 x SATA and a PCIe 2.0 x4. ZimaBlade has Thunderbolt 4, maybe you can squeeze a few more drives in there with a separate power supply? Seems mildly annoying but on the other hand, their SBCs only draw like 10 watts.
Not sure what your application is but if you’re open to clustering them that could be an option.
4 NAS HDD drives - will be SATA, but could use PCIe expansion; currently have 2 8TB 3.5" HDDs, want flexibility to add 2x more
minimum CPU performance - was fine on my Phenom II x4, so not a high bar, but the Phenom II x4 has better single core than ZimaBlade
Services:
I/O heavy - Jellyfin (no live transcoding), Collabora (and NextCloud/ownCloud), samba, etc
CPU heavy - CI/CD for Rust projects (relatively infrequent and not a hard req), gaming servers (Minecraft for now), speech processing (maybe? Looking to build Alexa alt)
others - actual budget, vault warden, Home Assistant
The ZimaBlade is probably good enough (would need to figure out SATA power), I’ll have to look at some performance numbers. I’m a little worried since it seems to be worse than my old Phenom II x4, which was the old CPU for this machine. I’m currently using my old Ryzen 1700, but I’d be fine downgrading a bit if it meant significantly lower power usage. I’d really like to put this under my bed, and it needs to be very quiet to do that.
Those are tough requirements to meet, I’m not sure there is a low power CPU that can do it all. You would likely need to cluster some devices but that means you need a separate NAS anyway and that kind of defeats the purpose for your case.
Yeah, I manage the infrastructure for almost 150 WordPress sites, and I moved them all to ARM servers a while ago, because they’re 10% or 20% cheaper on AWS.
Websites are rarely bottlenecked by the CPU, so that power efficiency is very significant.
I really think that most people who think that they want ARM machines are wrong, at least given the state of things in 2024. Like, maybe you use Linux…but do you want to run x86 Windows binary-only games? Even if you can get 'em running, you’ve lost the power efficiency. What’s hardware support like? Do you want to be able to buy other components? If you like stuff like that Framework laptop, which seems popular on here, an SoC is heading in the opposite direction of that – an all-in-one, non-expandable manufacturer-specified system.
But yours is a legit application. A non-CPU-constrained datacenter application running open-source software compiled against ARM, where someone else has validated that the hardware is all good for the OS.
I would not go ARM for a desktop or laptop as things stand, though.
If you didn’t want to game on your laptop, would an ARM device not be better for office work? Considering they’re quiet and their battery lasts forever.
ARM chips aren’t better at power efficiency compared to x84 above 10 or 15W or so. Apple is getting a lot out of them because TSMC 3nm; even the upcoming AMD 9000 series will only be on TSMC 4nm.
ARM is great for having more than one competent company in the market, though.
If you look at pfsense/OPNsense hardware recommendations, it’s almost all using chips like the Intel N5105 (10W TDP, though admittedly “TDP” is itself a messy term) or J4125 (also 10W TDP). Using ARM hardware is asked a lot in the community forums, and it’s one of those questions that will get you a flamed for not checking Google first. The power usage benefits for switching to ARM just aren’t there.
There is the Netgate 1100, which runs ARM on a proprietary build of pfsense. The community has largely ignored it in favor of Intel chips. There isn’t much of a price advantage, and the performance is lackluster.
That said, there’s lots that you can do with a sub-10W chip, and x86 has nothing modern there.
Personally, I cobbled together an OPNsense firewall out of some old desktop parts I had on hand. Power usage is a bit higher, but not so much that I care. I would like a more viable high-end ARM option, though, just because I don’t want x86 to be the only option.
Extrapolating the specific use case of pfsense routers to all other applications seems misleading, especially when arm laptops and servers exist that prove their utility and power savings for their use cases. It seems to be the case that there isn’t a particular arm device that is priced well and well suited for pfsense, which does have somewhat unusual requirements compared to other applications.
ARM looking pretty good too these days
arm is very primed to take a lot of market share of server market from intel. Amazon is already very committed on making their graviton arm cpu their main cpu, which they own a huge lion share of the server market on alone.
for consumers, arm adoption is fully reliant on the respective operating systems and compatibility to get ironed out.
Linux works great on ARM, I just want something similar to most mini-ITX boards (4x SATA, 2x mini-PCIe, and RAM slots), and I’ll convert my DIY NAS to ARM. But there just isn’t anything between RAM-limited SBCs and datacenter ARM boards.
Arm servers are slow, and arm laptops are not compatible with Linux.
Eh, it looks like ARM laptops are coming along. I give it a year or so for the process to be smooth.
For servers, AWS Graviton seems to be pretty solid. I honestly don’t need top performance and could probably get away with a Quartz64 SBC, I just don’t want to worry about RAM and would really like 16GB. I just need to server a dozen or so docker containers with really low load, and I want to do that with as little power as I can get away with for minimum noise. It doesn’t need to transcode or anything.
Man so many SBCs come so close to what you’re looking for but no one has that level of I/O. I was just looking at the ZimaBlade / ZimaBoard and they don’t quite get there either: 2 x SATA and a PCIe 2.0 x4. ZimaBlade has Thunderbolt 4, maybe you can squeeze a few more drives in there with a separate power supply? Seems mildly annoying but on the other hand, their SBCs only draw like 10 watts.
Not sure what your application is but if you’re open to clustering them that could be an option.
Here’s my actual requirements:
Services:
The ZimaBlade is probably good enough (would need to figure out SATA power), I’ll have to look at some performance numbers. I’m a little worried since it seems to be worse than my old Phenom II x4, which was the old CPU for this machine. I’m currently using my old Ryzen 1700, but I’d be fine downgrading a bit if it meant significantly lower power usage. I’d really like to put this under my bed, and it needs to be very quiet to do that.
Those are tough requirements to meet, I’m not sure there is a low power CPU that can do it all. You would likely need to cluster some devices but that means you need a separate NAS anyway and that kind of defeats the purpose for your case.
Yeah, I manage the infrastructure for almost 150 WordPress sites, and I moved them all to ARM servers a while ago, because they’re 10% or 20% cheaper on AWS.
Websites are rarely bottlenecked by the CPU, so that power efficiency is very significant.
I really think that most people who think that they want ARM machines are wrong, at least given the state of things in 2024. Like, maybe you use Linux…but do you want to run x86 Windows binary-only games? Even if you can get 'em running, you’ve lost the power efficiency. What’s hardware support like? Do you want to be able to buy other components? If you like stuff like that Framework laptop, which seems popular on here, an SoC is heading in the opposite direction of that – an all-in-one, non-expandable manufacturer-specified system.
But yours is a legit application. A non-CPU-constrained datacenter application running open-source software compiled against ARM, where someone else has validated that the hardware is all good for the OS.
I would not go ARM for a desktop or laptop as things stand, though.
If you didn’t want to game on your laptop, would an ARM device not be better for office work? Considering they’re quiet and their battery lasts forever.
ARM chips aren’t better at power efficiency compared to x84 above 10 or 15W or so. Apple is getting a lot out of them because TSMC 3nm; even the upcoming AMD 9000 series will only be on TSMC 4nm.
ARM is great for having more than one competent company in the market, though.
Do you have a source for that? It seems a bit hard to believe.
If you look at pfsense/OPNsense hardware recommendations, it’s almost all using chips like the Intel N5105 (10W TDP, though admittedly “TDP” is itself a messy term) or J4125 (also 10W TDP). Using ARM hardware is asked a lot in the community forums, and it’s one of those questions that will get you a flamed for not checking Google first. The power usage benefits for switching to ARM just aren’t there.
There is the Netgate 1100, which runs ARM on a proprietary build of pfsense. The community has largely ignored it in favor of Intel chips. There isn’t much of a price advantage, and the performance is lackluster.
That said, there’s lots that you can do with a sub-10W chip, and x86 has nothing modern there.
Personally, I cobbled together an OPNsense firewall out of some old desktop parts I had on hand. Power usage is a bit higher, but not so much that I care. I would like a more viable high-end ARM option, though, just because I don’t want x86 to be the only option.
Extrapolating the specific use case of pfsense routers to all other applications seems misleading, especially when arm laptops and servers exist that prove their utility and power savings for their use cases. It seems to be the case that there isn’t a particular arm device that is priced well and well suited for pfsense, which does have somewhat unusual requirements compared to other applications.