I guess most people use SSDs/NVMEs, but there are a lot of offers for servers with HDDs still today. Is anyone using those? How is performance with these disks these days?
I think It's not important to run apps on NVME or HDD after apps loaded on Memory. But if your apps do frequent I/O, it's important.
I don't care Disk type but network stability.
Nice, thanks all. I just bought a Hetzner server from their auction which has NVME storage, and I am gonna add more users to Nextcloud meaning that I will need more storage than I have on this server. I saw an offer on OVH for a dedicated server with a decent CPU, 32GB of RAM and 4 x 2TB HDDs for just 17 euros per month, so it's cheaper than adding the same amount of storage to the Hetzner server. 4 TB are more than enough for what I need, so I could configure the drives in RAID 10 and use that server purely for Nextcloud. @AlwaysSkint Most of my Nextcloud users, me included, just use the syncing functionality, not the web app, which we use rarely to collaborate with OnlyOffice. Do you ever see any particular slow down with these? Also what is the write/read speed of your disk(s)? Just to get an idea. Thanks!
@vitobotta said: Is anyone using those? How is performance with these disks these days?
It all depends what level of interaction is required. I have about 4 MinIO servers which store long-term archives using HDDs, mostly automated so don't care about latency, performance is fine for this use case. A SQL database used interactively would be a completely different story.
So for OS, website with high load, or any performance oriented use-case - SSD/NVMe is the only way to fly
Backups, movies, large files that do not need constant high IO - Spinning Rust, AKA HDD, and make sure it is at least a RAID6.
HDD actually outlive Flash in terms of life, but are slow due to the writing technique and mechanical part. The have the best $/MB ratio.
SSD/NVME - well they are fast, but consumer grade is a no-go, enterprise is extremely expensive at $/MB, and the life-span of flash, for now, is much less than a HDD.
This is why, some offers of VPS/DEDI include a Flash part for OS and running IO intensive APS and a HDD part for storing large files.
Just to have an idea, values can depend on brand/model but this is a general compassion:
A typical HDD will have sub 1MB/sec at 4K random write, and up to 180 MB/sec on sequential. IOPS is ~140 to 180.
A typical SSD will have ~15 to 35 MB/SEC at 4K random write, and up to 550 MB/sec on sequential. IOPS is ~35.000.
A typical NVME will have 135 and up MB/SEC at random write, and up to 5500 MB/sec on sequential. IOPS is above 70.000
Values vary much on flash ( mostly on NVME ), due to a ton of factors that include: cell type, nvme interface and controller, brand of flash chips, targeted consumer area. Here Enterprise will blow away consumer, specially on life-span.
Did this answer your question? partially at least?
All I do is use the web frontend to periodically clear out older backups (the file retention feature never worked/works properly). End users don't see the server at all, so no 'Apps' running.
I use davfs to upload approx. 8 VPS nightly backups to them (the Nextcloud instances). Additionally 2 mobile phones and 2 laptops get uploads sent to one.
Hard disc speed isn't really relevant to me but typically backups take around 10 minutes to upload - that is the important measure. Likewise, RAM and processing power doesn't really feature and I run one on a cheapo Scaleway box (used to be a Kimsufi ARM instance), one in a Proxmox VM on a cheapo WSI dedicated server and one on a basic Frantech block storage-added VPS.
Others prefer synchthing but I get on better with Nextcloud.
It wisnae me! A big boy done it and ran away.
NVMe2G for life! until death (the end is nigh)
@vitobotta said:
I guess most people use SSDs/NVMEs, but there are a lot of offers for servers with HDDs still today. Is anyone using those? How is performance with these disks these days?
Actually HDDs are still the best choice for backups or high data storage.
C1V hosting: Italy's Leading Data Center | Unbeatable VPS, Dedicated Servers, and Colocation | Cutting-Edge Facilities in Pomezia | Where Your Success Takes Center Stage.
🚀 VPN for €5/year 🚀 | Follow us on Telegram
Personally, I'd install debian, load Proxmox on top, then create a few VMs, one of which dedicated to Nextcloud. 4GB should be ample for Nextcloud - I run in 2GB and less.
It wisnae me! A big boy done it and ran away.
NVMe2G for life! until death (the end is nigh)
I am hosting a raspbian repo mirror from HDD. Was planning to extend it to include debian as well since newer raspberry pi runs on debians but the debian mirrors in my area are good enough. Other then that, I use HDDs for storing the server backups and proxmox backups. Rest of it runs off SSDs.
As mentioned above, most apps runs off RAM now a days so storage really doesn't matter much anymore.
Artificial intelligence is no match for our natural stupidity.
Time flies like an arrow; fruit flies like a banana.
I migrated Nextcloud and it's mostly fine. The only thing that is disappointing is the disk write speeds, not sure if it's because I configured the disks in RAID 10 (4 x 2TB drives). Is there any setting or something that could help improve disk performance with such configuration? Other than that it seems to work pretty well. Of course I can see some difference compared to a bigger server with NVME, but it's OK.
@host_c said:
Hw raid or software?, is software, what did you use, if hardware, did you wait for the raid to initialize?
It's the software raid configured by OVH when you install the OS. It's regular mdadm stuff. The server is all set up already and the RAID is perfectly functional, synced etc. It's just that write performance is not great
I personally stay clear of XFS due to the inability to shrink that filesystem. An edge case, I know, but I have felt/had the need a few times. Bear in mind that raw speed tests only go so far in real World use: buffering & caches make a fair bit of difference.
It wisnae me! A big boy done it and ran away.
NVMe2G for life! until death (the end is nigh)
Comments
I'm self hosting audiobookshelf on hosthatch storage and never faced any problems.
Is performance acceptable?
404 Error: Signature Not Found
I think It's not important to run apps on NVME or HDD after apps loaded on Memory. But if your apps do frequent I/O, it's important.
I don't care Disk type but network stability.
I run backups through Nextcloud quite happily and frugally, on HDD.
Hybrid HDD/SSD make this even better!
It wisnae me! A big boy done it and ran away.
NVMe2G for life! until death (the end is nigh)
Nice, thanks all. I just bought a Hetzner server from their auction which has NVME storage, and I am gonna add more users to Nextcloud meaning that I will need more storage than I have on this server. I saw an offer on OVH for a dedicated server with a decent CPU, 32GB of RAM and 4 x 2TB HDDs for just 17 euros per month, so it's cheaper than adding the same amount of storage to the Hetzner server. 4 TB are more than enough for what I need, so I could configure the drives in RAID 10 and use that server purely for Nextcloud. @AlwaysSkint Most of my Nextcloud users, me included, just use the syncing functionality, not the web app, which we use rarely to collaborate with OnlyOffice. Do you ever see any particular slow down with these? Also what is the write/read speed of your disk(s)? Just to get an idea. Thanks!
404 Error: Signature Not Found
It all depends what level of interaction is required. I have about 4 MinIO servers which store long-term archives using HDDs, mostly automated so don't care about latency, performance is fine for this use case. A SQL database used interactively would be a completely different story.
@vitobotta
it all depends on the IO performance you need.
So for OS, website with high load, or any performance oriented use-case - SSD/NVMe is the only way to fly
Backups, movies, large files that do not need constant high IO - Spinning Rust, AKA HDD, and make sure it is at least a RAID6.
HDD actually outlive Flash in terms of life, but are slow due to the writing technique and mechanical part. The have the best $/MB ratio.
SSD/NVME - well they are fast, but consumer grade is a no-go, enterprise is extremely expensive at $/MB, and the life-span of flash, for now, is much less than a HDD.
This is why, some offers of VPS/DEDI include a Flash part for OS and running IO intensive APS and a HDD part for storing large files.
Just to have an idea, values can depend on brand/model but this is a general compassion:
A typical HDD will have sub 1MB/sec at 4K random write, and up to 180 MB/sec on sequential. IOPS is ~140 to 180.
A typical SSD will have ~15 to 35 MB/SEC at 4K random write, and up to 550 MB/sec on sequential. IOPS is ~35.000.
A typical NVME will have 135 and up MB/SEC at random write, and up to 5500 MB/sec on sequential. IOPS is above 70.000
Values vary much on flash ( mostly on NVME ), due to a ton of factors that include: cell type, nvme interface and controller, brand of flash chips, targeted consumer area. Here Enterprise will blow away consumer, specially on life-span.
Did this answer your question? partially at least?
Host-C - VPS Services Provider - AS211462
"If there is no struggle there is no progress"
So for a Nextcloud install with around 10 users with moderate activity, shall I go for it or not? what do you think?
404 Error: Signature Not Found
I am on the clouds. No disks
Dentistry is my passion
HDD, you will be limited rather by bandwidth for upload/download then by HDD activity. The OS does caching also, so that will help.
Host-C - VPS Services Provider - AS211462
"If there is no struggle there is no progress"
OK, I think I'll give it a try. Thanks!
404 Error: Signature Not Found
Far from acceptable. It's pretty good and I play stuff almost every day.
When I read the first sentence I thought you meant horrible
404 Error: Signature Not Found
SSDs have become sufficiently cheap that HDDs no longer make sense to me outside of data centers and data hoarders.
The only HDD storage I still actively use is hetzner storageboxes. And I think maybe the oracle VMs that I'm not actively using are on hdd
All I do is use the web frontend to periodically clear out older backups (the file retention feature never worked/works properly). End users don't see the server at all, so no 'Apps' running.
I use davfs to upload approx. 8 VPS nightly backups to them (the Nextcloud instances). Additionally 2 mobile phones and 2 laptops get uploads sent to one.
Hard disc speed isn't really relevant to me but typically backups take around 10 minutes to upload - that is the important measure. Likewise, RAM and processing power doesn't really feature and I run one on a cheapo Scaleway box (used to be a Kimsufi ARM instance), one in a Proxmox VM on a cheapo WSI dedicated server and one on a basic Frantech block storage-added VPS.
Others prefer synchthing but I get on better with Nextcloud.
It wisnae me! A big boy done it and ran away.
NVMe2G for life! until death (the end is nigh)
Actually HDDs are still the best choice for backups or high data storage.
C1V hosting: Italy's Leading Data Center | Unbeatable VPS, Dedicated Servers, and Colocation | Cutting-Edge Facilities in Pomezia | Where Your Success Takes Center Stage.
🚀 VPN for €5/year 🚀 | Follow us on Telegram
I still chisel my ones and zeros onto cave walls.
URL Shortener | YetiNode | Come join us on the MetalVPS IRC channel!!! | Don't be a jerk, let YetiNode do the work.
I ordered that server from OVH and it's now installing the OS. I will then migrate Nextcloud. Thanks all!
404 Error: Signature Not Found
Personally, I'd install debian, load Proxmox on top, then create a few VMs, one of which dedicated to Nextcloud. 4GB should be ample for Nextcloud - I run in 2GB and less.
It wisnae me! A big boy done it and ran away.
NVMe2G for life! until death (the end is nigh)
I am hosting a raspbian repo mirror from HDD. Was planning to extend it to include debian as well since newer raspberry pi runs on debians but the debian mirrors in my area are good enough. Other then that, I use HDDs for storing the server backups and proxmox backups. Rest of it runs off SSDs.
As mentioned above, most apps runs off RAM now a days so storage really doesn't matter much anymore.
Artificial intelligence is no match for our natural stupidity.
Time flies like an arrow; fruit flies like a banana.
I migrated Nextcloud and it's mostly fine. The only thing that is disappointing is the disk write speeds, not sure if it's because I configured the disks in RAID 10 (4 x 2TB drives). Is there any setting or something that could help improve disk performance with such configuration? Other than that it seems to work pretty well. Of course I can see some difference compared to a bigger server with NVME, but it's OK.
404 Error: Signature Not Found
Hw raid or software?, is software, what did you use, if hardware, did you wait for the raid to initialize?
Host-C - VPS Services Provider - AS211462
"If there is no struggle there is no progress"
It's the software raid configured by OVH when you install the OS. It's regular mdadm stuff. The server is all set up already and the RAID is perfectly functional, synced etc. It's just that write performance is not great
404 Error: Signature Not Found
Mdadm is really bad at performance. Go with zfs instead
Host-C - VPS Services Provider - AS211462
"If there is no struggle there is no progress"
It was configured by OVH automatically when installing the OS, I only had to chose the RAID mode and choose 10.
404 Error: Signature Not Found
Please give me an idea on slow speed.
A yabs , disk test only
Host-C - VPS Services Provider - AS211462
"If there is no struggle there is no progress"
Someone on "the other forum" gave me a suggestion to disable bitmap and now it's a bit better:
```
Any other settings I could try?
404 Error: Signature Not Found
@vitobotta
I would help you out further, but my taxi just arrived, I have to go to "party" for 2024.
Have no clue on OVH drive policy, but if you do not have data on it, just do a ZFS and do not waste any more time.
Maybe someone can help you debug this, I personally, would go for ZFS on Software raid.
AA, just remembered, filesystem? try out XFS. It is much better than EXT4 at handling read and write ( https://en.wikipedia.org/wiki/XFS )
Host-C - VPS Services Provider - AS211462
"If there is no struggle there is no progress"
I personally stay clear of XFS due to the inability to shrink that filesystem. An edge case, I know, but I have felt/had the need a few times. Bear in mind that raw speed tests only go so far in real World use: buffering & caches make a fair bit of difference.
It wisnae me! A big boy done it and ran away.
NVMe2G for life! until death (the end is nigh)
@vitobotta
This is an excellent article for you, found it while searching for other stuff ( as usual )
https://www.arcserve.com/blog/understanding-raid-performance-various-levels
Host-C - VPS Services Provider - AS211462
"If there is no struggle there is no progress"