Thursday, March 30, 2017

1 SSD + 1 HDD - how should I design my ZFS storage?

I have a PC with a 256 GB M.2 SSD drive used for Linux Mint root, swap and home partitions right now.
I have a 2TB HDD for all my data (I keep that separate from home dir actually, because users' home folder has user configuration).



I would like to migrate that system to ZFS to take advantage of checksums, snapshots, transparent compression and the power-loss robustness.



Since I didn't build the hardware with ZFS in mind I wonder now what would be the best way to utilize this setup.




I am doing lots of video production among other things, so I have big files (10GB) being thrown around a lot. I thought about using SSD as an SLOG, but wouldn't that unnecessarily wear the SSD off, when I'm capturing and rendering video files - HDD speed in not a bottleneck for me in this regard anyway.



Should I create separate pools for SSD and HDD?
Can I easily move datasets between the pools with send/receive commands?



Could I partition the SSD to use it both for root partition and SLOG for HDD? Wouldn't that defeat wear leveling and kill my SSD faster?
Wouldn't that kill SSDs performance benefits?



As a side-note:




I might add a second 2 TB HDD later as a mirror to gain redundancy. I also have 2 1TB USB 3.0 drives that I used with ZFS in Raid-0 for a while. They seem to work pretty well, and can handle ~130 MB/s write speed. I wonder if using that as a mirror vdev for my main HDD would be a good idea. They have proven to be stable for a few months (I know USB can be problematic with ZFS - I played with that a quite lot too).



I currently do rdiff-backup to an external 3TB USB 3.0 drive.



I have deployed ZFS a few times so far, once in a production environment for system root, and data storage in 2-disk mirror. I never used SSDs with it though.



What would you advise me to do?

No comments:

Post a Comment

linux - How to SSH to ec2 instance in VPC private subnet via NAT server

I have created a VPC in aws with a public subnet and a private subnet. The private subnet does not have direct access to external network. S...