I have many hard drives circulating among my servers for testing purpose. For example, I took a hard drive from one server and put it on a different server. After doing this for many times, I’ve noticed that the ZFS has put many header information \/ meta data left on my hard drive. While it does not do anything harmful to the normal ZFS operation, I think it is not a good idea to have some outdated information living on my hard drive.\n<\/p>\n
Here is an example:<\/p>\n
\r\n#sudo zpool import\r\n\r\n pool: storage\r\n id: 4394681882400895515\r\n state: UNAVAIL\r\nstatus: The pool was last accessed by another system.\r\naction: The pool cannot be imported due to damaged devices or data.\r\n see: http:\/\/www.sun.com\/msg\/ZFS-8000-EY\r\nconfig:\r\n\r\n storage UNAVAIL insufficient replicas\r\n raidz1-0 UNAVAIL insufficient replicas\r\n 12688516256739208392 UNAVAIL cannot open\r\n ada3 ONLINE\r\n 4218969245912188584 UNAVAIL cannot open\r\n 1537006695366032450 UNAVAIL cannot open\r\n 8194123525800888894 UNAVAIL cannot open\r\n 13778624724471040977 UNAVAIL cannot open\r\n\r\n pool: storage\r\n id: 12159013771499288095\r\n state: FAULTED\r\nstatus: One or more devices contains corrupted data.\r\naction: The pool cannot be imported due to damaged devices or data.\r\n The pool may be active on another system, but can be imported using\r\n the '-f' flag.\r\n see: http:\/\/www.sun.com\/msg\/ZFS-8000-5E\r\nconfig:\r\n\r\n storage FAULTED corrupted data\r\n 6113585248511400089 UNAVAIL corrupted data\r\n\r\n<\/pre>\nAlthough ZFS provides a way (zpool labelclear) to remove this information, it only works if the hard drive is still attached to the server. If the hard drive is missing, there is nothing you can do. For example, the following command will be failed:<\/p>\n
\r\n#sudo zpool labelclear -f ada3\r\n<\/pre>\nI googled for solutions and I found many idea. Unfortunately, none of them works. <\/p>\n
Anyway, I came up a solution that is quick, easy and simple. Since ZFS stores the header information in the first and last sector of the hard drive, all I need to do is to wipe out the first and the last sector. That’s it.<\/p>\n
How To Remove ZFS Meta Data – Linux<\/h3>\n
\r\n#replace \/dev\/sdXX with that actual ID of your hard drive\r\ndd if=\/dev\/zero of=\/dev\/sdXX bs=512 count=10\r\ndd if=\/dev\/zero of=\/dev\/sdXX bs=512 seek=$(( $(blockdev --getsz \/dev\/sdXX) - 4096 )) count=1M\r\n<\/pre>\nThat’s it for Linux. Below is the FreeBSD version.<\/p>\n
How To Remove ZFS Meta Data – FreeBSD<\/h3>\n
First, you will need to identify which hard drive you want to clean up. The easiest way is to use dmesg<\/p>\n
\r\n#dmesg\r\n\r\n\r\nor \r\n\r\n#dmesg | grep ada | grep MB | grep -v 'MB\/s'\r\n\r\n\r\nwhich will return something like this:\r\n\r\n\r\nada0: 381554MB (781422768 512 byte sectors: 16H 63S\/T 16383C)\r\nada1: 1430799MB (2930277168 512 byte sectors: 16H 63S\/T 16383C)\r\nada2: 953869MB (1953525168 512 byte sectors: 16H 63S\/T 16383C)\r\nada3: 953869MB (1953525168 512 byte sectors: 16H 63S\/T 16383C)\r\nada4: 1430799MB (2930277168 512 byte sectors: 16H 63S\/T 16383C)\r\n<\/pre>\nNext, I need to know which one is the system hard drive, something I don’t want to touch.<\/p>\n
\r\n#df\r\n\r\n\/dev\/ada0p2 362G 3.6G 329G 1% \/\r\ndevfs 1.0k 1.0k 0B 100% \/dev\r\n<\/pre>\nIn this example, my goal is very clear. I need to wipe clear ada1, ada2, ada3 and ada4, and leave ada0 untouched.<\/p>\n
Next, I need to clear the first sector:<\/p>\n
\r\n#sudo dd if=\/dev\/zero of=\/dev\/ada1 count=1 bs=512k\r\n\r\nrepeat this for the other hard drives\r\n<\/pre>\nNext, I need to clear the last sector. You can use the sector information from dmesg (if available), or you can use the following command to find the location of the last sector:<\/p>\n
\r\n#sudo diskinfo -c \/dev\/ada1\r\n\r\nwhich will return something like the following:\r\n\r\n\/dev\/ada1\r\n 512 # sectorsize\r\n 1500301910016 # mediasize in bytes (1.4T)\r\n 2930277168 # mediasize in sectors\r\n 0 # stripesize\r\n 0 # stripeoffset\r\n 2907021 # Cylinders according to firmware.\r\n 16 # Heads according to firmware.\r\n 63 # Sectors according to firmware.\r\n S1Y6J1KS710613 # Disk ident.\r\n\r\nI\/O command overhead:\r\n time to read 10MB block 0.091942 sec = 0.004 msec\/sector\r\n time to read 20480 sectors 1.945038 sec = 0.095 msec\/sector\r\n calculated command overhead = 0.090 msec\/sector\r\n\r\n<\/pre>\nIn this example, the total number of sector is 2930277168 (mediasize in sectors).<\/p>\n
To keep things simple, I am going to wipe out the hard drive from 2930270000 to the end (Replace the last four digits of the sector size to zero).<\/p>\n
\r\n#sudo dd if=\/dev\/zero of=\/dev\/ada1 oseek=293027000\r\n<\/pre>\nNow, repeat the same thing for each hard drive. Keep in mind that the sector size of each hard drive may not be the same. So it is better to run the command and get the sector information first.<\/p>\n
After running these commands, the ZFS meta information should be removed. You can verify your work by doing this:<\/p>\n
\r\n#sudo zfs import\r\n\r\n\r\nwhich should output nothing.\r\n<\/pre>\nThat’s it. Enjoy building a new ZFS!<\/p>\n
–Derrick<\/p>\n
<\/p>\n","protected":false},"excerpt":{"rendered":"