ZFS, booting from (pre 9.0-RELEASE)
Line 180: | Line 180: | ||
Exit Fixit mode and sysinstall. Remove the FreeBSD install DVD/Memstick and the system will boot using the ZFS root. | Exit Fixit mode and sysinstall. Remove the FreeBSD install DVD/Memstick and the system will boot using the ZFS root. | ||
− | [[Category : | + | [[Category:ZFS]] [[Category:FreeBSD for Servers]] [[Category:RAID]] |
Latest revision as of 17:59, 25 August 2012
Note: this article was taken very nearly verbatim from Scott Hetzel's excellent guide at http://wiki.freebsd.org/RootOnZFS/GPTZFSBoot/Mirror.
[edit] Installing FreeBSD Root on ZFS (Mirror) using GPT
[edit] Creating a bootable ZFS Filesystem
Boot FreeBSD install DVD or USB Memstick, and choose the Fixit option in sysinstall.
[edit] Create GPT Disks
Fixit# gpart create -s gpt ad0 Fixit# gpart create -s gpt ad1
[edit] Create the boot, swap and zfs partitions
Create 3 partitions on both drives ad0 and ad1. The first partition contains the gptzfsboot loader which is able to recognize and load the loader from a ZFS partition. The second partition is a 4 GB swap partition. The third partition is the partition containing the zpool (20GB).
Fixit# gpart add -b 34 -s 128 -t freebsd-boot -l boot0 ad0 Fixit# gpart add -b 162 -s 8388608 -t freebsd-swap -l swap0 ad0 Fixit# gpart add -b 8388770 -s 41943040 -t freebsd-zfs -l root0 ad0 Fixit# gpart add -b 34 -s 128 -t freebsd-boot -l boot1 ad1 Fixit# gpart add -b 162 -s 8388608 -t freebsd-swap -l swap1 ad1 Fixit# gpart add -b 8388770 -s 41943040 -t freebsd-zfs -l root1 ad1
Notes: 1. While a ZFS Swap Volume can be used instead of the freebsd-swap partition, crash dumps can't be created on the ZFS Swap Volume. 2. Sizes and offsets are specified in sectors (1 sector is typically 512 bytes). 3. You may issue a gpart show command to see the correct location and size for further partitions you might need.
[edit] Install the Protected MBR (pmbr) and gptzfsboot loader to both drives
Fixit# gpart bootcode -b /mnt2/boot/pmbr -p /mnt2/boot/gptzfsboot -i 1 ad0 Fixit# gpart bootcode -b /mnt2/boot/pmbr -p /mnt2/boot/gptzfsboot -i 1 ad1
This may fail with an "operation not permitted" error message, since the kernel likes to protect critical parts of the disk. If this happens for you, run:
Fixit# sysctl kern.geom.debugflags=0x10
[edit] Create the root ZFS Pool
Fixit# kldload /mnt2/boot/kernel/opensolaris.ko Fixit# kldload /mnt2/boot/kernel/zfs.ko Fixit# mkdir /boot/zfs Fixit# zpool create zroot mirror /dev/gpt/root0 /dev/gpt/root1 Fixit# zpool set bootfs=zroot zroot
[edit] Install FreeBSD to zroot
[edit] Optional: Create ZFS datasets specifically for a FreeBSD system
If you wish, you may set up ZFS datasets within the zroot pool specifically optimized for the FreeBSD system.
I wish to stress that this is optional, and many admins may prefer to simply install to the single 20GB zroot pool already set up - among other things, following the guide linked to will cause sixteen new filesystems to show up in the output of df!
If this sounds like more trouble than it's worth, skip this step completely and move on.
[edit] Optional: Change the checksum algorithm
The fletcher4 algorithm should be more robust than the fletcher2 algorithm.
Fixit# zfs set checksum=fletcher4 zroot
[edit] Installing the system
Fixit# cd /zroot Fixit# cd /dist/8.0-* Fixit# export DESTDIR=/zroot Fixit# for dir in base catpages dict doc games info lib32 manpages ports; \ do (cd $dir ; ./install.sh) ; done Fixit# cd src ; ./install.sh all Fixit# cd ../kernels ; ./install.sh generic Fixit# cd /zroot/boot ; cp -Rlp GENERIC/* /zroot/boot/kernel/
[edit] Initial configuration of the new system
[edit] chroot into the new system
Fixit# chroot /zroot
[edit] create a /home directory
If you didn't create a dataset for home in the optional steps above, you'll need to create a directory for it now.
Fixit# mkdir /usr/home Fixit# ln -s /usr/home home
[edit] configure /etc/rc.conf
Fixit# echo 'zfs_enable="YES"' > /etc/rc.conf Fixit# echo 'hostname="beastie.mydomain.local"' >> /etc/rc.conf Fixit# echo 'ifconfig_re0="DHCP"' >> /etc/rc.conf
Note: Replace re0 with the name of the Network interface for the new system
[edit] configure /boot/loader.conf
Fixit# echo 'zfs_load="YES"' > /boot/loader.conf Fixit# echo 'vfs.root.mountfrom="zfs:zroot"' >> /boot/loader.conf
Check your loader.conf, and make CERTAIN you the quotes in "zfs:zroot" showed up - your system will not boot if they're not there!
[edit] Change root's password
Fixit# passwd
[edit] Set the local time zone
Fixit# tzsetup
[edit] Create /etc/mail/aliases.db
Fixit# cd /etc/mail Fixit# make aliases
[edit] Installing ZFS aware /boot/loader (Required for 8.0-RELEASE and 7.{0-2}-RELEASE)
Note: This step is obsoleted in FreeBSD 8.0-STABLE, FreeBSD 9.0-CURRENT, FreeBSD 7.2-STABLE, and newer.
Fixit# echo 'LOADER_ZFS_SUPPORT=YES' > /etc/src.conf Fixit# mount -t devfs devfs /dev Fixit# export DESTDIR="" Fixit# cd /usr/src/sys/boot/ Fixit# make obj Fixit# make depend Fixit# make Fixit# cd i386/loader Fixit# make install Fixit# umount /dev
[edit] Exit from the /zroot
Fixit# exit
[edit] Install zpool.cache to the ZFS filesystem
Fixit# cp /boot/zfs/zpool.cache /zroot/boot/zfs/zpool.cache
[edit] Finishing the installation
[edit] Using swap
There are 2 ways to use the gpt/swap0 and gpt/swap1 partitions. Only choose one!
[edit] Create /etc/fstab to use both swap partitions
Fixit# cat << EOF > /zroot/etc/fstab # Device Mountpoint FStype Options Dump Pass# /dev/gpt/swap0 none swap sw 0 0 /dev/gpt/swap1 none swap sw 0 0 EOF
[edit] Use gmirror to mirror the swap partitions
Fixit# kldload /mnt2/boot/kernel/geom_mirror.ko Fixit# gmirror label -b prefer swap gpt/swap0 gpt/swap1
Note: The 'prefer' balance algorithm can be replaced by 'round-robin'. See the gmirror(8) man page about problem using the 'round-robin' balance algorithm and kernel dumps
Fixit# cat << EOF > /zroot/etc/fstab # Device Mountpoint FStype Options Dump Pass# /dev/mirror/swap none swap sw 0 0 EOF
Fixit# echo 'geom_mirror_load="YES"' >> /zroot/boot/loader.conf
[edit] Setting mountpoints before first boot
Fixit# export LD_LIBRARY_PATH=/mnt2/lib Fixit# cd / Fixit# zfs unmount -a Fixit# zfs set mountpoint=legacy zroot
If you set up the full hierarchy of ZFS datasets for the system in the optional steps above, you need to set their mountpoints as well:
Fixit# zfs set mountpoint=/tmp zroot/tmp Fixit# zfs set mountpoint=/usr zroot/usr Fixit# zfs set mountpoint=/var zroot/var
Exit Fixit mode and sysinstall. Remove the FreeBSD install DVD/Memstick and the system will boot using the ZFS root.