FreeBSDwiki - User contributions [en]

FreeBSD ISO layout

2007-07-23T06:24:27Z

MaxEnt: comparison to full FTP distribution

==Sample ISO layout of 6.2-RELEASE i386==

The directory <tt>ftp://ftp.freebsd.org/pub/FreeBSD/releases/i386/ISO-IMAGES/6.2</tt> lists the following contents:
<pre>
6.2-RELEASE-i386-bootonly.iso 24848 KB 01/12/2007 12:00:00 AM
6.2-RELEASE-i386-disc1.iso 587138 KB 01/12/2007 12:00:00 AM
6.2-RELEASE-i386-disc2.iso 654402 KB 01/12/2007 12:00:00 AM
6.2-RELEASE-i386-docs.iso 192414 KB 01/12/2007 12:00:00 AM
CHECKSUM.MD5 1 KB 01/12/2007 12:00:00 AM
CHECKSUM.SHA256 1 KB 01/12/2007 12:00:00 AM
</pre>

The file <tt>CHECKSUM.MD5</tt> contains the following text:
<pre>
MD5 (6.2-RELEASE-i386-bootonly.iso) = 4e8701ac951bc4537f8420fdac7efbb5
MD5 (6.2-RELEASE-i386-disc1.iso) = 3d27214700687c0b5390e8b6dd3706e3
MD5 (6.2-RELEASE-i386-disc2.iso) = fd30bfc65ef8adaa67aeffd07c72bf21
MD5 (6.2-RELEASE-i386-docs.iso) = e3512834982a9beebc3670499c7f3817
</pre>

The four ISO images were downloaded to an OpenBSD host (from various mirrors) and the signatures were verified using the OpenBSD <tt>md5</tt> command. For some other systems the command is <tt>md5sum</tt> instead.

The four ISO images were then loopback mounted using svnd devices as follows:
<pre>
mkdir boot disc1 disc2 docs

sudo vnconfig svnd0 6.2-RELEASE-i386-bootonly.iso
sudo mount -t cd9660 /dev/svnd0c boot

sudo vnconfig svnd1 6.2-RELEASE-i386-disc1.iso
sudo mount -t cd9660 /dev/svnd1c disc1

sudo vnconfig svnd2 6.2-RELEASE-i386-disc2.iso
sudo mount -t cd9660 /dev/svnd2c disc2

sudo vnconfig svnd3 6.2-RELEASE-i386-docs.iso
sudo mount -t cd9660 /dev/svnd3c docs
</pre>

After mounting the four images as above, the top-level structure of the ISO images was listed out with the command:
find . -maxdepth 4 -type d
which produces the following output:
<pre>
./boot
./boot/boot
./boot/boot/defaults
./boot/boot/kernel
./boot/boot/modules
./disc1
./disc1/6.2-RELEASE
./disc1/6.2-RELEASE/base
./disc1/6.2-RELEASE/catpages
./disc1/6.2-RELEASE/dict
./disc1/6.2-RELEASE/doc
./disc1/6.2-RELEASE/games
./disc1/6.2-RELEASE/info
./disc1/6.2-RELEASE/kernels
./disc1/6.2-RELEASE/manpages
./disc1/6.2-RELEASE/ports
./disc1/6.2-RELEASE/proflibs
./disc1/6.2-RELEASE/src
./disc1/bin
./disc1/boot
./disc1/boot/defaults
./disc1/boot/kernel
./disc1/boot/modules
./disc1/dev
./disc1/etc
./disc1/etc/bluetooth
./disc1/etc/defaults
./disc1/etc/gnats
./disc1/etc/isdn
./disc1/etc/mail
./disc1/etc/mtree
./disc1/etc/ntp
./disc1/etc/pam.d
./disc1/etc/periodic
./disc1/etc/periodic/daily
./disc1/etc/periodic/monthly
./disc1/etc/periodic/security
./disc1/etc/periodic/weekly
./disc1/etc/ppp
./disc1/etc/rc.d
./disc1/etc/security
./disc1/etc/skel
./disc1/etc/ssh
./disc1/etc/ssl
./disc1/etc/X11
./disc1/floppies
./disc1/lib
./disc1/lib/geom
./disc1/libexec
./disc1/media
./disc1/mnt
./disc1/packages
./disc1/packages/All
./disc1/packages/devel
./disc1/packages/emulators
./disc1/packages/graphics
./disc1/packages/lang
./disc1/packages/linux
./disc1/packages/perl5
./disc1/packages/print
./disc1/packages/textproc
./disc1/packages/x11
./disc1/packages/x11-fonts
./disc1/packages/x11-servers
./disc1/proc
./disc1/rescue
./disc1/root
./disc1/sbin
./disc1/tmp
./disc1/tools
./disc1/tools/bsdboot
./disc1/tools/dist
./disc1/tools/srcs
./disc1/tools/srcs/bteasy
./disc1/tools/srcs/EXTIPL
./disc1/tools/srcs/fips
./disc1/tools/srcs/ide_conf
./disc1/tools/srcs/pfdisk
./disc1/tools/srcs/rawrite
./disc1/usr
./disc1/usr/bin
./disc1/usr/games
./disc1/usr/include
./disc1/usr/include/altq
./disc1/usr/include/arpa
./disc1/usr/include/bsm
./disc1/usr/include/bsnmp
./disc1/usr/include/cam
./disc1/usr/include/crypto
./disc1/usr/include/c++
./disc1/usr/include/dev
./disc1/usr/include/fs
./disc1/usr/include/geom
./disc1/usr/include/gnu
./disc1/usr/include/gpib
./disc1/usr/include/isofs
./disc1/usr/include/kadm5
./disc1/usr/include/libmilter
./disc1/usr/include/lwres
./disc1/usr/include/machine
./disc1/usr/include/net
./disc1/usr/include/net80211
./disc1/usr/include/netatalk
./disc1/usr/include/netatm
./disc1/usr/include/netgraph
./disc1/usr/include/netinet
./disc1/usr/include/netinet6
./disc1/usr/include/netipsec
./disc1/usr/include/netipx
./disc1/usr/include/netkey
./disc1/usr/include/netnatm
./disc1/usr/include/netncp
./disc1/usr/include/netsmb
./disc1/usr/include/nfs
./disc1/usr/include/nfsclient
./disc1/usr/include/nfsserver
./disc1/usr/include/objc
./disc1/usr/include/openssl
./disc1/usr/include/pccard
./disc1/usr/include/posix4
./disc1/usr/include/protocols
./disc1/usr/include/readline
./disc1/usr/include/rpc
./disc1/usr/include/rpcsvc
./disc1/usr/include/security
./disc1/usr/include/sys
./disc1/usr/include/ufs
./disc1/usr/include/vm
./disc1/usr/lib
./disc1/usr/lib/aout
./disc1/usr/lib/compat
./disc1/usr/libdata
./disc1/usr/libdata/gcc
./disc1/usr/libdata/ldscripts
./disc1/usr/libdata/lint
./disc1/usr/libexec
./disc1/usr/libexec/lpr
./disc1/usr/libexec/sendmail
./disc1/usr/libexec/sm.bin
./disc1/usr/local
./disc1/usr/obj
./disc1/usr/sbin
./disc1/usr/share
./disc1/usr/share/calendar
./disc1/usr/share/dict
./disc1/usr/share/doc
./disc1/usr/share/examples
./disc1/usr/share/games
./disc1/usr/share/groff_font
./disc1/usr/share/info
./disc1/usr/share/isdn
./disc1/usr/share/locale
./disc1/usr/share/man
./disc1/usr/share/me
./disc1/usr/share/misc
./disc1/usr/share/mk
./disc1/usr/share/nls
./disc1/usr/share/openssl
./disc1/usr/share/pcvt
./disc1/usr/share/security
./disc1/usr/share/sendmail
./disc1/usr/share/skel
./disc1/usr/share/snmp
./disc1/usr/share/syscons
./disc1/usr/share/tabset
./disc1/usr/share/tmac
./disc1/usr/share/vi
./disc1/usr/share/zoneinfo
./disc1/usr/src
./disc1/var
./disc1/var/account
./disc1/var/at
./disc1/var/at/jobs
./disc1/var/at/spool
./disc1/var/audit
./disc1/var/backups
./disc1/var/crash
./disc1/var/cron
./disc1/var/cron/tabs
./disc1/var/db
./disc1/var/db/entropy
./disc1/var/db/freebsd-update
./disc1/var/db/ipf
./disc1/var/db/pkg
./disc1/var/db/ports
./disc1/var/db/portsnap
./disc1/var/empty
./disc1/var/heimdal
./disc1/var/log
./disc1/var/mail
./disc1/var/msgs
./disc1/var/named
./disc1/var/named/dev
./disc1/var/named/etc
./disc1/var/named/var
./disc1/var/preserve
./disc1/var/run
./disc1/var/run/named
./disc1/var/run/ppp
./disc1/var/rwho
./disc1/var/spool
./disc1/var/spool/clientmqueue
./disc1/var/spool/lock
./disc1/var/spool/lpd
./disc1/var/spool/mqueue
./disc1/var/spool/opielocks
./disc1/var/spool/output
./disc1/var/tmp
./disc1/var/tmp/vi.recover
./disc1/var/yp
./disc2
./disc2/packages
./disc2/packages/accessibility
./disc2/packages/afterstep
./disc2/packages/All
./disc2/packages/archivers
./disc2/packages/astro
./disc2/packages/audio
./disc2/packages/comms
./disc2/packages/converters
./disc2/packages/databases
./disc2/packages/deskutils
./disc2/packages/devel
./disc2/packages/dns
./disc2/packages/editors
./disc2/packages/emulators
./disc2/packages/ftp
./disc2/packages/games
./disc2/packages/gnome
./disc2/packages/graphics
./disc2/packages/ipv6
./disc2/packages/irc
./disc2/packages/kde
./disc2/packages/lang
./disc2/packages/mail
./disc2/packages/math
./disc2/packages/misc
./disc2/packages/multimedia
./disc2/packages/net
./disc2/packages/net-mgmt
./disc2/packages/news
./disc2/packages/palm
./disc2/packages/perl5
./disc2/packages/print
./disc2/packages/python
./disc2/packages/ruby
./disc2/packages/scheme
./disc2/packages/security
./disc2/packages/shells
./disc2/packages/sysutils
./disc2/packages/textproc
./disc2/packages/windowmaker
./disc2/packages/www
./disc2/packages/x11
./disc2/packages/x11-clocks
./disc2/packages/x11-fm
./disc2/packages/x11-fonts
./disc2/packages/x11-themes
./disc2/packages/x11-toolkits
./disc2/packages/x11-wm
./docs
./docs/rr_moved
./docs/usr
./docs/usr/share
./docs/usr/share/doc
</pre>

The mounted size, as reported by <tt>du -shPx</tt> differs from the ISO image size:
<pre>
23.3M boot
997M disc1
638M disc2
177M docs
</pre>

Whereas the ISO file sizes are:
<pre>
6.2-RELEASE-i386-bootonly.iso 24,848 KB
6.2-RELEASE-i386-disc1.iso 587,138 KB
6.2-RELEASE-i386-disc2.iso 654,402 KB
6.2-RELEASE-i386-docs.iso 192,414 KB
</pre>

For a mirror combining the contents of disc1 and disc2, about 1.6 GB of storage would be consumed.

==FreeBSD ftp mirror layout==

For comparison, the file ftp://ftp.freebsd.org/pub/FreeBSD/dir.sizes shows the layout of a typical FreeBSD mirror, presumably giving the file sizes in multiples of KiB. The total size of the mirror for all architectures appears to be 440GB. The FreeBSD mirror documentation at [http://www.freebsd.org/doc/en_US.ISO8859-1/articles/hubs/mirror-requirements.html Requirements for FreeBSD mirrors] states that a ''Full FTP Distribution'' occupies 412 GB. Mirroring the whole of the ftp distribution is not practical for a local mirror.

==See also==

* [http://www.freebsd.org/doc/en_US.ISO8859-1/articles/hubs/index.html Mirroring FreeBSD] -- from freebsd.org
* [http://www.freebsd.org/doc/en_US.ISO8859-1/articles/releng/article.html FreeBSD Release Engineering] -- also from freebsd.org

[[category:installation]]

FreeBSD ISO layout

2007-07-23T06:06:45Z

MaxEnt: initial version mostly consists of commands and screen captures

Installing FreeBSD from a Local FTP Site

2007-07-23T05:53:29Z

MaxEnt: link to more precise info about ISO layout

== Creating a Local FTP Site with a FreeBSD Disc ==

FreeBSD ISO images (discs) have a layout similar to the FTP site. This makes it very easy for you to create a local FTP site that can be used by other machines on your network when installing FreeBSD. See [[FreeBSD ISO layout]] for more details.

=== Mount a FreeBSD CDROM ===
==== FreeBSD ====
On the FreeBSD computer that will host the FTP site, ensure that the CDROM is in the drive, and mounted on /cdrom.

# mount /cdrom

This only mounts the first CD. To recreate the entire FTP site keep reading.

=== Mount a FreeBSD CDROM Image ===
==== FreeBSD ====

[[Mounting ISOs under FreeBSD 5.x]] (also applies to 6.x)

==== Windows ====
Obtain software that will mount an iso image.
* Daemon Tools 3.4.7 ("Free" for non-commercial use. Not Open Source. Proprietary License.)
** Note: More recent versions contain adware.
** Install the software and mount the iso.

== Copy All Files to a New Directory to Recreate the FTP Site ==
=== FreeBSD ===
# cp -Rp /cdrom /ftproot

== Create Anonymous FTP Account ==
Create an account for anonymous FTP in /etc/passwd. Do this by editing /etc/passwd using vipw(8) and adding this line:

ftp:*:99:99::0:0:FTP:/cdrom:/nonexistent

== Enable FTP Service ==
=== FreeBSD ===
Ensure that the FTP service is enabled in /etc/inetd.conf.

=== Windows ===
* Obtain FTP Server software.
** [http://filezilla.sourceforge.net/ Filezilla (server) ]
** [http://support.jgaa.com/index.php?MenuPage=download WarFTPD ("Free" Proprietary License)]
Anyone with network connectivity to your machine can now chose a media type of FTP and type in <nowiki>ftp://your machine</nowiki> after picking “Other” in the FTP sites menu during the install.

Note: If the boot media (floppy disks, usually) for your FTP clients is not precisely the same version as that provided by the local FTP site, then sysinstall will not let you complete the installation. If the versions are not similar and you want to override this, you must go into the Options menu and change distribution name to any.

Warning: This approach is OK for a machine that is on your local network, and that is protected by your firewall. Offering up FTP services to other machines over the Internet (and not your local network) exposes your computer to the attention of crackers and other undesirables. We strongly recommend that you follow good security practices (ie, use [[sftp]] instead of straight-up [[ftp]]) if you do this. If you are determined to open a bare ftp server to the internet, a chroot ftp configuration offers a reasonable security compromise if your OS provides this. It won't protect you from abuse of your bandwidth by the gratification-deprived, and you will have to plan your storage allocation more carefully, as chroot environments will refuse to follow symlinks to other file systems on your ftp host.

[[Category:Installation]]

Talk:Installing FreeBSD from a Local FTP Site

2007-07-23T01:34:11Z

MaxEnt: /* http proxy */

Wikis are great and this one has a lot of potential. I'd like to see all of the pages of the FreeBSD Handbook in here in an editable format. I started with this page because I need to install 10 FreeBSD servers and I don't want to burn 20 CDs to do it. I looked at the handbook, but it is light on details. I'll add them as I discover them.

== Proprietary ISO Mounting Software ==

Sorry I had to plug proprietary software here, but I don't know of anything else for this job. If anyone knows about some better software that runs on windows, please plug it instead. I have no problem with removing the plug to Daemon Tools if someone posts something FREE.

== FileZilla - Problems Running Anonymous ==

I usually use FileZilla server (GPL) when I need a Windows FTP server, but I never needed an anonymous server before. I was not able to log on anonymously to FileZilla server. I created a user anonymous and unchecked the password box, but to no avail. If there is another trick to this and anyone knows it, post it and I will put in a link to FileZilla. I just didn't want to put a link to software that was going to end up frustrating people. Also, if someone does know of an Open Source Windows FTP server that works with anonymous login, please let me know what that is.

== Instructions to Help People in Windows ==

I know some people will object to helping people in Windows. Even if it is to help them install FreeBSD. I just have to respectfully disagree and ask that you leave my instructions for those people up on the wiki. I also strongly dislike plugging proprietary software, and I would be happy to find anything to replace it.

: The sentiment toward virtuous monoculture is expressed at disproportionate volume to its practioner base. It's a false view of human psychology: people are more willing to branch into the unknown beginning from a secure base, and they should be given every opportunity to do so. Later on, the new can replace the old. Off topic, extra credit: Will Africa develop more quickly building on the best of what Africa already has, or the worst of what the developed world is willing to spare?

== http proxy ==

Already I'm confused by the FreeBSD Handbook. It mentions that install sets can come from FTP, passive FTP, or proxy FTP. But I don't understand the difference between FTP via http proxy vs plain old http byte serving, and if they are different, why the installer would fall short of using http directly.

http://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/install-media.html

[[User:MaxEnt|MaxEnt]] 21:25, 22 July 2007 (EDT)

Talk:Installing FreeBSD from a Local FTP Site

2007-07-23T01:25:25Z

MaxEnt:

Wikis are great and this one has a lot of potential. I'd like to see all of the pages of the FreeBSD Handbook in here in an editable format. I started with this page because I need to install 10 FreeBSD servers and I don't want to burn 20 CDs to do it. I looked at the handbook, but it is light on details. I'll add them as I discover them.

== Proprietary ISO Mounting Software ==

Sorry I had to plug proprietary software here, but I don't know of anything else for this job. If anyone knows about some better software that runs on windows, please plug it instead. I have no problem with removing the plug to Daemon Tools if someone posts something FREE.

== FileZilla - Problems Running Anonymous ==

I usually use FileZilla server (GPL) when I need a Windows FTP server, but I never needed an anonymous server before. I was not able to log on anonymously to FileZilla server. I created a user anonymous and unchecked the password box, but to no avail. If there is another trick to this and anyone knows it, post it and I will put in a link to FileZilla. I just didn't want to put a link to software that was going to end up frustrating people. Also, if someone does know of an Open Source Windows FTP server that works with anonymous login, please let me know what that is.

== Instructions to Help People in Windows ==

I know some people will object to helping people in Windows. Even if it is to help them install FreeBSD. I just have to respectfully disagree and ask that you leave my instructions for those people up on the wiki. I also strongly dislike plugging proprietary software, and I would be happy to find anything to replace it.

: The sentiment toward virtuous monoculture is expressed at disproportionate volume to its practioner base. It's a false view of human psychology: people are more willing to branch into the unknown beginning from a secure base, and they should be given every opportunity to do so. Later on, the new can replace the old. Off topic, extra credit: Will Africa develop more quickly building on the best of what Africa already has, or the worst of what the developed world is willing to spare?

== http proxy ==

Already I'm confused by the FreeBSD Handbook. It mentions that install sets can come from FTP, passive FTP, or proxy FTP. But I don't understand the difference between FTP via http proxy vs plain old http byte serving.

http://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/install-media.html

[[User:MaxEnt|MaxEnt]] 21:25, 22 July 2007 (EDT)

Installing FreeBSD from a Local FTP Site

2007-07-23T00:54:22Z

MaxEnt: /* Windows */

== Creating a Local FTP Site with a FreeBSD Disc ==

FreeBSD discs are laid out in the same way as the FTP site. This makes it very easy for you to create a local FTP site that can be used by other machines on your network when installing FreeBSD.

=== Mount a FreeBSD CDROM ===
==== FreeBSD ====
On the FreeBSD computer that will host the FTP site, ensure that the CDROM is in the drive, and mounted on /cdrom.

# mount /cdrom

This only mounts the first CD. To recreate the entire FTP site keep reading.

=== Mount a FreeBSD CDROM Image ===
==== FreeBSD ====

[[Mounting ISOs under FreeBSD 5.x]] (also applies to 6.x)

==== Windows ====
Obtain software that will mount an iso image.
* Daemon Tools 3.4.7 ("Free" for non-commercial use. Not Open Source. Proprietary License.)
** Note: More recent versions contain adware.
** Install the software and mount the iso.

== Copy All Files to a New Directory to Recreate the FTP Site ==
=== FreeBSD ===
# cp -Rp /cdrom /ftproot

== Create Anonymous FTP Account ==
Create an account for anonymous FTP in /etc/passwd. Do this by editing /etc/passwd using vipw(8) and adding this line:

ftp:*:99:99::0:0:FTP:/cdrom:/nonexistent

== Enable FTP Service ==
=== FreeBSD ===
Ensure that the FTP service is enabled in /etc/inetd.conf.

=== Windows ===
* Obtain FTP Server software.
** [http://filezilla.sourceforge.net/ Filezilla (server) ]
** [http://support.jgaa.com/index.php?MenuPage=download WarFTPD ("Free" Proprietary License)]
Anyone with network connectivity to your machine can now chose a media type of FTP and type in <nowiki>ftp://your machine</nowiki> after picking “Other” in the FTP sites menu during the install.

Note: If the boot media (floppy disks, usually) for your FTP clients is not precisely the same version as that provided by the local FTP site, then sysinstall will not let you complete the installation. If the versions are not similar and you want to override this, you must go into the Options menu and change distribution name to any.

Warning: This approach is OK for a machine that is on your local network, and that is protected by your firewall. Offering up FTP services to other machines over the Internet (and not your local network) exposes your computer to the attention of crackers and other undesirables. We strongly recommend that you follow good security practices (ie, use [[sftp]] instead of straight-up [[ftp]]) if you do this. If you are determined to open a bare ftp server to the internet, a chroot ftp configuration offers a reasonable security compromise if your OS provides this. It won't protect you from abuse of your bandwidth by the gratification-deprived, and you will have to plan your storage allocation more carefully, as chroot environments will refuse to follow symlinks to other file systems on your ftp host.

[[Category:Installation]]

User:MaxEnt

2007-07-23T00:41:02Z

MaxEnt:

I'm also active as MaxEnt on various MediaWiki Foundation projects. In my own network I run a mixture of OpenBSD, FreeBSD, Fedora Core, and Ubuntu.

On the BSD side, I'm presently running a FreeBSD backup server, I host various web sites (including a handful of MediaWiki sites) on a FreeBSD hosting service that recently upgraded to 6.2, and I'm in the process of adding to my test network a pfSense firewall and a Varnish http accelerator, also on the FreeBSD 6.2 platform.

On the Linux side, I'm in the process of switching over the remaining Fedora boxes to Ubuntu. I just completed my first successful netboot / local mirror installation of Feisty Fawn using apt-mirror on an OpenBSD host (mirror is set up for i386 and AMD64). The stupid thing chewed up more disk space than I anticipated, but in the end it worked well.

I PXE-booted my FreeBSD backup server quite a while back, but I didn't set up a local installation mirror at the time. I stumbled upon this wiki looking for the best method to manage a local FreeBSD install mirror. Hopefully this site will get me started and I can contribute back a few refinements along the trail.

I'll say one thing about installation mirrors: many of the tutorials out there describe self-hosted mirrors (e.g. Ubuntu mirror hosted on Ubuntu). This might make sense in larger sites, but in the case of my test network, the worst place to host the mirror is on the machine I'm in the process of tearing apart. I could host my FreeBSD mirror on my FreeBSD backup machine, but then how would I would do a netboot reinstallation of the backup host itself, should that come to pass? There is no guarantee one of my other FreeBSD project machines will around at the time to host the mirror natively. For this reason, I lean toward mirrors that are platform agnostic as much as possible.

User:MaxEnt

2007-07-23T00:28:57Z

MaxEnt:

User:MaxEnt

2007-07-23T00:27:30Z

MaxEnt: