From owner-freebsd-questions@freebsd.org Thu Apr 23 20:25:22 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 25B962C2687 for ; Thu, 23 Apr 2020 20:25:22 +0000 (UTC) (envelope-from dpchrist@holgerdanske.com) Received: from holgerdanske.com (holgerdanske.com [184.105.128.27]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "holgerdanske.com", Issuer "holgerdanske.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 497TM44vBfz4J1G for ; Thu, 23 Apr 2020 20:25:20 +0000 (UTC) (envelope-from dpchrist@holgerdanske.com) Received: from 99.100.19.101 ([99.100.19.101]) by holgerdanske.com with ESMTPSA (ECDHE-RSA-AES128-GCM-SHA256:TLSv1.2:Kx=ECDH:Au=RSA:Enc=AESGCM(128):Mac=AEAD) (SMTP-AUTH username dpchrist@holgerdanske.com, mechanism PLAIN) for ; Thu, 23 Apr 2020 13:25:18 -0700 Subject: Re: best upgrade process for server To: freebsd-questions@freebsd.org References: <1810714722.149383351.1587616694832.JavaMail.zimbra@shaw.ca> From: David Christensen Message-ID: <618aed37-a64b-9471-4353-366460d057d7@holgerdanske.com> Date: Thu, 23 Apr 2020 13:25:17 -0700 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.6.0 MIME-Version: 1.0 In-Reply-To: <1810714722.149383351.1587616694832.JavaMail.zimbra@shaw.ca> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 497TM44vBfz4J1G X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of dpchrist@holgerdanske.com has no SPF policy when checking 184.105.128.27) smtp.mailfrom=dpchrist@holgerdanske.com X-Spamd-Result: default: False [-1.70 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; NEURAL_HAM_MEDIUM(-0.97)[-0.975,0]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; IP_SCORE(-0.64)[ipnet: 184.104.0.0/15(0.43), asn: 6939(-3.60), country: US(-0.05)]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; TO_DN_NONE(0.00)[]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.99)[-0.987,0]; DMARC_NA(0.00)[holgerdanske.com]; URIBL_PBL(0.01)[dalescott.net]; RCVD_IN_DNSWL_NONE(0.00)[27.128.105.184.list.dnswl.org : 127.0.10.0]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:6939, ipnet:184.104.0.0/15, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Apr 2020 20:25:22 -0000 On 2020-04-22 21:38, Dale Scott wrote: > Hi all, > > I'd like suggestions for a new basic server. I'm currently running my website and a number of web apps I use to demo enterprise work processes on a single-disk 11.3 server with a 2nd disk for periodic backups of the web apps and the occasional file system dump. I'm concerned about backups and recovery, and would like replace the server with a new ZFS-based system and a pool of three or four 1T SSDs. I'm not interested in laboring over spec's and tweaking the system out and I'm not storing the world's movie collection. I favor basic, mature parts and minimum time spent making decisions. > > Is the following migration strategy reasonable? Can I restore a dump from my single-disk system to a new bhyve/ZFS system? Can I copy the virtualbox-ose virtual disk file to the new system and bhyve will know what to do? I'm using the virtualbox-ose NAT to remap the vm IP address and port, will bhyve be able to do this? > > Thanks for your recommendations. > > ## CURRENT SERVER > > wwww.dalescott.net:8080 <------------------------------------+ > | > | > www.dalescott.net <--\ +--------+-------+ > mantisbt.dalescott.net <--+ | ERPNext/Linux | > proqjector.dalescott.net <--+ +-----------------------------------+ > nextcloud.dalescott.net <--+-----+ Apache/MySQL/PHP | virtualbox|ose | > +------------------+----------------+ > | FreeBSD 11.3 | > +-----------------------------------+ > emo (DHCP ISP) | Core2 66000 | > <-----------------------------------+ 6GB RAM | > +------+----------------------------+ > | > +----+ 200G HD - ada0s1a on / > +----+ 200G HD - ada1p1 on /backup > > ## PROPOSED SERVER > > wwww.dalescott.net:8080 <------------------------------------+ > | > | > www.dalescott.net <--\ | > mantisbt.dalescott.net <--+ | > proqjector.dalescott.net <--+ +------------------+ | > nextcloud.dalescott.net <--+-----+ Apache/MySQL/PHP | | > +------------------+----------------+ > | FreeBSD 11.3 | ERPNext/Linux | > +------------------+----------------+ > | bhyve | > +-----------------------------------+ > emo (DHCP ISP) | ?? CPU | > <-----------------------------------+ ?? RAM | > +------+----------------------------+ > | > \----+ 4x 1T SSD I have a SOHO LAN with one server for Samba and CVS. I do not host any public services, so as not to saturate my residential WAN connection. I use VPS's for public services. When it was time to retire my previous desktop/ Linux SOHO server with an up-to-date FreeBSD server, I bought a lightly used Dell PowerEdge T30 with one Xeon E3-1225 v5 processor, one 8 GB ECC memory module, one 1 TB SATA HDD, and one DVD+/-RW drive. (It is important that computers running ZFS have ECC memory.) I removed the 1 TB HDD, added one 8 GB ECC memory module, added one 2.5" SSD for the system drive and data cache, and added two 3 TB SATA HDD's for data (3 TB mirror). I find it is easier to put the jails on the system drive than to put them into the data pool (ZFS property dedup=verify). Total price was around US$ 700. The platform is more than adequate for my needs. Switching to FreeBSD and ZFS has required a lot of learning and doing. The Lucas books were invaluable. Backups, archives, images, etc., required new thinking and new infrastructure (hardware, software, and scripts). I ended up building another server with another 3 TB mirror to receive replication streams (US$ 250 and existing parts). My advice would be to keep your existing server and disaster preparedness infrastructure fully functional while you build an end-to-end replacement. There are many learning curves to climb and goals to be achieved along the way. Expect failures, retreats, and multiple attempts as you gain experience. Be prepared for hardware failures and operator errors. Don't be afraid to buy additional hardware. Upgrade to FreeBSD 12.1, if possible. Use jails, if possible. Put your operating system on a single, small, fast SSD to simplify system administration and disaster preparedness (ZFS property copies=2). Build your ZFS pools from mirrored devices. I would start with two drives for data and VM's. If you anticipate needing more space, start with larger drives. If you later require more space and/or performance, stripe another equal-sized mirror onto the pool. Using all SSD's should give excellent performance, but HDD's with fast cache and/or ZIL devices might be a viable alternative (depending upon workload). David