From owner-freebsd-fs@freebsd.org Sun May 22 06:40:50 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 33D47B43F0E; Sun, 22 May 2016 06:40:50 +0000 (UTC) (envelope-from mckusick@chez.mckusick.com) Received: from chez.mckusick.com (chez.mckusick.com [IPv6:2001:5a8:4:7e72:d250:99ff:fe57:4030]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "chez.mckusick.com", Issuer "chez.mckusick.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 033D21D1B; Sun, 22 May 2016 06:40:49 +0000 (UTC) (envelope-from mckusick@chez.mckusick.com) Received: from chez.mckusick.com (localhost [IPv6:::1]) by chez.mckusick.com (8.15.2/8.15.2) with ESMTP id u4M6enEo017327; Sat, 21 May 2016 23:40:49 -0700 (PDT) (envelope-from mckusick@chez.mckusick.com) Message-Id: <201605220640.u4M6enEo017327@chez.mckusick.com> From: Kirk McKusick To: Andriy Gapon Subject: Re: mount / unmount and mountcheckdirs() cc: freebsd-arch@FreeBSD.org, freebsd-fs In-reply-to: <5c01bf62-b7b2-2e1d-bca5-859e6bf1f0e5@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-ID: <17325.1463899249.1@chez.mckusick.com> Content-Transfer-Encoding: quoted-printable Date: Sat, 21 May 2016 23:40:49 -0700 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 May 2016 06:40:50 -0000 > To: freebsd-arch@FreeBSD.org, freebsd-fs > From: Andriy Gapon > Subject: mount / unmount and mountcheckdirs() > Date: Sun, 15 May 2016 16:37:05 +0300 > = > I am curious about the purpose of mountcheckdirs() called when mounting = and > unmounting a filesystem. > = > The function is described as such: > /* > * Scan all active processes and prisons to see if any of them have a cu= rrent > * or root directory of `olddp'. If so, replace them with the new mount = point. > */ > and it seems to be used to "lift" processes and jails to a root of a new > filesystem when it is mounted and to "lower" them onto a covered vnode (= if any) > when a filesystem is unmounted. > = > What's the purpose of those actions? > It's strange that the machinations are done at all, but it is stranger t= hat they > are applied only to processes and jails at exactly a covered vnode and a= root > vnode. Anything below in a filesystem's tree is left alone. Is there a= nything > so very special about being at exactly those points? > = > IMO, the machinations can have unexpected security consequences. > = > A little bit of history. > mountcheckdirs() was first added in r22521 (circa 1997) as checkdirs wit= h a > rather non-specific commit message. Initially it was used only when a > filesystem was mounted. > Then, in r73241 (circa 2002) the function was added to dounmount(): > The checkdirs() function is called at mount time to find any process > fd_cdir or fd_rdir pointers referencing the covered mountpoint > vnode. It transfers these to point at the root of the new filesystem= . > However, this process was not reversed at unmount time, so processes > with a cwd/root at a mount point would unexpectedly lose their > cwd/root following a mount-unmount cycle at that mountpoint. > ... > Dounmount() now undoes the actions > taken by checkdirs() at mount time; any process cdir/rdir pointers > that reference the root vnode of the unmounted filesystem are > transferred to the now-uncovered vnode. > = > = > -- = > Andriy Gapon I added the checkdirs functionality in the mount direction only (I actually did it in 4.4BSD-Lite and it got swept in with commit 22521). The reason is that when a directory that is not empty is mounted on, the expectation is that the entries in that directory should no longer be present; rather they should be replaced by the entries in the newly mounted directory. Thus all processes sitting in the mounted on directory should see the newly mounted directory as if they had come to it using a lookup after the mount had been done. If a process had proceeded through the mounted on directory into one of its other entries, then they are left alone until such time as they chdir back into the mount point directory through ".." at which time they will be passed up to the mounted directory using the same mechanism that would put them there if they traversed into the mount point from above it in the tree. I believe this is the correct behavior, is not a security threat, and should be left alone. I was not aware that the functionality had been added at unmount time, and I do not believe that it should have been done. Normally an unmount will not succeed if any vnodes are busy (for example, if any directory in the filesystem is a current directory). The only way that it can succeed in such a case is if a forcible unmount is done. The forcible unmount will effectively do a revoke(2) on all current directory vnodes in the unmounted filesystem. Further attempts to access them will fail with "." not found errors. The only way to get a valid current directory is to chdir to an absolute pathname. Gratuitously fixing this if you happen to be in the former root of the filesystem is wrong. And as you note can lead to unintensionally giving an escape path from a prison. So I concur with your removing this added functionality. Kirk McKusick that it can succeed if any From owner-freebsd-fs@freebsd.org Sun May 22 21:00:21 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 861E7B45A0B for ; Sun, 22 May 2016 21:00:21 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 655401AE1 for ; Sun, 22 May 2016 21:00:21 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u4ML01FW049096 for ; Sun, 22 May 2016 21:00:21 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <201605222100.u4ML01FW049096@kenobi.freebsd.org> From: bugzilla-noreply@FreeBSD.org To: freebsd-fs@FreeBSD.org Subject: Problem reports for freebsd-fs@FreeBSD.org that need special attention Date: Sun, 22 May 2016 21:00:21 +0000 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 May 2016 21:00:21 -0000 To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- New | 203492 | mount_unionfs -o below causes panic Open | 136470 | [nfs] Cannot mount / in read-only, over NFS Open | 139651 | [nfs] mount(8): read-only remount of NFS volume d Open | 144447 | [zfs] sharenfs fsunshare() & fsshare_main() non f 4 problems total for which you should take action. From owner-freebsd-fs@freebsd.org Mon May 23 07:15:27 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4E6F3B46CFA for ; Mon, 23 May 2016 07:15:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3F8691E21 for ; Mon, 23 May 2016 07:15:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u4N7FQw1034932 for ; Mon, 23 May 2016 07:15:27 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209093] ZFS snapshot rename : .zfs/snapshot messes up Date: Mon, 23 May 2016 07:15:26 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: commit-hook@freebsd.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: avg@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 May 2016 07:15:27 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209093 --- Comment #4 from commit-hook@freebsd.org --- A commit references this bug: Author: avg Date: Mon May 23 07:15:23 UTC 2016 New revision: 300482 URL: https://svnweb.freebsd.org/changeset/base/300482 Log: MFC r300024: zfs_ioc_rename: fix a reversed condition PR: 209093 Changes: _U stable/10/ stable/10/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_ioctl.c --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-fs@freebsd.org Mon May 23 07:18:29 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 075F6B46E54 for ; Mon, 23 May 2016 07:18:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id EC7E511B8 for ; Mon, 23 May 2016 07:18:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u4N7ISVw039260 for ; Mon, 23 May 2016 07:18:28 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209093] ZFS snapshot rename : .zfs/snapshot messes up Date: Mon, 23 May 2016 07:18:29 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: commit-hook@freebsd.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: avg@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 May 2016 07:18:29 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209093 --- Comment #5 from commit-hook@freebsd.org --- A commit references this bug: Author: avg Date: Mon May 23 07:17:53 UTC 2016 New revision: 300483 URL: https://svnweb.freebsd.org/changeset/base/300483 Log: MFC r300024: zfs_ioc_rename: fix a reversed condition PR: 209093 Changes: _U stable/9/sys/ _U stable/9/sys/cddl/contrib/opensolaris/ stable/9/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_ioctl.c --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-fs@freebsd.org Mon May 23 07:23:01 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 144A3B460BF for ; Mon, 23 May 2016 07:23:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 0514F18C5 for ; Mon, 23 May 2016 07:23:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u4N7N0VG052788 for ; Mon, 23 May 2016 07:23:00 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209093] ZFS snapshot rename : .zfs/snapshot messes up Date: Mon, 23 May 2016 07:23:01 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: avg@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 May 2016 07:23:01 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209093 Andriy Gapon changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |FIXED Status|In Progress |Closed --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-fs@freebsd.org Mon May 23 21:51:32 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 38791B47E41 for ; Mon, 23 May 2016 21:51:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 298C41DB7 for ; Mon, 23 May 2016 21:51:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u4NLpVUf082868 for ; Mon, 23 May 2016 21:51:32 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209158] node / npm triggering zfs rename deadlock Date: Mon, 23 May 2016 21:51:32 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: doug@freebsd.con.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 May 2016 21:51:32 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209158 Doug Luce changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |doug@freebsd.con.com --- Comment #1 from Doug Luce --- Same thing is happening for me: % procstat -kk 2291 PID TID COMM TDNAME KSTACK 2291 101307 node - mi_switch+0xe1 sleepq_catch_signals+0xab sleepq_wait_sig+0xf _sleep+0x27d kern_kevent+0x401 sys_kevent+0x12a amd64_syscall+0x351 Xfast_syscall+0xfb 2291 101353 node V8 WorkerThread mi_switch+0xe1 sleepq_catch_signals+0xab sleepq_wait_sig+0xf _sleep+0x27d umtxq_sleep+0x125 do_sem_wait+0x4aa __umtx_op_sem_wait+0x73 amd64_syscall+0x351 Xfast_syscall+0xfb 2291 101354 node V8 WorkerThread mi_switch+0xe1 sleepq_catch_signals+0xab sleepq_wait_sig+0xf _sleep+0x27d umtxq_sleep+0x125 do_sem_wait+0x4aa __umtx_op_sem_wait+0x73 amd64_syscall+0x351 Xfast_syscall+0xfb 2291 101355 node V8 WorkerThread mi_switch+0xe1 sleepq_catch_signals+0xab sleepq_wait_sig+0xf _sleep+0x27d umtxq_sleep+0x125 do_sem_wait+0x4aa __umtx_op_sem_wait+0x73 amd64_syscall+0x351 Xfast_syscall+0xfb 2291 101356 node V8 WorkerThread mi_switch+0xe1 sleepq_catch_signals+0xab sleepq_wait_sig+0xf _sleep+0x27d umtxq_sleep+0x125 do_sem_wait+0x4aa __umtx_op_sem_wait+0x73 amd64_syscall+0x351 Xfast_syscall+0xfb 2291 101357 node - mi_switch+0xe1 sleepq_wait+0= x3a sleeplk+0x15d __lockmgr_args+0x902 vop_stdlock+0x3c VOP_LOCK1_APV+0xab _vn_lock+0x43 zfs_lookup+0x3c2 zfs_freebsd_lookup+0x6d VOP_CACHEDLOOKUP_APV+0xa1 vfs_cache_lookup+0xd6 VOP_LOOKUP_APV+0xa1 lookup+0x59c namei+0x4d4 kern_renameat+0x213 amd64_syscall+0x351 Xfast_syscall+0xfb 2291 101358 node - mi_switch+0xe1 sleepq_wait+0= x3a sleeplk+0x15d __lockmgr_args+0x902 vop_stdlock+0x3c VOP_LOCK1_APV+0xab _vn_lock+0x43 zfs_lookup+0x3c2 zfs_freebsd_lookup+0x6d VOP_CACHEDLOOKUP_APV+0xa1 vfs_cache_lookup+0xd6 VOP_LOOKUP_APV+0xa1 lookup+0x59c namei+0x4d4 kern_renameat+0x213 amd64_syscall+0x351 Xfast_syscall+0xfb 2291 101359 node - mi_switch+0xe1 sleepq_wait+0= x3a sleeplk+0x15d __lockmgr_args+0xc9e vop_stdlock+0x3c VOP_LOCK1_APV+0xab _vn_lock+0x43 vputx+0x21f zfs_rename_unlock+0x3e zfs_freebsd_rename+0xcdf VOP_RENAME_APV+0xab kern_renameat+0x3ef amd64_syscall+0x351 Xfast_syscall+0= xfb 2291 101360 node - mi_switch+0xe1 sleepq_wait+0= x3a sleeplk+0x15d __lockmgr_args+0x902 vop_stdlock+0x3c VOP_LOCK1_APV+0xab _vn_lock+0x43 zfs_lookup+0x3c2 zfs_freebsd_lookup+0x6d VOP_CACHEDLOOKUP_APV+0xa1 vfs_cache_lookup+0xd6 VOP_LOOKUP_APV+0xa1 lookup+0x59c namei+0x4d4 kern_renameat+0x213 amd64_syscall+0x351 Xfast_syscall+0xfb Full thread dump at https://gist.github.com/anonymous/3be664a893c8face928b678956b86302 --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Tue May 24 00:17:49 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 01B33B4779C for ; Tue, 24 May 2016 00:17:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E64D81B02 for ; Tue, 24 May 2016 00:17:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u4O0HmM1055748 for ; Tue, 24 May 2016 00:17:48 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209158] node / npm triggering zfs rename deadlock Date: Tue, 24 May 2016 00:17:48 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: rmacklem@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 May 2016 00:17:49 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209158 Rick Macklem changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |rmacklem@FreeBSD.org --- Comment #2 from Rick Macklem --- If it was possible, it might be useful to test with sysctl debug.vfscache=3D0 Why? Well there was a similar recent occurrence on Freefall, but where the vnode lock was on NFS. The similarity is that several of the threads that were waiting for the vnode lock were: cache_lookup()->vget()->_vn_lock()-> and r285632 changed cache_lookup() from using VI_LOCK() to vhold() before the vget() call. I am wondering if this change somehow broke the code. Anyhow, disabling name caching would avoid doing the code in cache_lookup(). Disabling name caching will have a performance hit, but it would be nice to see if this avoids the deadlock? --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Tue May 24 00:23:09 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1FDC5B479E8 for ; Tue, 24 May 2016 00:23:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 060A21F93 for ; Tue, 24 May 2016 00:23:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u4O0N8qK071740 for ; Tue, 24 May 2016 00:23:08 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209158] node / npm triggering zfs rename deadlock Date: Tue, 24 May 2016 00:23:08 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: doug@freebsd.con.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 May 2016 00:23:09 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209158 --- Comment #3 from Doug Luce --- (In reply to Rick Macklem from comment #2) OK, did that on the same machine as before. A new npm install gives me something slightly different: PID TID COMM TDNAME KSTACK 21557 100965 node - mi_switch+0xe1 sleepq_catch_signals+0xab sleepq_wait_sig+0xf _sleep+0x27d kern_kevent+0x401 sys_kevent+0x12a amd64_syscall+0x351 Xfast_syscall+0xfb 21557 101212 node V8 WorkerThread mi_switch+0xe1 sleepq_catch_signals+0xab sleepq_wait_sig+0xf _sleep+0x27d umtxq_sleep+0x125 do_sem_wait+0x4aa __umtx_op_sem_wait+0x73 amd64_syscall+0x351 Xfast_syscall+0xfb 21557 101213 node V8 WorkerThread mi_switch+0xe1 sleepq_catch_signals+0xab sleepq_wait_sig+0xf _sleep+0x27d umtxq_sleep+0x125 do_sem_wait+0x4aa __umtx_op_sem_wait+0x73 amd64_syscall+0x351 Xfast_syscall+0xfb 21557 101214 node - mi_switch+0xe1 sleepq_catch_signals+0xab sleepq_wait_sig+0xf _sleep+0x27d umtxq_sleep+0x125 do_wait+0x329 __umtx_op_wait_uint_private+0x83 amd64_syscall+0x351 Xfast_syscall+0xfb 21557 101215 node - mi_switch+0xe1 sleepq_wait+0= x3a sleeplk+0x15d __lockmgr_args+0x902 vop_stdlock+0x3c VOP_LOCK1_APV+0xab _vn_lock+0x43 zfs_lookup+0x3c2 zfs_freebsd_lookup+0x6d VOP_CACHEDLOOKUP_APV+0xa1 vfs_cache_lookup+0xd6 VOP_LOOKUP_APV+0xa1 lookup+0x59c namei+0x4d4 vn_open_cred+0x21d kern_openat+0x26f amd64_syscall+0x351 Xfast_syscall+0xfb 21557 101646 node V8 WorkerThread mi_switch+0xe1 sleepq_catch_signals+0xab sleepq_wait_sig+0xf _sleep+0x27d umtxq_sleep+0x125 do_sem_wait+0x4aa __umtx_op_sem_wait+0x73 amd64_syscall+0x351 Xfast_syscall+0xfb 21557 101651 node V8 WorkerThread mi_switch+0xe1 sleepq_catch_signals+0xab sleepq_wait_sig+0xf _sleep+0x27d umtxq_sleep+0x125 do_sem_wait+0x4aa __umtx_op_sem_wait+0x73 amd64_syscall+0x351 Xfast_syscall+0xfb 21557 101654 node - mi_switch+0xe1 sleepq_catch_signals+0xab sleepq_wait_sig+0xf _sleep+0x27d umtxq_sleep+0x125 do_wait+0x329 __umtx_op_wait_uint_private+0x83 amd64_syscall+0x351 Xfast_syscall+0xfb 21557 101655 node - mi_switch+0xe1 sleepq_catch_signals+0xab sleepq_wait_sig+0xf _sleep+0x27d umtxq_sleep+0x125 do_wait+0x329 __umtx_op_wait_uint_private+0x83 amd64_syscall+0x351 Xfast_syscall+0xfb Process still hangs, acourse. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Tue May 24 01:03:53 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DE91BB48382 for ; Tue, 24 May 2016 01:03:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id CF7D116DE for ; Tue, 24 May 2016 01:03:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u4O13rP4092844 for ; Tue, 24 May 2016 01:03:53 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209158] node / npm triggering zfs rename deadlock Date: Tue, 24 May 2016 01:03:54 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: rmacklem@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 May 2016 01:03:54 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209158 --- Comment #4 from Rick Macklem --- Oh well. Thanks for trying it. I am still not 100% convinced that recent changes haven't broken cache_lookup(), but your problem isn't that. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Tue May 24 06:53:02 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1516AB48AA4 for ; Tue, 24 May 2016 06:53:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 063361D5F for ; Tue, 24 May 2016 06:53:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u4O6r1UH065472 for ; Tue, 24 May 2016 06:53:01 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209158] node / npm triggering zfs rename deadlock Date: Tue, 24 May 2016 06:53:01 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 May 2016 06:53:02 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209158 --- Comment #5 from Andriy Gapon --- (In reply to Rick Macklem from comment #4) Rick, there is certainly a deadlock problem with rename on ZFS (on FreeBSD)= .=20=20 It's been there since day one. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Tue May 24 12:02:03 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CCF58B43CB3 for ; Tue, 24 May 2016 12:02:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id BE289181C for ; Tue, 24 May 2016 12:02:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u4OC23JU079706 for ; Tue, 24 May 2016 12:02:03 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209158] node / npm triggering zfs rename deadlock Date: Tue, 24 May 2016 12:02:03 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: rmacklem@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 May 2016 12:02:03 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209158 --- Comment #6 from Rick Macklem --- I knew there was a ZFS rename issue, but I thought it occurred rarely and typically (always??) when snapshots were being renamed. This problem seems to have become frequent. Of course, just about any change could cause changes in when things get executed and "tickle" the deadlock bug. There was a case on freefall that looked similar (due to a deadlock involving vnode locks, mostly through cache_lookup()) and I had "hoped" this was the same problem (since the freefall case occurred once in several months). It doesn't appear to be the same problem. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Tue May 24 12:42:20 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 102FDB477D9 for ; Tue, 24 May 2016 12:42:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 0147014FD for ; Tue, 24 May 2016 12:42:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u4OCgJ5F032671 for ; Tue, 24 May 2016 12:42:19 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209158] node / npm triggering zfs rename deadlock Date: Tue, 24 May 2016 12:42:20 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 May 2016 12:42:20 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209158 --- Comment #7 from Andriy Gapon --- (In reply to Rick Macklem from comment #6) > I knew there was a ZFS rename issue, but I thought it > occurred rarely and typically (always??) when snapshots > were being renamed. It is quite rare indeed. Just in case, I meant rename(2), so not sure how snapshot renaming, which is done through a special ioctl, can get into the picture. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Tue May 24 12:43:58 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BD91BB478F9 for ; Tue, 24 May 2016 12:43:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id AECD21737 for ; Tue, 24 May 2016 12:43:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u4OChwN3064529 for ; Tue, 24 May 2016 12:43:58 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209158] node / npm triggering zfs rename deadlock Date: Tue, 24 May 2016 12:43:58 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: doug@freebsd.con.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 May 2016 12:43:58 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209158 --- Comment #8 from Doug Luce --- I"m finding this highly reproducible at the moment. Anything I might do to = aid in diagnosis? --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Tue May 24 12:58:17 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C29CEB47F07 for ; Tue, 24 May 2016 12:58:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B3A521DB5 for ; Tue, 24 May 2016 12:58:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u4OCwG4d011322 for ; Tue, 24 May 2016 12:58:17 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209158] node / npm triggering zfs rename deadlock Date: Tue, 24 May 2016 12:58:16 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 May 2016 12:58:17 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209158 --- Comment #9 from Andriy Gapon --- (In reply to Doug Luce from comment #8) I believe that I know the root cause (if it's the same problem that I diagn= osed earlier). But my fix is very non-trivial, because it has a domino like effe= ct on the related ZFS code. So, I am not sure how to proceed from here. I have a dusty and somewhat logically incomplete but working patch. At the very least I can rebase it to the latest head and attach it to this = bug. Maybe tomorrow. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Tue May 24 15:00:08 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9EBA7B483F1 for ; Tue, 24 May 2016 15:00:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8FBBC1028 for ; Tue, 24 May 2016 15:00:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u4OF08xI041279 for ; Tue, 24 May 2016 15:00:08 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209158] node / npm triggering zfs rename deadlock Date: Tue, 24 May 2016 15:00:08 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: bengta@sics.se X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 May 2016 15:00:08 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209158 Bengt Ahlgren changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |bengta@sics.se --- Comment #10 from Bengt Ahlgren --- (In reply to Andriy Gapon from comment #9) You write that you think that a zfs rename (file, NOT snapshot) deadlock has been around for a long time. Do you think this could be the same issue (on 9.3)? https://lists.freebsd.org/pipermail/freebsd-fs/2015-December/022370.html The trigger there was a massively parallel java program creating (and renam= ing) a lot of output files. I would be interested in testing patches, but that server is unfortunately still running 9.3. Later in the summer perhaps. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Tue May 24 15:46:47 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DDBA5B480DB for ; Tue, 24 May 2016 15:46:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id CBB101A1B for ; Tue, 24 May 2016 15:46:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u4OFkl2l037914 for ; Tue, 24 May 2016 15:46:47 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209158] node / npm triggering zfs rename deadlock Date: Tue, 24 May 2016 15:46:47 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 May 2016 15:46:48 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209158 --- Comment #11 from Andriy Gapon --- (In reply to Bengt Ahlgren from comment #10) Yes, that looks like the same thing. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Tue May 24 16:58:35 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 97798B48782 for ; Tue, 24 May 2016 16:58:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8881F1659 for ; Tue, 24 May 2016 16:58:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u4OGwZUv028383 for ; Tue, 24 May 2016 16:58:35 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209158] node / npm triggering zfs rename deadlock Date: Tue, 24 May 2016 16:58:35 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 May 2016 16:58:35 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209158 --- Comment #12 from Andriy Gapon --- I've just created a phabricator review request with my patch: https://reviews.freebsd.org/D6533 I haven't added any reviewers or subscribers (other than umbrella ZFS subscriber), because I view this review request more as an invitation to a discussion or a request for comments. But please feel free to add yourself in either capacity. If you would like just to test the change, then there is 'Download Raw Diff' link. The patch is for head as of r300617. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Tue May 24 19:35:35 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CD563B483BF for ; Tue, 24 May 2016 19:35:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A4AE11680 for ; Tue, 24 May 2016 19:35:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u4OJZZD1036625 for ; Tue, 24 May 2016 19:35:35 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209158] node / npm triggering zfs rename deadlock Date: Tue, 24 May 2016 19:35:35 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: doug@freebsd.con.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 May 2016 19:35:35 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209158 --- Comment #13 from Doug Luce --- Running the patch give me this on bootup: kernel: lock order reversal: kernel: 1st 0xfffffe00f766fba0 bufwait (bufwait) @ /usr/src/sys/kern/vfs_bio.c:3512 kernel: 2nd 0xfffff800141e0200 dirhash (dirhash) @ /usr/src/sys/ufs/ufs/ufs_dirhash.c:281 kernel: stack backtrace: kernel: #0 0xffffffff80a76bc3 at witness_debugger+0x73 kernel: #1 0xffffffff80a76ac3 at witness_checkorder+0xea3 kernel: #2 0xffffffff80a21cc5 at _sx_xlock+0x75 kernel: #3 0xffffffff80cd5ded at ufsdirhash_move+0x3d kernel: #4 0xffffffff80cd831d at ufs_direnter+0x35d kernel: #5 0xffffffff80ce08a1 at ufs_mkdir+0x8b1 kernel: #6 0xffffffff80fd2e67 at VOP_MKDIR_APV+0xf7 kernel: #7 0xffffffff80ae3b09 at kern_mkdirat+0x209 kernel: #8 0xffffffff80e7d2ae at amd64_syscall+0x2de kernel: #9 0xffffffff80e5da1b at Xfast_syscall+0xfb A bit later on: kernel: acquiring duplicate lock of same type: "kqueue" kernel: 1st kqueue @ /usr/src/sys/kern/kern_event.c:2026 kernel: 2nd kqueue @ /usr/src/sys/kern/subr_taskqueue.c:282 kernel: stack backtrace: kernel: #0 0xffffffff80a76bc3 at witness_debugger+0x73 kernel: #1 0xffffffff80a76ac3 at witness_checkorder+0xea3 kernel: #2 0xffffffff809fb2b8 at __mtx_lock_flags+0xa8 kernel: #3 0xffffffff80a6945f at taskqueue_enqueue+0x3f kernel: #4 0xffffffff809d04f9 at knote_enqueue+0x119 kernel: #5 0xffffffff809d28c1 at knote+0x1c1 kernel: #6 0xffffffff80ad9843 at vop_rename_post+0x143 kernel: #7 0xffffffff80fd2d3b at VOP_RENAME_APV+0x13b kernel: #8 0xffffffff80ae3896 at kern_renameat+0x4a6 kernel: #9 0xffffffff80e7d2ae at amd64_syscall+0x2de kernel: #10 0xffffffff80e5da1b at Xfast_syscall+0xfb and the machine locks up. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Tue May 24 19:54:58 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 89DF0B48CE3 for ; Tue, 24 May 2016 19:54:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 7AD41151A for ; Tue, 24 May 2016 19:54:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u4OJswrO084187 for ; Tue, 24 May 2016 19:54:58 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209158] node / npm triggering zfs rename deadlock Date: Tue, 24 May 2016 19:54:58 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: kib@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 May 2016 19:54:58 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209158 --- Comment #14 from Konstantin Belousov --- (In reply to Doug Luce from comment #13) First LOR is known, false positive and not related. Second LOR is more interesting, but it should be innocent. The cause is du= e to witness matching locks by names, so it is just formal and is yet another consequence of the taskqueue changes. Still, the patch attached should fix= it. What program do you run which needs vnode notifications ? --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Tue May 24 19:55:28 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D93ABB48D3A for ; Tue, 24 May 2016 19:55:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id CA3AD16C0 for ; Tue, 24 May 2016 19:55:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u4OJtSbx085129 for ; Tue, 24 May 2016 19:55:28 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209158] node / npm triggering zfs rename deadlock Date: Tue, 24 May 2016 19:55:28 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: kib@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 May 2016 19:55:28 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209158 --- Comment #15 from Konstantin Belousov --- Created attachment 170634 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D170634&action= =3Dedit Silence false LOR --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Tue May 24 20:36:24 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4E11BB4979C for ; Tue, 24 May 2016 20:36:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3E431108B for ; Tue, 24 May 2016 20:36:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u4OKaNVT002907 for ; Tue, 24 May 2016 20:36:24 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209158] node / npm triggering zfs rename deadlock Date: Tue, 24 May 2016 20:36:24 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: doug@freebsd.con.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 May 2016 20:36:24 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209158 --- Comment #16 from Doug Luce --- Maybe btsync is leading to the second LOR? With the patch, I'm getting a locked machine after a couple minutes. Unfortunately it's an EC2 instance so no console access. Not sure what the = best way to proceed would be... --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Tue May 24 21:02:48 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AD80EB49D67 for ; Tue, 24 May 2016 21:02:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 849CA1E44 for ; Tue, 24 May 2016 21:02:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u4OL2mJ5042105 for ; Tue, 24 May 2016 21:02:48 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209158] node / npm triggering zfs rename deadlock Date: Tue, 24 May 2016 21:02:48 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: doug@freebsd.con.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 May 2016 21:02:48 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209158 --- Comment #17 from Doug Luce --- A little more luck, got the panic message at least: Fatal trap 12: page fault while in kernel mode cpuid =3D 0; apic id =3D 00 fault virtual address =3D 0x118 fault code =3D supervisor read data, page not present instruction pointer =3D 0x20:0xffffffff8229551d stack pointer =3D 0x28:0xfffffe01232905e0 frame pointer =3D 0x28:0xfffffe0123290600 code segment =3D base 0x0, limit 0xfffff, type 0x1b =3D DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags =3D interrupt enabled, resume, IOPL =3D 0 current process =3D 3233 (emacs-25.0.93) trap number =3D 12 panic: page fault cpuid =3D 0 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0123290= 0a0 kdb_backtrace() at kdb_backtrace+0x39/frame 0xfffffe0123290150 vpanic() at vpanic+0x189/frame 0xfffffe01232901d0 panic() at panic+0x43/frame 0xfffffe0123290230 trap_fatal() at trap_fatal+0x36b/frame 0xfffffe0123290290 trap_pfault() at trap_pfault+0x200/frame 0xfffffe0123290310 trap() at trap+0x4cc/frame 0xfffffe0123290520 calltrap() at calltrap+0x8/frame 0xfffffe0123290520 --- trap 0xc, rip =3D 0xffffffff8229551d, rsp =3D 0xfffffe01232905f0, rbp = =3D 0xfffffe0123290600 --- rrm_exit() at rrm_exit+0xd/frame 0xfffffe0123290600 zfs_freebsd_rename() at zfs_freebsd_rename+0x12e/frame 0xfffffe0123290710 VOP_RENAME_APV() at VOP_RENAME_APV+0xfc/frame 0xfffffe0123290740 kern_renameat() at kern_renameat+0x4a6/frame 0xfffffe01232909a0 amd64_syscall() at amd64_syscall+0x2de/frame 0xfffffe0123290ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0123290ab0 --- syscall (128, FreeBSD ELF64, sys_rename), rip =3D 0x807c5fbaa, rsp =3D 0x7fffffffc418, rbp =3D 0x7fffffffc450 --- Uptime: 28m4s Automatic reboot in 15 seconds - press a key on the console to abort --> Press a key on the console to reboot, --> or switch off the system now. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Tue May 24 21:20:41 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BBDB7B49106 for ; Tue, 24 May 2016 21:20:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id AD0851A66 for ; Tue, 24 May 2016 21:20:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u4OLKfdb096273 for ; Tue, 24 May 2016 21:20:41 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209158] node / npm triggering zfs rename deadlock Date: Tue, 24 May 2016 21:20:41 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 May 2016 21:20:41 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209158 --- Comment #18 from Andriy Gapon --- (In reply to Doug Luce from comment #17) As Konstantin said earlier those reported LORs are unlikely to have anythin= g to do with the lock-up. The panic looks like quite unexpected too... Could you please disassemble zfs_freebsd_rename in kgdb (kgdb /path/to/zfs.= ko) and attach the output? Thank you for testing! --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Tue May 24 21:22:31 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AFD1AB4924D for ; Tue, 24 May 2016 21:22:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A0F081D24 for ; Tue, 24 May 2016 21:22:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u4OLMVMC005325 for ; Tue, 24 May 2016 21:22:31 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209158] node / npm triggering zfs rename deadlock Date: Tue, 24 May 2016 21:22:31 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: doug@freebsd.con.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 May 2016 21:22:31 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209158 --- Comment #19 from Doug Luce --- Will this do? https://gist.github.com/anonymous/c18e9f08e7a36aef5c4ed2abb047e8f6 --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Wed May 25 12:48:09 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A8291B49031 for ; Wed, 25 May 2016 12:48:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 994A51341 for ; Wed, 25 May 2016 12:48:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u4PCm9Px037280 for ; Wed, 25 May 2016 12:48:09 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209158] node / npm triggering zfs rename deadlock Date: Wed, 25 May 2016 12:48:09 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 May 2016 12:48:09 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209158 --- Comment #20 from Andriy Gapon --- (In reply to Doug Luce from comment #19) Yes, thank you. Now I see one problem in the code, but it was present even without my patch= and now something in the patch triggers that bug. So, I have a fix for that problem, but more investigation might be required. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Wed May 25 13:08:05 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B348EB49429 for ; Wed, 25 May 2016 13:08:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A414D1DC9 for ; Wed, 25 May 2016 13:08:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u4PD83uJ020201 for ; Wed, 25 May 2016 13:08:05 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209158] node / npm triggering zfs rename deadlock Date: Wed, 25 May 2016 13:08:03 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 May 2016 13:08:05 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209158 --- Comment #21 from Andriy Gapon --- Created attachment 170652 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D170652&action= =3Dedit delta patch --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Wed May 25 22:02:30 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 05E4FB4A63C for ; Wed, 25 May 2016 22:02:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D2E091103 for ; Wed, 25 May 2016 22:02:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u4PM2TCr073014 for ; Wed, 25 May 2016 22:02:29 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209158] node / npm triggering zfs rename deadlock Date: Wed, 25 May 2016 22:02:29 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: doug@freebsd.con.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 May 2016 22:02:30 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209158 --- Comment #22 from Doug Luce --- With that patch, the npm install that used to hang no longer does. The panic didn't happen until the thing had been up a few hours: Fatal trap 12: page fault while in kernel mode cpuid =3D 1; apic id =3D 02 fault virtual address =3D 0xc0 fault code =3D supervisor read data, page not present instruction pointer =3D 0x20:0xffffffff82310db4 stack pointer =3D 0x28:0xfffffe01236e0600 frame pointer =3D 0x28:0xfffffe01236e0710 code segment =3D base 0x0, limit 0xfffff, type 0x1b =3D DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags =3D interrupt enabled, resume, IOPL =3D 0 current process =3D 2533 (emacs-25.0.93) trap number =3D 12 panic: page fault cpuid =3D 1 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe01236e0= 0c0 kdb_backtrace() at kdb_backtrace+0x39/frame 0xfffffe01236e0170 vpanic() at vpanic+0x189/frame 0xfffffe01236e01f0 panic() at panic+0x43/frame 0xfffffe01236e0250 trap_fatal() at trap_fatal+0x36b/frame 0xfffffe01236e02b0 trap_pfault() at trap_pfault+0x200/frame 0xfffffe01236e0330 trap() at trap+0x4cc/frame 0xfffffe01236e0540 calltrap() at calltrap+0x8/frame 0xfffffe01236e0540 --- trap 0xc, rip =3D 0xffffffff82310db4, rsp =3D 0xfffffe01236e0610, rbp = =3D 0xfffffe01236e0710 --- zfs_freebsd_rename() at zfs_freebsd_rename+0xe4/frame 0xfffffe01236e0710 VOP_RENAME_APV() at VOP_RENAME_APV+0xfc/frame 0xfffffe01236e0740 kern_renameat() at kern_renameat+0x4a6/frame 0xfffffe01236e09a0 amd64_syscall() at amd64_syscall+0x2de/frame 0xfffffe01236e0ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe01236e0ab0 --- syscall (128, FreeBSD ELF64, sys_rename), rip =3D 0x807c5fbaa, rsp =3D 0x7fffffffc418, rbp =3D 0x7fffffffc450 --- Uptime: 2h36m30s Dumping 1470 out of 4064 MB: (CTRL-C to abort) ..2%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete Automatic reboot in 15 seconds - press a key on the console to abort Rebooting... cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 1 --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Wed May 25 22:39:02 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 136EDB4AC18 for ; Wed, 25 May 2016 22:39:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id DF08210D1 for ; Wed, 25 May 2016 22:39:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u4PMd1qC051374 for ; Wed, 25 May 2016 22:39:01 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209158] node / npm triggering zfs rename deadlock Date: Wed, 25 May 2016 22:39:02 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: doug@freebsd.con.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 May 2016 22:39:02 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209158 --- Comment #23 from Doug Luce --- A second panic happened after only a few seconds of uptime after rebooting. Looks the same: Fatal trap 12: page fault while in kernel mode cpuid =3D 0; apic id =3D 00 fault virtual address =3D 0xc0 fault code =3D supervisor read data, page not present instruction pointer =3D 0x20:0xffffffff82310db4 stack pointer =3D 0x28:0xfffffe0123585600 frame pointer =3D 0x28:0xfffffe0123585710 code segment =3D base 0x0, limit 0xfffff, type 0x1b =3D DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags =3D interrupt enabled, resume, IOPL =3D 0 current process =3D 2734 (emacs-25.0.93) trap number =3D 12 panic: page fault cpuid =3D 0 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0123585= 0c0 kdb_backtrace() at kdb_backtrace+0x39/frame 0xfffffe0123585170 vpanic() at vpanic+0x189/frame 0xfffffe01235851f0 panic() at panic+0x43/frame 0xfffffe0123585250 trap_fatal() at trap_fatal+0x36b/frame 0xfffffe01235852b0 trap_pfault() at trap_pfault+0x200/frame 0xfffffe0123585330 trap() at trap+0x4cc/frame 0xfffffe0123585540 calltrap() at calltrap+0x8/frame 0xfffffe0123585540 --- trap 0xc, rip =3D 0xffffffff82310db4, rsp =3D 0xfffffe0123585610, rbp = =3D 0xfffffe0123585710 --- zfs_freebsd_rename() at zfs_freebsd_rename+0xe4/frame 0xfffffe0123585710 VOP_RENAME_APV() at VOP_RENAME_APV+0xfc/frame 0xfffffe0123585740 kern_renameat() at kern_renameat+0x4a6/frame 0xfffffe01235859a0 amd64_syscall() at amd64_syscall+0x2de/frame 0xfffffe0123585ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0123585ab0 --- syscall (128, FreeBSD ELF64, sys_rename), rip =3D 0x807c5fbaa, rsp =3D 0x7fffffffcf88, rbp =3D 0x7fffffffcfc0 --- Uptime: 12m25s Dumping 634 out of 4064 MB: (CTRL-C to abort) ..3%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Thu May 26 07:01:04 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 249EBB4A797 for ; Thu, 26 May 2016 07:01:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 157AA187E for ; Thu, 26 May 2016 07:01:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u4Q713Uo070891 for ; Thu, 26 May 2016 07:01:03 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209158] node / npm triggering zfs rename deadlock Date: Thu, 26 May 2016 07:01:03 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 26 May 2016 07:01:04 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209158 Andriy Gapon changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Open --- Comment #24 from Andriy Gapon --- (In reply to Doug Luce from comment #22) I am afraid that I really need to be able to poke inside the crash dump to = be able to understand what's happening here... Or, before that, could you please compile your kernel with DEBUG_VFS_LOCKS options if it's not enabled yet? --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Thu May 26 11:08:47 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 38B0AB4B4A5 for ; Thu, 26 May 2016 11:08:47 +0000 (UTC) (envelope-from freebsd-listen@fabiankeil.de) Received: from smtprelay03.ispgateway.de (smtprelay03.ispgateway.de [80.67.31.37]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4A0341D03 for ; Thu, 26 May 2016 11:08:45 +0000 (UTC) (envelope-from freebsd-listen@fabiankeil.de) Received: from [78.35.171.25] (helo=fabiankeil.de) by smtprelay03.ispgateway.de with esmtpsa (TLSv1.2:AES128-GCM-SHA256:128) (Exim 4.84) (envelope-from ) id 1b5ujn-0005DC-2r for freebsd-fs@freebsd.org; Thu, 26 May 2016 14:50:07 +0200 Date: Thu, 26 May 2016 12:48:22 +0200 From: Fabian Keil To: FreeBSD Filesystems Subject: Re: zfs receive stalls whole system Message-ID: <20160526124822.374b2dea@fabiankeil.de> In-Reply-To: <20160517123627.699e2aa5@fabiankeil.de> References: <0C2233A9-C64A-4773-ABA5-C0BCA0D037F0@ultra-secure.de> <20160517102757.135c1468@fabiankeil.de> <20160517123627.699e2aa5@fabiankeil.de> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; boundary="Sig_/c7iMMeIVRTkG76+IpJ0qpz5"; protocol="application/pgp-signature" X-Df-Sender: Nzc1MDY3 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 26 May 2016 11:08:47 -0000 --Sig_/c7iMMeIVRTkG76+IpJ0qpz5 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Fabian Keil wrote: > rainer@ultra-secure.de wrote: >=20 > > Am 2016-05-17 10:27, schrieb Fabian Keil: =20 > > > Rainer Duffner wrote: > > > =20 > > >> I have two servers, that were running FreeBSD 10.1-AMD64 for a long= =20 > > >> time, one zfs-sending to the other (via zxfer). Both are NFS-servers= =20 > > >> and MySQL-slaves, the sender is actively used as NFS-server, the=20 > > >> recipient is just a warm-standby, in case something serious happens= =20 > > >> and we don=E2=80=99t want to wait for a day until the restore is bac= k in=20 > > >> place. The MySQL-Slaves are actively used as read-only servers (at t= he=20 > > >> application level, Python=E2=80=99s SQL-Alchemy does that, apparentl= y). > > >>=20 > > >> They are HP DL380G8 (one CPU, hexacore) with over 128 GB RAM (I thin= k=20 > > >> one has 144, the other has 192). > > >> While they were running 10.1, they used HP P420 RAID-controllers wit= h=20 > > >> individual 12 RAID0 volumes that I pooled into 6-disk RAIDZ2 vdevs. > > >> I use zfsnap to do hourly, daily and weekly snapshots. =20 > > > [...] =20 > > >> Now, when I do a zxfer, sometimes the whole system stalls while the= =20 > > >> data is sent over, especially if the delta is large or if something= =20 > > >> else is reading from the disk at the same time (backup agent). > > >>=20 > > >> I had this before, on 10.0 (I believe, we didn=E2=80=99t have this i= n 9.1=20 > > >> either, IIRC) and it went away in 10.1. =20 > > >=20 > > > Do you use geli for swap device(s)? =20 > >=20 > >=20 > > Yes, I do. > > /dev/mirror/swap.eli none swap sw 0 0 > >=20 > > Bad idea? =20 >=20 > It can cause deadlocks and poor performance when paging. >=20 > This was recently fixed in ElectroBSD and I intend to submit > the patch in a couple of days after a bit more stress testing. Done: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209759 Fabian --Sig_/c7iMMeIVRTkG76+IpJ0qpz5 Content-Type: application/pgp-signature Content-Description: OpenPGP digital signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iEYEARECAAYFAldG1HcACgkQBYqIVf93VJ0TDgCeKKfOKu3Say8K0QDsWuAPmhPA s3AAoJPlCDWMXyVZJOBsOQulUU94U+hS =f3f2 -----END PGP SIGNATURE----- --Sig_/c7iMMeIVRTkG76+IpJ0qpz5-- From owner-freebsd-fs@freebsd.org Thu May 26 14:14:18 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 087A4B4B931 for ; Thu, 26 May 2016 14:14:18 +0000 (UTC) (envelope-from lists@yamagi.org) Received: from mail1.yamagi.org (yugo.yamagi.org [212.48.122.103]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id C8B3913D1 for ; Thu, 26 May 2016 14:14:16 +0000 (UTC) (envelope-from lists@yamagi.org) Received: from [10.1.0.1] (helo=webmail.yamagi.org) by mail1.yamagi.org with esmtpsa (TLSv1:ECDHE-RSA-AES256-SHA:256) (Exim 4.86 (FreeBSD)) (envelope-from ) id 1b5w2h-0005LI-M8 for freebsd-fs@freebsd.org; Thu, 26 May 2016 16:14:14 +0200 MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit Date: Thu, 26 May 2016 16:13:43 +0200 From: lists@yamagi.org To: freebsd-fs@freebsd.org Subject: LOR between allproc <-> ufs Message-ID: <20160526160902.bbe4c36ad340f11f69f7ba08@yamagi.org> X-Sender: lists@yamagi.org User-Agent: Roundcube Webmail/1.1.4 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 26 May 2016 14:14:18 -0000 Hello, having experienced several hard 'freezes' (system is still running, but all file system activity just hangs) on a FreeBSD 10.3-RELEASE machine, I've build a kernel with full debugging. Besides the well knows bufwait <-> dirhash LOR I've seen this one between allproc <-> ufs. Sadly the output is somewhat garbled, messages from LSIs upstream mps(4) driver interfered : May 26 15:24:26 grobi kernel: 1st 0xffffffff81885b28 allproc (allproc) @ /usr/src/sys/vm/vm_meter.c:122 May 26 15:24:26 grobi kernel: 2nd 0xfffff8022c60b5f0 ufs (ufs) @ /usr/src/sys/kern/vfs_subr.c:2364 May 26 15:24:26 grobi kernel: KDB: stack backtrace: May 26 15:24:26 grobi kernel: xpt_release_simq: requested 1 > present 0 May 26 15:24:26 grobi kernel: db_trace_self_wrapperxpt_release_simq: requested 1 > present 0 May 26 15:24:26 grobi kernel: () atxpt_release_simq: requested 1 > present 0 May 26 15:24:26 grobi kernel: xpt_release_simq: requested 1 > present 0 May 26 15:24:26 grobi kernel: db_trace_self_wxpt_release_simq: requested 1 > present 0 May 26 15:24:26 grobi kernel: rxpt_release_simq: requested 1 > present 0 May 26 15:24:26 grobi kernel: apper+xpt_release_simq: requested 1 > present 0 May 26 15:24:26 grobi kernel: 0x2b/fraxpt_release_simq: requested 1 > present 0 May 26 15:24:26 grobi kernel: me 0xfffffe1xpt_release_simq: requested 1 > present 0 May 26 15:24:26 grobi kernel: 04432b2d0 May 26 15:24:26 grobi kernel: xpt_release_simq: requested 1 > present 0 May 26 15:24:26 grobi kernel: xpt_release_simq: requested 1 > present 0 May 26 15:24:26 grobi kernel: kxpt_release_simq: requested 1 > present 0 May 26 15:24:26 grobi kernel: dxpt_release_simq: requested 1 > present 0 May 26 15:24:26 grobi kernel: bxpt_release_simq: requested 1 > present 0 May 26 15:24:26 grobi kernel: _backtrxpt_release_simq: requested 1 > present 0 May 26 15:24:26 grobi kernel: ace() atxpt_release_simq: requested 1 > present 0 May 26 15:24:26 grobi kernel: xpt_release_simq: requested 1 > present 0 May 26 15:24:26 grobi kernel: kdb_backxpt_release_simq: requested 1 > present 0 May 26 15:24:26 grobi kernel: trace+0x3xpt_release_simq: requested 1 > present 0 May 26 15:24:26 grobi kernel: 9/frame 0xpt_release_simq: requested 1 > present 0 May 26 15:24:26 grobi kernel: xfffffe10xpt_release_simq: requested 1 > present 0 May 26 15:24:26 grobi kernel: 4432b380 May 26 15:24:26 grobi kernel: xpt_release_simq: requested 1 > present 0 May 26 15:24:26 grobi kernel: xpt_release_simq: requested 1 > present 0 May 26 15:24:26 grobi kernel: wxpt_release_simq: requested 1 > present 0 May 26 15:24:26 grobi kernel: itnxpt_release_simq: requested 1 > present 0 May 26 15:24:26 grobi kernel: ess_chexpt_release_simq: requested 1 > present 0 May 26 15:24:26 grobi kernel: ckordexpt_release_simq: requested 1 > present 0 May 26 15:24:26 grobi kernel: r(xpt_release_simq: requested 1 > present 0 May 26 15:24:26 grobi kernel: ) at witness_checkorder+0xe24/frame 0xfffffe104432b410 May 26 15:24:26 grobi kernel: __lockmgr_args() at __lockmgr_args+0x9ea/frame 0xfffffe104432b550 May 26 15:24:26 grobi kernel: ffs_lock() at ffs_lock+0x84/frame 0xfffffe104432b5a0 May 26 15:24:26 grobi kernel: VOP_LOCK1_APV() at VOP_LOCK1_APV+0xfc/frame 0xfffffe104432b5d0 May 26 15:24:26 grobi kernel: _vn_lock() at _vn_lock+0xaa/frame 0xfffffe104432b640 May 26 15:24:26 grobi kernel: vputx() at vputx+0x232/frame 0xfffffe104432b6a0 May 26 15:24:26 grobi kernel: vm_object_deallocate() at vm_object_deallocate+0x5fb/frame 0xfffffe104432b700 May 26 15:24:26 grobi kernel: vm_map_process_deferred() at vm_map_process_deferred+0x89/frame 0xfffffe104432b730 May 26 15:24:26 grobi kernel: vm_map_remove() at vm_map_remove+0xc8/frame 0xfffffe104432b760 May 26 15:24:26 grobi kernel: vmspace_free() at vmspace_free+0x51/frame 0xfffffe104432b780 May 26 15:24:26 grobi kernel: vmtotal() at vmtotal+0x2a5/frame 0xfffffe104432b800 May 26 15:24:26 grobi kernel: sysctl_root() at sysctl_root+0x1d2/frame 0xfffffe104432b850 May 26 15:24:26 grobi kernel: userland_sysctl() at userland_sysctl+0x192/frame 0xfffffe104432b8f0 May 26 15:24:26 grobi kernel: sys___sysctl() at sys___sysctl+0x74/frame 0xfffffe104432b9a0 May 26 15:24:26 grobi kernel: amd64_syscall() at amd64_syscall+0x2c4/frame 0xfffffe104432bab0 May 26 15:24:26 grobi kernel: Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104432bab0 May 26 15:24:26 grobi kernel: --- syscall (202, FreeBSD ELF64, sys___sysctl), rip = 0x802ef665a, rsp = 0x7fffffffe758, rbp = 0x7fffffffe790 --- Can anybody tell me if this is a know false positive? So far I was unable to reproduce it. If I manage to do so I'll send a better stacktrace. Regards, Yamagi From owner-freebsd-fs@freebsd.org Thu May 26 15:58:51 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3CA0CB4BD65 for ; Thu, 26 May 2016 15:58:51 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id DA481177D for ; Thu, 26 May 2016 15:58:50 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kib@localhost [127.0.0.1]) by kib.kiev.ua (8.15.2/8.15.2) with ESMTPS id u4QFwiTB098675 (version=TLSv1 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Thu, 26 May 2016 18:58:44 +0300 (EEST) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.10.3 kib.kiev.ua u4QFwiTB098675 Received: (from kostik@localhost) by tom.home (8.15.2/8.15.2/Submit) id u4QFwiR0098674; Thu, 26 May 2016 18:58:44 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Thu, 26 May 2016 18:58:44 +0300 From: Konstantin Belousov To: lists@yamagi.org Cc: freebsd-fs@freebsd.org Subject: Re: LOR between allproc <-> ufs Message-ID: <20160526155844.GH38613@kib.kiev.ua> References: <20160526160902.bbe4c36ad340f11f69f7ba08@yamagi.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20160526160902.bbe4c36ad340f11f69f7ba08@yamagi.org> User-Agent: Mutt/1.6.1 (2016-04-27) X-Spam-Status: No, score=-2.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FREEMAIL_FROM,NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on tom.home X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 26 May 2016 15:58:51 -0000 On Thu, May 26, 2016 at 04:13:43PM +0200, lists@yamagi.org wrote: > Hello, > having experienced several hard 'freezes' (system is still running, but > all file system activity just hangs) on a FreeBSD 10.3-RELEASE machine, > I've build a kernel with full debugging. Besides the well knows bufwait > <-> dirhash LOR I've seen this one between allproc <-> ufs. Sadly the > output is somewhat garbled, messages from LSIs upstream mps(4) driver > interfered : > > May 26 15:24:26 grobi kernel: 1st 0xffffffff81885b28 allproc (allproc) @ > /usr/src/sys/vm/vm_meter.c:122 > May 26 15:24:26 grobi kernel: 2nd 0xfffff8022c60b5f0 ufs (ufs) @ > /usr/src/sys/kern/vfs_subr.c:2364 > May 26 15:24:26 grobi kernel: KDB: stack backtrace: > May 26 15:24:26 grobi kernel: xpt_release_simq: requested 1 > present 0 > May 26 15:24:26 grobi kernel: db_trace_self_wrapperxpt_release_simq: > requested 1 > present 0 > May 26 15:24:26 grobi kernel: () atxpt_release_simq: requested 1 > > present 0 > May 26 15:24:26 grobi kernel: xpt_release_simq: requested 1 > present 0 > May 26 15:24:26 grobi kernel: db_trace_self_wxpt_release_simq: requested > 1 > present 0 > May 26 15:24:26 grobi kernel: rxpt_release_simq: requested 1 > present 0 > May 26 15:24:26 grobi kernel: apper+xpt_release_simq: requested 1 > > present 0 > May 26 15:24:26 grobi kernel: 0x2b/fraxpt_release_simq: requested 1 > > present 0 > May 26 15:24:26 grobi kernel: me 0xfffffe1xpt_release_simq: requested 1 > > present 0 > May 26 15:24:26 grobi kernel: 04432b2d0 > May 26 15:24:26 grobi kernel: xpt_release_simq: requested 1 > present 0 > May 26 15:24:26 grobi kernel: xpt_release_simq: requested 1 > present 0 > May 26 15:24:26 grobi kernel: kxpt_release_simq: requested 1 > present 0 > May 26 15:24:26 grobi kernel: dxpt_release_simq: requested 1 > present 0 > May 26 15:24:26 grobi kernel: bxpt_release_simq: requested 1 > present 0 > May 26 15:24:26 grobi kernel: _backtrxpt_release_simq: requested 1 > > present 0 > May 26 15:24:26 grobi kernel: ace() atxpt_release_simq: requested 1 > > present 0 > May 26 15:24:26 grobi kernel: xpt_release_simq: requested 1 > present 0 > May 26 15:24:26 grobi kernel: kdb_backxpt_release_simq: requested 1 > > present 0 > May 26 15:24:26 grobi kernel: trace+0x3xpt_release_simq: requested 1 > > present 0 > May 26 15:24:26 grobi kernel: 9/frame 0xpt_release_simq: requested 1 > > present 0 > May 26 15:24:26 grobi kernel: xfffffe10xpt_release_simq: requested 1 > > present 0 > May 26 15:24:26 grobi kernel: 4432b380 > May 26 15:24:26 grobi kernel: xpt_release_simq: requested 1 > present 0 > May 26 15:24:26 grobi kernel: xpt_release_simq: requested 1 > present 0 > May 26 15:24:26 grobi kernel: wxpt_release_simq: requested 1 > present 0 > May 26 15:24:26 grobi kernel: itnxpt_release_simq: requested 1 > present > 0 > May 26 15:24:26 grobi kernel: ess_chexpt_release_simq: requested 1 > > present 0 > May 26 15:24:26 grobi kernel: ckordexpt_release_simq: requested 1 > > present 0 > May 26 15:24:26 grobi kernel: r(xpt_release_simq: requested 1 > present > 0 > May 26 15:24:26 grobi kernel: ) at witness_checkorder+0xe24/frame > 0xfffffe104432b410 > May 26 15:24:26 grobi kernel: __lockmgr_args() at > __lockmgr_args+0x9ea/frame 0xfffffe104432b550 > May 26 15:24:26 grobi kernel: ffs_lock() at ffs_lock+0x84/frame > 0xfffffe104432b5a0 > May 26 15:24:26 grobi kernel: VOP_LOCK1_APV() at > VOP_LOCK1_APV+0xfc/frame 0xfffffe104432b5d0 > May 26 15:24:26 grobi kernel: _vn_lock() at _vn_lock+0xaa/frame > 0xfffffe104432b640 > May 26 15:24:26 grobi kernel: vputx() at vputx+0x232/frame > 0xfffffe104432b6a0 > May 26 15:24:26 grobi kernel: vm_object_deallocate() at > vm_object_deallocate+0x5fb/frame 0xfffffe104432b700 > May 26 15:24:26 grobi kernel: vm_map_process_deferred() at > vm_map_process_deferred+0x89/frame 0xfffffe104432b730 > May 26 15:24:26 grobi kernel: vm_map_remove() at > vm_map_remove+0xc8/frame 0xfffffe104432b760 > May 26 15:24:26 grobi kernel: vmspace_free() at vmspace_free+0x51/frame > 0xfffffe104432b780 > May 26 15:24:26 grobi kernel: vmtotal() at vmtotal+0x2a5/frame > 0xfffffe104432b800 > May 26 15:24:26 grobi kernel: sysctl_root() at sysctl_root+0x1d2/frame > 0xfffffe104432b850 > May 26 15:24:26 grobi kernel: userland_sysctl() at > userland_sysctl+0x192/frame 0xfffffe104432b8f0 > May 26 15:24:26 grobi kernel: sys___sysctl() at sys___sysctl+0x74/frame > 0xfffffe104432b9a0 > May 26 15:24:26 grobi kernel: amd64_syscall() at > amd64_syscall+0x2c4/frame 0xfffffe104432bab0 > May 26 15:24:26 grobi kernel: Xfast_syscall() at > Xfast_syscall+0xfb/frame 0xfffffe104432bab0 > May 26 15:24:26 grobi kernel: --- syscall (202, FreeBSD ELF64, > sys___sysctl), rip = 0x802ef665a, rsp = 0x7fffffffe758, rbp = > 0x7fffffffe790 --- > > Can anybody tell me if this is a know false positive? So far I > was unable to reproduce it. If I manage to do so I'll send a > better stacktrace. I do not think this is a false positive, the order there is indeed allproc_lock->vnode lock. Reversed order can occur in, say, call to mountcheckdirs() from unmount, where we own mp root vnode lock and then iterate over all processes in the system. I do not see an easy (or any) way to avoid the lock order on umount. IMO we should avoid freeing reference on vmspace while owning the allproc_lock lock, and not unlock the user map due to deferred man entries free. Completely untested patch is below. I do not think that this LOR can be reproduced at will. E.g. you need to record the order in witness by unmounting some filesystem mounted on a directory on UFS mount. Then, the chances must be that it was the last reference on the vmspace, or that there were deferred vnode entry. diff --git a/sys/vm/vm_glue.c b/sys/vm/vm_glue.c index 83dc01a..c815c33 100644 --- a/sys/vm/vm_glue.c +++ b/sys/vm/vm_glue.c @@ -863,22 +863,32 @@ retry: struct vmspace *vm; int minslptime = 100000; int slptime; - + + PROC_LOCK(p); /* * Watch out for a process in * creation. It may have no * address space or lock yet. */ - if (p->p_state == PRS_NEW) + if (p->p_state == PRS_NEW) { + PROC_UNLOCK(p); continue; + } /* * An aio daemon switches its * address space while running. * Perform a quick check whether * a process has P_SYSTEM. + * Filter out exiting processes. */ - if ((p->p_flag & P_SYSTEM) != 0) + if ((p->p_flag & (P_SYSTEM | P_WEXIT)) != 0) { + PROC_UNLOCK(p); continue; + } + p->p_lock++; + PROC_UNLOCK(p); + sx_sunlock(&allproc_lock); + /* * Do not swapout a process that * is waiting for VM data @@ -893,16 +903,15 @@ retry: */ vm = vmspace_acquire_ref(p); if (vm == NULL) - continue; + goto nextproc2; if (!vm_map_trylock(&vm->vm_map)) goto nextproc1; PROC_LOCK(p); - if (p->p_lock != 0 || - (p->p_flag & (P_STOPPED_SINGLE|P_TRACED|P_SYSTEM|P_WEXIT) - ) != 0) { + if (p->p_lock != 1 || (p->p_flag & (P_STOPPED_SINGLE | + P_TRACED | P_SYSTEM)) != 0) goto nextproc; - } + /* * only aiod changes vmspace, however it will be * skipped because of the if statement above checking @@ -977,12 +986,13 @@ retry: if ((action & VM_SWAP_NORMAL) || ((action & VM_SWAP_IDLE) && (minslptime > swap_idle_threshold2))) { + _PRELE(p); if (swapout(p) == 0) didswap++; PROC_UNLOCK(p); + sx_sunlock(&allproc_lock); vm_map_unlock(&vm->vm_map); vmspace_free(vm); - sx_sunlock(&allproc_lock); goto retry; } } @@ -991,7 +1001,9 @@ nextproc: vm_map_unlock(&vm->vm_map); nextproc1: vmspace_free(vm); - continue; +nextproc2: + sx_slock(&allproc_lock); + PRELE(p); } sx_sunlock(&allproc_lock); /* diff --git a/sys/vm/vm_meter.c b/sys/vm/vm_meter.c index f1573a3..f1d8c6f 100644 --- a/sys/vm/vm_meter.c +++ b/sys/vm/vm_meter.c @@ -153,14 +153,20 @@ vmtotal(SYSCTL_HANDLER_ARGS) thread_unlock(td); } } + if ((p->p_flag & P_WEXIT) != 0) + continue; + p->p_lock++; /* avoid _PHOLD, no need for faultin() */ PROC_UNLOCK(p); /* * Note active objects. */ paging = 0; vm = vmspace_acquire_ref(p); - if (vm == NULL) + if (vm == NULL) { + PRELE(p); continue; + } + sx_sunlock(&allproc_lock); map = &vm->vm_map; vm_map_lock_read(map); for (entry = map->header.next; @@ -177,6 +183,8 @@ vmtotal(SYSCTL_HANDLER_ARGS) vmspace_free(vm); if (paging) total.t_pw++; + sx_slock(&allproc_lock); + PRELE(p); } sx_sunlock(&allproc_lock); /* diff --git a/sys/vm/vm_pageout.c b/sys/vm/vm_pageout.c index ffdcb61..29d4155 100644 --- a/sys/vm/vm_pageout.c +++ b/sys/vm/vm_pageout.c @@ -1484,19 +1484,21 @@ vm_pageout_oom(int shortage) PROC_UNLOCK(p); continue; } - _PHOLD(p); + p->p_lock++; + PROC_UNLOCK(p); + sx_sunlock(&allproc_lock); if (!vm_map_trylock_read(&vm->vm_map)) { - _PRELE(p); - PROC_UNLOCK(p); vmspace_free(vm); + sx_slock(&allproc_lock); + PRELE(p); continue; } - PROC_UNLOCK(p); size = vmspace_swap_count(vm); if (shortage == VM_OOM_MEM) size += vm_pageout_oom_pagecount(vm); vm_map_unlock_read(&vm->vm_map); vmspace_free(vm); + sx_slock(&allproc_lock); /* * If this process is bigger than the biggest one, @@ -1794,9 +1796,13 @@ again: if ((p->p_flag & P_INMEM) == 0) limit = 0; /* XXX */ vm = vmspace_acquire_ref(p); + p->p_lock++; PROC_UNLOCK(p); - if (vm == NULL) + if (vm == NULL) { + PRELE(p); continue; + } + sx_sunlock(&allproc_lock); size = vmspace_resident_count(vm); if (size >= limit) { @@ -1841,6 +1847,8 @@ again: } #endif vmspace_free(vm); + sx_slock(&allproc_lock); + PRELE(p); } sx_sunlock(&allproc_lock); if (tryagain != 0 && attempts <= 10) From owner-freebsd-fs@freebsd.org Thu May 26 19:27:49 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5E50CB4BE01 for ; Thu, 26 May 2016 19:27:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 36E071E13 for ; Thu, 26 May 2016 19:27:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u4QJRnIS066832 for ; Thu, 26 May 2016 19:27:49 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209158] node / npm triggering zfs rename deadlock Date: Thu, 26 May 2016 19:27:49 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: doug@freebsd.con.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 26 May 2016 19:27:49 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209158 --- Comment #25 from Doug Luce --- What's your SSH public key? I'll set you up with access. Recompiled with the flag, got a panic and a dump. Fatal trap 12: page fault while in kernel mode cpuid =3D 0; apic id =3D 00 fault virtual address =3D 0xc0 fault code =3D supervisor read data, page not present instruction pointer =3D 0x20:0xffffffff82311194 stack pointer =3D 0x28:0xfffffe0123717600 frame pointer =3D 0x28:0xfffffe0123717710 code segment =3D base 0x0, limit 0xfffff, type 0x1b =3D DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags =3D interrupt enabled, resume, IOPL =3D 0 current process =3D 2621 (emacs-25.0.93) trap number =3D 12 panic: page fault cpuid =3D 1 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0123717= 0c0 kdb_backtrace() at kdb_backtrace+0x39/frame 0xfffffe0123717170 vpanic() at vpanic+0x189/frame 0xfffffe01237171f0 panic() at panic+0x43/frame 0xfffffe0123717250 trap_fatal() at trap_fatal+0x36b/frame 0xfffffe01237172b0 trap_pfault() at trap_pfault+0x200/frame 0xfffffe0123717330 trap() at trap+0x4cc/frame 0xfffffe0123717540 calltrap() at calltrap+0x8/frame 0xfffffe0123717540 --- trap 0xc, rip =3D 0xffffffff82311194, rsp =3D 0xfffffe0123717610, rbp = =3D 0xfffffe0123717710 --- zfs_freebsd_rename() at zfs_freebsd_rename+0xe4/frame 0xfffffe0123717710 VOP_RENAME_APV() at VOP_RENAME_APV+0xfc/frame 0xfffffe0123717740 kern_renameat() at kern_renameat+0x4a6/frame 0xfffffe01237179a0 amd64_syscall() at amd64_syscall+0x2de/frame 0xfffffe0123717ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0123717ab0 --- syscall (128, FreeBSD ELF64, sys_rename), rip =3D 0x807c5fbaa, rsp =3D 0x7fffffffcdd8, rbp =3D 0x7fffffffce10 --- Uptime: 14m43s Dumping 565 out of 4064 MB: (CTRL-C to abort) ..3%..12%..23%..32%..43%..51%..63%..71%..83%..91% Dump complete --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Thu May 26 22:26:30 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A1DA3B4CF08 for ; Thu, 26 May 2016 22:26:30 +0000 (UTC) (envelope-from esamorokov@gmail.com) Received: from mail-pa0-x241.google.com (mail-pa0-x241.google.com [IPv6:2607:f8b0:400e:c03::241]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6123F18D5 for ; Thu, 26 May 2016 22:26:30 +0000 (UTC) (envelope-from esamorokov@gmail.com) Received: by mail-pa0-x241.google.com with SMTP id gp3so3595289pac.2 for ; Thu, 26 May 2016 15:26:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=to:from:subject:message-id:date:user-agent:mime-version; bh=OlKdH3yh3VVJ1jt47DoAtZ8fehxIKYqnAyMHUy+FCSI=; b=qmPTfUKTskTxbJiGvMCbqyc3pix5u6fURXuJI2eXwX8Nh8UIcVh6Pvrzh0PGxQR6FK NxOPbtd1YyJxj9mT6UtSrVa3h44iGSaoCnUhcI9mkn/Lbsv7YtuaglD/3cFq8vI+ODfb armbE6JXUoIVYLL79D1Ekwy/Hd0i09weRA2XiHECDKutvVfPF5lzL3FfruZxKJX2/QdI K55N0rHImU2XO7h4IRVqRBaZQgrDNKLQ8OcdccWxFMO00U01sX7Wyw1markAsYeFfJHh roQqTK7fwAdkEXpAjo1gDPYeBuCqyTLFfTo0Ymcviuj4dw2r13xIupGQIuVAzA1hsyDE 6yXg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:to:from:subject:message-id:date:user-agent :mime-version; bh=OlKdH3yh3VVJ1jt47DoAtZ8fehxIKYqnAyMHUy+FCSI=; b=WjgoM/Qo8FxDddGMhJKlQDgcSQE570REebP/YWEz7Y6x9T1eaxOpJ7DN5+MfbNudqS FriopTW7rEkb9u1nw9vwz3lT8PbxBhTXHxC1DRqzH3WAag0mgLLLWklGa1r2Vkp/n2LS humNSH5QDzPZk9CRiV22lf/+bc7cVFN6slSfRcZMBz3StGRzEyYAJ7A4PqcT1eCiFko7 OpbNiHbBuRsEUQ5qekUq5NDi3Dk7LOq4eNR22qtD+yEoIUMtNCWiboH78JZq3S1OFSvM Cre5sCdCgVOG59pVtsywxshXmsdiUQISpIi0onO6TzCZQUxH5pCHceNIb1YGKlhdPwZ3 D+4Q== X-Gm-Message-State: ALyK8tIqALkD7YcrejnKp5U0FTPPBpiFq0N8U+cVPKIkNKqOmOWdB8tSbWWdu/S/KuGOcw== X-Received: by 10.66.166.78 with SMTP id ze14mr17607838pab.149.1464301589920; Thu, 26 May 2016 15:26:29 -0700 (PDT) Received: from [10.8.104.106] ([199.47.179.227]) by smtp.googlemail.com with ESMTPSA id w27sm8414470pfi.24.2016.05.26.15.26.26 (version=TLSv1/SSLv3 cipher=OTHER); Thu, 26 May 2016 15:26:28 -0700 (PDT) To: freebsd-fs@freebsd.org, BlackCat From: esamorokov Subject: ZFS - RAIDZ1 Recovery Message-ID: <5747780A.5000809@gmail.com> Date: Thu, 26 May 2016 15:26:18 -0700 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Thunderbird/38.8.0 MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="------------000201070805010504040008" X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 26 May 2016 22:26:30 -0000 This is a multi-part message in MIME format. --------------000201070805010504040008 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Hello All, My name is Evgeny and I have 3 x 3TB in RAIDZ1, where one drive is gone and I accidentally screwed the other two. The data should be fine, just need to revert uberblock in point of time, where i started doing changes. I AM KINDLY ASKING FOR HELP! The pool had all of the family memories for many years :( Thanks in advance! I am not a FreeBSD guru and have been using ZFS for a couple of years, but I know Linux and do some programming/scripting. Since I got that incident I started learning the depth of the ZFS, but I definitely need help on it at this point. Please don't ask me why I did not have backups, I was building backup server in my garage, when it happened History: I was using WEB GUI of FreeNas and it reported a failed drive I shutdown the computer and replaced the drive, but I did not noticed that I accidentally disconnected power of another drive I powered on the server and expanded the pool where there only one drive of the pool was active Then I began to really learn ZFS and messing up with bits At some point I created a backup bit-to-bit images of the two drives from the pool (using R-Studio) Specs: OS: FreeBSD 9.2-RELEASE (FREENAS.amd64) #0 r+2315ea3: Fri Dec 20 12:48:50 PST 2013 RAID: [root@juicy] ~# camcontrol devlist at scbus1 target 0 lun 0 (pass1,ada1) at scbus2 target 0 lun 0 (ada2,pass2) at scbus3 target 0 lun 0 (pass3,ada3) [root@juicy] ~# zdb zh_vol: version: 5000 name: 'zh_vol' state: 0 txg: 14106447 pool_guid: 2918670121059000644 hostid: 1802987710 hostname: '' vdev_children: 1 vdev_tree: type: 'root' id: 0 guid: 2918670121059000644 create_txg: 4 children[0]: type: 'raidz' id: 0 guid: 14123440993587991088 nparity: 1 metaslab_array: 34 metaslab_shift: 36 ashift: 12 asize: 8995321675776 is_log: 0 create_txg: 4 children[0]: type: 'disk' id: 0 guid: 17624020450804741401 path: '/dev/gptid/6e5cea27-7f52-11e3-9cd8-d43d7ed5b587' whole_disk: 1 DTL: 137 create_txg: 4 children[1]: type: 'disk' id: 1 guid: 3253299067537287428 path: '/dev/gptid/2b70d9c0-8e40-11e3-aa1c-d43d7ed5b587' whole_disk: 1 DTL: 133 create_txg: 4 children[2]: type: 'disk' id: 2 guid: 17999524418015963258 path: '/dev/gptid/1e898758-9488-11e3-a86e-d43d7ed5b587' whole_disk: 1 DTL: 134 create_txg: 4 features_for_read: --------------000201070805010504040008 Content-Type: text/plain; charset=UTF-8; name="Zpool_history_cleanned" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="Zpool_history_cleanned" Cltyb290QGp1aWN5XSB+IyB6ZGIKIyMjIyMjIyMjIyMjIy8vLS1TVEFSVCBPRiBTVERPVVQt LS8vIyMjIyMjIyMjIyMjIwp6aF92b2w6CiAgICB2ZXJzaW9uOiA1MDAwCiAgICBuYW1lOiAn emhfdm9sJwogICAgc3RhdGU6IDAKICAgIHR4ZzogMTQxMDY0NDcKICAgIHBvb2xfZ3VpZDog MjkxODY3MDEyMTA1OTAwMDY0NAogICAgaG9zdGlkOiAxODAyOTg3NzEwCiAgICBob3N0bmFt ZTogJycKICAgIHZkZXZfY2hpbGRyZW46IDEKICAgIHZkZXZfdHJlZToKICAgICAgICB0eXBl OiAncm9vdCcKICAgICAgICBpZDogMAogICAgICAgIGd1aWQ6IDI5MTg2NzAxMjEwNTkwMDA2 NDQKICAgICAgICBjcmVhdGVfdHhnOiA0CiAgICAgICAgY2hpbGRyZW5bMF06CiAgICAgICAg ICAgIHR5cGU6ICdyYWlkeicKICAgICAgICAgICAgaWQ6IDAKICAgICAgICAgICAgZ3VpZDog MTQxMjM0NDA5OTM1ODc5OTEwODgKICAgICAgICAgICAgbnBhcml0eTogMQogICAgICAgICAg ICBtZXRhc2xhYl9hcnJheTogMzQKICAgICAgICAgICAgbWV0YXNsYWJfc2hpZnQ6IDM2CiAg ICAgICAgICAgIGFzaGlmdDogMTIKICAgICAgICAgICAgYXNpemU6IDg5OTUzMjE2NzU3NzYK ICAgICAgICAgICAgaXNfbG9nOiAwCiAgICAgICAgICAgIGNyZWF0ZV90eGc6IDQKICAgICAg ICAgICAgY2hpbGRyZW5bMF06CiAgICAgICAgICAgICAgICB0eXBlOiAnZGlzaycKICAgICAg ICAgICAgICAgIGlkOiAwCiAgICAgICAgICAgICAgICBndWlkOiAxNzYyNDAyMDQ1MDgwNDc0 MTQwMQogICAgICAgICAgICAgICAgcGF0aDogJy9kZXYvZ3B0aWQvNmU1Y2VhMjctN2Y1Mi0x MWUzLTljZDgtZDQzZDdlZDViNTg3JwogICAgICAgICAgICAgICAgd2hvbGVfZGlzazogMQog ICAgICAgICAgICAgICAgRFRMOiAxMzcKICAgICAgICAgICAgICAgIGNyZWF0ZV90eGc6IDQK ICAgICAgICAgICAgY2hpbGRyZW5bMV06CiAgICAgICAgICAgICAgICB0eXBlOiAnZGlzaycK ICAgICAgICAgICAgICAgIGlkOiAxCiAgICAgICAgICAgICAgICBndWlkOiAzMjUzMjk5MDY3 NTM3Mjg3NDI4CiAgICAgICAgICAgICAgICBwYXRoOiAnL2Rldi9ncHRpZC8yYjcwZDljMC04 ZTQwLTExZTMtYWExYy1kNDNkN2VkNWI1ODcnCiAgICAgICAgICAgICAgICB3aG9sZV9kaXNr OiAxCiAgICAgICAgICAgICAgICBEVEw6IDEzMwogICAgICAgICAgICAgICAgY3JlYXRlX3R4 ZzogNAogICAgICAgICAgICBjaGlsZHJlblsyXToKICAgICAgICAgICAgICAgIHR5cGU6ICdk aXNrJwogICAgICAgICAgICAgICAgaWQ6IDIKICAgICAgICAgICAgICAgIGd1aWQ6IDE3OTk5 NTI0NDE4MDE1OTYzMjU4CiAgICAgICAgICAgICAgICBwYXRoOiAnL2Rldi9ncHRpZC8xZTg5 ODc1OC05NDg4LTExZTMtYTg2ZS1kNDNkN2VkNWI1ODcnCiAgICAgICAgICAgICAgICB3aG9s ZV9kaXNrOiAxCiAgICAgICAgICAgICAgICBEVEw6IDEzNAogICAgICAgICAgICAgICAgY3Jl YXRlX3R4ZzogNAogICAgZmVhdHVyZXNfZm9yX3JlYWQ6CiAjIyMjIyMjIyMjIyMjLy8tLUVO RCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwoKCltyb290QGp1aWN5XSB+IyB6cG9vbCBk ZXRhY2ggemhfdm9sIDE3OTk5NTI0NDE4MDE1OTYzMjU4CiMjIyMjIyMjIyMjIyMvLy0tU1RB UlQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKY2Fubm90IG9wZW4gJ3poX3ZvbCc6IG5v IHN1Y2ggcG9vbAojIyMjIyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQtLS8vIyMjIyMjIyMj IyMjIwoKW3Jvb3RAanVpY3ldIH4jIHpwb29sIGxpc3QKIyMjIyMjIyMjIyMjIy8vLS1TVEFS VCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwpubyBwb29scyBhdmFpbGFibGUKIyMjIyMj IyMjIyMjIy8vLS1FTkQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCgpbcm9vdEBqdWlj eV0gfiMgemZzIG1vdW50CiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMj IyMjIyMjIyMjIyMKIyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VULS0vLyMjIyMjIyMj IyMjIyMKCltyb290QGp1aWN5XSB+IyB6cG9vbCBzdGF0dXMKIyMjIyMjIyMjIyMjIy8vLS1T VEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwpubyBwb29scyBhdmFpbGFibGUKIyMj IyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290QGp1 aWN5XSB+IyB6cG9vbCBsaXN0CiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0v LyMjIyMjIyMjIyMjIyMKbm8gcG9vbHMgYXZhaWxhYmxlCiMjIyMjIyMjIyMjIyMvLy0tRU5E IE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0gfiMgemZzIG1vdW50 IDI5MTg2NzAxMjEwNTkwMDA2NDQKIyMjIyMjIyMjIyMjIy8vLS1TVEFSVCBPRiBTVERPVVQt LS8vIyMjIyMjIyMjIyMjIwpjYW5ub3Qgb3BlbiAnMjkxODY3MDEyMTA1OTAwMDY0NCc6IGRh dGFzZXQgZG9lcyBub3QgZXhpc3QKIyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VULS0v LyMjIyMjIyMjIyMjIyMKCltyb290QGp1aWN5XSB+IyB6ZnMgbW91bnQgemhfdm9sCiMjIyMj IyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKY2Fubm90IG9w ZW4gJ3poX3ZvbCc6IGRhdGFzZXQgZG9lcyBub3QgZXhpc3QKIyMjIyMjIyMjIyMjIy8vLS1F TkQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290QGp1aWN5XSB+IyB6ZnMgbGlz dAojIyMjIyMjIyMjIyMjLy8tLVNUQVJUIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCm5v IGRhdGFzZXRzIGF2YWlsYWJsZQojIyMjIyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQtLS8v IyMjIyMjIyMjIyMjIwoKW3Jvb3RAanVpY3ldIH4jIG1hbiB6ZGIKIyMjIyMjIyMjIyMjIy8v LS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwptYW46IENvbW1hbmQgbm90IGZv dW5kLgojIyMjIyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwoK W3Jvb3RAanVpY3ldIH4jIHpwb29sIGltcG9ydAojIyMjIyMjIyMjIyMjLy8tLVNUQVJUIE9G IFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCiAgIHBvb2w6IHpoX3ZvbAogICAgIGlkOiAyOTE4 NjcwMTIxMDU5MDAwNjQ0CiAgc3RhdGU6IEZBVUxURUQKIHN0YXR1czogT25lIG9yIG1vcmUg ZGV2aWNlcyBhcmUgbWlzc2luZyBmcm9tIHRoZSBzeXN0ZW0uCiBhY3Rpb246IFRoZSBwb29s IGNhbm5vdCBiZSBpbXBvcnRlZC4gQXR0YWNoIHRoZSBtaXNzaW5nCglkZXZpY2VzIGFuZCB0 cnkgYWdhaW4uCglUaGUgcG9vbCBtYXkgYmUgYWN0aXZlIG9uIGFub3RoZXIgc3lzdGVtLCBi dXQgY2FuIGJlIGltcG9ydGVkIHVzaW5nCgl0aGUgJy1mJyBmbGFnLgogICBzZWU6IGh0dHA6 Ly9pbGx1bW9zLm9yZy9tc2cvWkZTLTgwMDAtM0MKIGNvbmZpZzoKCgl6aF92b2wgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBGQVVMVEVEICBjb3JydXB0ZWQg ZGF0YQoJICByYWlkejEtMCAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg REVHUkFERUQKCSAgICAxNzYyNDAyMDQ1MDgwNDc0MTQwMSAgICAgICAgICAgICAgICAgICAg ICAgIFVOQVZBSUwgIGNhbm5vdCBvcGVuCgkgICAgZ3B0aWQvMmI3MGQ5YzAtOGU0MC0xMWUz LWFhMWMtZDQzZDdlZDViNTg3ICBPTkxJTkUKCSAgICBncHRpZC81ZGFjZDczNy0xOGFjLTEx ZTYtOWMyNS0wMDFiNzg1OWI5M2UgIE9OTElORQoJICAgICMjIyMjIyMjIyMjIyMvLy0tRU5E IE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0gfiMgenBvb2wgb2Zm bGluZSAtdCB6aF92b2wgL2Rldi9ncHRpZC8xZTg5ODc1OC05NDg4LTExZTMtYTg2ZS1kNDNk N2VkNWI1ODcgCiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMjIyMj IyMjIyMKY2Fubm90IG9wZW4gJ3poX3ZvbCc6IG5vIHN1Y2ggcG9vbAojIyMjIyMjIyMjIyMj Ly8tLUVORCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwoKW3Jvb3RAanVpY3ldIH4jIHpw b29sIG9mZmxpbmUgLXQgMjkxODY3MDEyMTA1OTAwMDY0NCAvZGV2L2dwdGlkLzFlODk4NzU4 LTk0ODgtMTFlMy1hODZlLWQ0M2Q3ZWQ1YjU4NwojIyMjIyMjIyMjIyMjLy8tLVNUQVJUIE9G IFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCmNhbm5vdCBvcGVuICcyOTE4NjcwMTIxMDU5MDAw NjQ0JzogbmFtZSBtdXN0IGJlZ2luIHdpdGggYSBsZXR0ZXIKIyMjIyMjIyMjIyMjIy8vLS1F TkQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290QGp1aWN5XSB+IyB6ZGIKIyMj IyMjIyMjIyMjIy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwp6aF92b2w6 CiAgICB2ZXJzaW9uOiA1MDAwCiAgICBuYW1lOiAnemhfdm9sJwogICAgc3RhdGU6IDAKICAg IHR4ZzogMTQxMDY0NDcKICAgIHBvb2xfZ3VpZDogMjkxODY3MDEyMTA1OTAwMDY0NAogICAg aG9zdGlkOiAxODAyOTg3NzEwCiAgICBob3N0bmFtZTogJycKICAgIHZkZXZfY2hpbGRyZW46 IDEKICAgIHZkZXZfdHJlZToKICAgICAgICB0eXBlOiAncm9vdCcKICAgICAgICBpZDogMAog ICAgICAgIGd1aWQ6IDI5MTg2NzAxMjEwNTkwMDA2NDQKICAgICAgICBjcmVhdGVfdHhnOiA0 CiAgICAgICAgY2hpbGRyZW5bMF06CiAgICAgICAgICAgIHR5cGU6ICdyYWlkeicKICAgICAg ICAgICAgaWQ6IDAKICAgICAgICAgICAgZ3VpZDogMTQxMjM0NDA5OTM1ODc5OTEwODgKICAg ICAgICAgICAgbnBhcml0eTogMQogICAgICAgICAgICBtZXRhc2xhYl9hcnJheTogMzQKICAg ICAgICAgICAgbWV0YXNsYWJfc2hpZnQ6IDM2CiAgICAgICAgICAgIGFzaGlmdDogMTIKICAg ICAgICAgICAgYXNpemU6IDg5OTUzMjE2NzU3NzYKICAgICAgICAgICAgaXNfbG9nOiAwCiAg ICAgICAgICAgIGNyZWF0ZV90eGc6IDQKICAgICAgICAgICAgY2hpbGRyZW5bMF06CiAgICAg ICAgICAgICAgICB0eXBlOiAnZGlzaycKICAgICAgICAgICAgICAgIGlkOiAwCiAgICAgICAg ICAgICAgICBndWlkOiAxNzYyNDAyMDQ1MDgwNDc0MTQwMQogICAgICAgICAgICAgICAgcGF0 aDogJy9kZXYvZ3B0aWQvNmU1Y2VhMjctN2Y1Mi0xMWUzLTljZDgtZDQzZDdlZDViNTg3Jwog ICAgICAgICAgICAgICAgd2hvbGVfZGlzazogMQogICAgICAgICAgICAgICAgRFRMOiAxMzcK ICAgICAgICAgICAgICAgIGNyZWF0ZV90eGc6IDQKICAgICAgICAgICAgY2hpbGRyZW5bMV06 CiAgICAgICAgICAgICAgICB0eXBlOiAnZGlzaycKICAgICAgICAgICAgICAgIGlkOiAxCiAg ICAgICAgICAgICAgICBndWlkOiAzMjUzMjk5MDY3NTM3Mjg3NDI4CiAgICAgICAgICAgICAg ICBwYXRoOiAnL2Rldi9ncHRpZC8yYjcwZDljMC04ZTQwLTExZTMtYWExYy1kNDNkN2VkNWI1 ODcnCiAgICAgICAgICAgICAgICB3aG9sZV9kaXNrOiAxCiAgICAgICAgICAgICAgICBEVEw6 IDEzMwogICAgICAgICAgICAgICAgY3JlYXRlX3R4ZzogNAogICAgICAgICAgICBjaGlsZHJl blsyXToKICAgICAgICAgICAgICAgIHR5cGU6ICdkaXNrJwogICAgICAgICAgICAgICAgaWQ6 IDIKICAgICAgICAgICAgICAgIGd1aWQ6IDE3OTk5NTI0NDE4MDE1OTYzMjU4CiAgICAgICAg ICAgICAgICBwYXRoOiAnL2Rldi9ncHRpZC8xZTg5ODc1OC05NDg4LTExZTMtYTg2ZS1kNDNk N2VkNWI1ODcnCiAgICAgICAgICAgICAgICB3aG9sZV9kaXNrOiAxCiAgICAgICAgICAgICAg ICBEVEw6IDEzNAogICAgICAgICAgICAgICAgY3JlYXRlX3R4ZzogNAogICAgZmVhdHVyZXNf Zm9yX3JlYWQ6CiAgICAjIyMjIyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQtLS8vIyMjIyMj IyMjIyMjIwoKW3Jvb3RAanVpY3ldIH4jIHpkYiAtRiB6aF92b2wKIyMjIyMjIyMjIyMjIy8v LS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwp6ZGI6IGNhbid0IG9wZW4gJ3po X3ZvbCc6IE5vIHN1Y2ggZmlsZSBvciBkaXJlY3RvcnkKIyMjIyMjIyMjIyMjIy8vLS1FTkQg T0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290QGp1aWN5XSB+IyB6ZGIgLUYgL2Jv b3QKIyMjIyMjIyMjIyMjIy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwpi b290LmNvbmZpZyAgYm9vdC8gICAgICAgIAojIyMjIyMjIyMjIyMjLy8tLUVORCBPRiBTVERP VVQtLS8vIyMjIyMjIyMjIyMjIwoKW3Jvb3RAanVpY3ldIH4jIHpkYiAtRiAvYm9vdC96ZnMK IyMjIyMjIyMjIyMjIy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwp6ZnMv ICAgICAgIHpmc2Jvb3QgICAgemZzbG9hZGVyKiAKIyMjIyMjIyMjIyMjIy8vLS1FTkQgT0Yg U1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290QGp1aWN5XSB+IyB6ZGIgLUYgL2Jvb3Qv emZzCiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMK emZzLyAgICAgICB6ZnNib290ICAgIHpmc2xvYWRlciogCiMjIyMjIyMjIyMjIyMvLy0tRU5E IE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0gfiMgbGVzcyAvYm9v dC96ZnMvenBvb2wuY2FjaGUgCiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0v LyMjIyMjIyMjIyMjIyMKIi9ib290L3pmcy96cG9vbC5jYWNoZSIgbWF5IGJlIGEgYmluYXJ5 IGZpbGUuICBTZWUgaXQgYW55d2F5PyAKIyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VU LS0vLyMjIyMjIyMjIyMjIyMKCltyb290QGp1aWN5XSB+IyB6ZGIKIyMjIyMjIyMjIyMjIy8v LS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwp6aF92b2w6CiAgICB2ZXJzaW9u OiA1MDAwCiAgICBuYW1lOiAnemhfdm9sJwogICAgc3RhdGU6IDAKICAgIHR4ZzogMTQxMDY0 NDcKICAgIHBvb2xfZ3VpZDogMjkxODY3MDEyMTA1OTAwMDY0NAogICAgaG9zdGlkOiAxODAy OTg3NzEwCiAgICBob3N0bmFtZTogJycKICAgIHZkZXZfY2hpbGRyZW46IDEKICAgIHZkZXZf dHJlZToKICAgICAgICB0eXBlOiAncm9vdCcKICAgICAgICBpZDogMAogICAgICAgIGd1aWQ6 IDI5MTg2NzAxMjEwNTkwMDA2NDQKICAgICAgICBjcmVhdGVfdHhnOiA0CiAgICAgICAgY2hp bGRyZW5bMF06CiAgICAgICAgICAgIHR5cGU6ICdyYWlkeicKICAgICAgICAgICAgaWQ6IDAK ICAgICAgICAgICAgZ3VpZDogMTQxMjM0NDA5OTM1ODc5OTEwODgKICAgICAgICAgICAgbnBh cml0eTogMQogICAgICAgICAgICBtZXRhc2xhYl9hcnJheTogMzQKICAgICAgICAgICAgbWV0 YXNsYWJfc2hpZnQ6IDM2CiAgICAgICAgICAgIGFzaGlmdDogMTIKICAgICAgICAgICAgYXNp emU6IDg5OTUzMjE2NzU3NzYKICAgICAgICAgICAgaXNfbG9nOiAwCiAgICAgICAgICAgIGNy ZWF0ZV90eGc6IDQKICAgICAgICAgICAgY2hpbGRyZW5bMF06CiAgICAgICAgICAgICAgICB0 eXBlOiAnZGlzaycKICAgICAgICAgICAgICAgIGlkOiAwCiAgICAgICAgICAgICAgICBndWlk OiAxNzYyNDAyMDQ1MDgwNDc0MTQwMQogICAgICAgICAgICAgICAgcGF0aDogJy9kZXYvZ3B0 aWQvNmU1Y2VhMjctN2Y1Mi0xMWUzLTljZDgtZDQzZDdlZDViNTg3JwogICAgICAgICAgICAg ICAgd2hvbGVfZGlzazogMQogICAgICAgICAgICAgICAgRFRMOiAxMzcKICAgICAgICAgICAg ICAgIGNyZWF0ZV90eGc6IDQKICAgICAgICAgICAgY2hpbGRyZW5bMV06CiAgICAgICAgICAg ICAgICB0eXBlOiAnZGlzaycKICAgICAgICAgICAgICAgIGlkOiAxCiAgICAgICAgICAgICAg ICBndWlkOiAzMjUzMjk5MDY3NTM3Mjg3NDI4CiAgICAgICAgICAgICAgICBwYXRoOiAnL2Rl di9ncHRpZC8yYjcwZDljMC04ZTQwLTExZTMtYWExYy1kNDNkN2VkNWI1ODcnCiAgICAgICAg ICAgICAgICB3aG9sZV9kaXNrOiAxCiAgICAgICAgICAgICAgICBEVEw6IDEzMwogICAgICAg ICAgICAgICAgY3JlYXRlX3R4ZzogNAogICAgICAgICAgICBjaGlsZHJlblsyXToKICAgICAg ICAgICAgICAgIHR5cGU6ICdkaXNrJwogICAgICAgICAgICAgICAgaWQ6IDIKICAgICAgICAg ICAgICAgIGd1aWQ6IDE3OTk5NTI0NDE4MDE1OTYzMjU4CiAgICAgICAgICAgICAgICBwYXRo OiAnL2Rldi9ncHRpZC8xZTg5ODc1OC05NDg4LTExZTMtYTg2ZS1kNDNkN2VkNWI1ODcnCiAg ICAgICAgICAgICAgICB3aG9sZV9kaXNrOiAxCiAgICAgICAgICAgICAgICBEVEw6IDEzNAog ICAgICAgICAgICAgICAgY3JlYXRlX3R4ZzogNAogICAgZmVhdHVyZXNfZm9yX3JlYWQ6CiAg ICAjIyMjIyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwoKW3Jv b3RAanVpY3ldIH4jICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAKIyMjIyMjIyMjIyMjIy8v LS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwoqKiogRklOQUwgU3lzdGVtIHNo dXRkb3duIG1lc3NhZ2UgZnJvbSByb290QGp1aWN5LnpoZWxhbmEubG9jYWwgKioqICAgICAg ICAgIAoKU3lzdGVtIGdvaW5nIGRvd24gSU1NRURJQVRFTFkgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIAoKICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgIApwYWNrZXRfd3JpdGVfd2FpdDogQ29ubmVjdGlvbiB0byAxNzIuMjAuNC41OiBCcm9r ZW4gcGlwZQpldmdlbkBRV0VCb29rOn4kIHNzaCByb290QGp1aWN5CnJvb3RAanVpY3kncyBw YXNzd29yZDogCkZyZWVCU0QgOS4yLVJFTEVBU0UgKEZSRUVOQVMuYW1kNjQpICMwIHIrMjMx NWVhMzogRnJpIERlYyAyMCAxMjo0ODo1MCBQU1QgMjAxMwoKCUZyZWVOQVMgKGMpIDIwMDkt MjAxMywgVGhlIEZyZWVOQVMgRGV2ZWxvcG1lbnQgVGVhbQoJQWxsIHJpZ2h0cyByZXNlcnZl ZC4KCUZyZWVOQVMgaXMgcmVsZWFzZWQgdW5kZXIgdGhlIG1vZGlmaWVkIEJTRCBsaWNlbnNl LgoKCUZvciBtb3JlIGluZm9ybWF0aW9uLCBkb2N1bWVudGF0aW9uLCBoZWxwIG9yIHN1cHBv cnQsIGdvIGhlcmU6CiAJaHR0cDovL2ZyZWVuYXMub3JnCldlbGNvbWUgdG8gRnJlZU5BUwog ICAgICAgICAgICAuCiAgICAgICAgICAgICB8fgogICAgICAgICAgICAvfFwKICAgICAgICAg ICB8LS4tfAogICAgICAgICAgICctOi0nCiAgICAgICAgICAgIFt8XQogICAgICAgICAgICBb fF0KICAgICAgICAgICAgW3xdCiAgICAgICAgICAgIFt8XQogICAgICAgICAgICBbfF0KICAg ICAgICAgICAuW3xdLgogICAgICAgICAgIDovfFw6CiAgICAgICAgICAgWy98XF0KICAgICAg ICAgICBbL3xcXQogICAgICAgICAuOl8jfCNfOi4KICAgICAgICAgfF8gJy0nIF98CiAgICAg ICAgIC9cOi0uLTovXAogICAgICAgIC9cfF9bfF1ffC9cCiAgICAgIF8vXHx+IFt8XSB+fC9c XwogICAgICBbJyc9LS5bfF0uLT0nJ10KICAgICAgOi0uXyAgIHwgICBfLi06CiAgICAgIC8v XDs6Oi06LTo6Oy9cXAogICAgIC9cLictXFwvfFwvLy0nLi9cCiAgIC4nXC8nICAgOlx8Lzog ICAnXC8nLgogLi8vXCgnICAgIFtcfC9dICAgICcpL1xcLgonJzpdW1wuJyAgLltcfC9dLiAg Jy4vXVs6JycKICAgICcnICAgIDovXHwvXDogICAgJycKICAgICAgICAgLltcL3xcL10uCiAg ICAgICAgICAgJy58LicKICAgICAgICAgICAgICcKCiMjIyMjIyMjIyMjIyMvLy0tRU5EIE9G IFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0gfiMgenBvb2wgaGlzdG9y eQojIyMjIyMjIyMjIyMjLy8tLVNUQVJUIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCm5v IHBvb2xzIGF2YWlsYWJsZQojIyMjIyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQtLS8vIyMj IyMjIyMjIyMjIwoKW3Jvb3RAanVpY3ldIH4jIHpkYgojIyMjIyMjIyMjIyMjLy8tLVNUQVJU IE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCnpoX3ZvbDoKICAgIHZlcnNpb246IDUwMDAK ICAgIG5hbWU6ICd6aF92b2wnCiAgICBzdGF0ZTogMAogICAgdHhnOiAxNDEwNjQ0NwogICAg cG9vbF9ndWlkOiAyOTE4NjcwMTIxMDU5MDAwNjQ0CiAgICBob3N0aWQ6IDE4MDI5ODc3MTAK ICAgIGhvc3RuYW1lOiAnJwogICAgdmRldl9jaGlsZHJlbjogMQogICAgdmRldl90cmVlOgog ICAgICAgIHR5cGU6ICdyb290JwogICAgICAgIGlkOiAwCiAgICAgICAgZ3VpZDogMjkxODY3 MDEyMTA1OTAwMDY0NAogICAgICAgIGNyZWF0ZV90eGc6IDQKICAgICAgICBjaGlsZHJlblsw XToKICAgICAgICAgICAgdHlwZTogJ3JhaWR6JwogICAgICAgICAgICBpZDogMAogICAgICAg ICAgICBndWlkOiAxNDEyMzQ0MDk5MzU4Nzk5MTA4OAogICAgICAgICAgICBucGFyaXR5OiAx CiAgICAgICAgICAgIG1ldGFzbGFiX2FycmF5OiAzNAogICAgICAgICAgICBtZXRhc2xhYl9z aGlmdDogMzYKICAgICAgICAgICAgYXNoaWZ0OiAxMgogICAgICAgICAgICBhc2l6ZTogODk5 NTMyMTY3NTc3NgogICAgICAgICAgICBpc19sb2c6IDAKICAgICAgICAgICAgY3JlYXRlX3R4 ZzogNAogICAgICAgICAgICBjaGlsZHJlblswXToKICAgICAgICAgICAgICAgIHR5cGU6ICdk aXNrJwogICAgICAgICAgICAgICAgaWQ6IDAKICAgICAgICAgICAgICAgIGd1aWQ6IDE3NjI0 MDIwNDUwODA0NzQxNDAxCiAgICAgICAgICAgICAgICBwYXRoOiAnL2Rldi9ncHRpZC82ZTVj ZWEyNy03ZjUyLTExZTMtOWNkOC1kNDNkN2VkNWI1ODcnCiAgICAgICAgICAgICAgICB3aG9s ZV9kaXNrOiAxCiAgICAgICAgICAgICAgICBEVEw6IDEzNwogICAgICAgICAgICAgICAgY3Jl YXRlX3R4ZzogNAogICAgICAgICAgICBjaGlsZHJlblsxXToKICAgICAgICAgICAgICAgIHR5 cGU6ICdkaXNrJwogICAgICAgICAgICAgICAgaWQ6IDEKICAgICAgICAgICAgICAgIGd1aWQ6 IDMyNTMyOTkwNjc1MzcyODc0MjgKICAgICAgICAgICAgICAgIHBhdGg6ICcvZGV2L2dwdGlk LzJiNzBkOWMwLThlNDAtMTFlMy1hYTFjLWQ0M2Q3ZWQ1YjU4NycKICAgICAgICAgICAgICAg IHdob2xlX2Rpc2s6IDEKICAgICAgICAgICAgICAgIERUTDogMTMzCiAgICAgICAgICAgICAg ICBjcmVhdGVfdHhnOiA0CiAgICAgICAgICAgIGNoaWxkcmVuWzJdOgogICAgICAgICAgICAg ICAgdHlwZTogJ2Rpc2snCiAgICAgICAgICAgICAgICBpZDogMgogICAgICAgICAgICAgICAg Z3VpZDogMTc5OTk1MjQ0MTgwMTU5NjMyNTgKICAgICAgICAgICAgICAgIHBhdGg6ICcvZGV2 L2dwdGlkLzFlODk4NzU4LTk0ODgtMTFlMy1hODZlLWQ0M2Q3ZWQ1YjU4NycKICAgICAgICAg ICAgICAgIHdob2xlX2Rpc2s6IDEKICAgICAgICAgICAgICAgIERUTDogMTM0CiAgICAgICAg ICAgICAgICBjcmVhdGVfdHhnOiA0CiAgICBmZWF0dXJlc19mb3JfcmVhZDoKICAgICMjIyMj IyMjIyMjIyMvLy0tRU5EIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCgpbcm9vdEBqdWlj eV0gfiMgbW91bnQgLXV3IC8KIyMjIyMjIyMjIyMjIy8vLS1TVEFSVCBPRiBTVERPVVQtLS8v IyMjIyMjIyMjIyMjIwojIyMjIyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQtLS8vIyMjIyMj IyMjIyMjIwoKW3Jvb3RAanVpY3ldIH4jIHpwb29sIGhpc3RvcnkKIyMjIyMjIyMjIyMjIy8v LS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwpubyBwb29scyBhdmFpbGFibGUK IyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290 QGp1aWN5XSB+IyB6cG9vbCBoaXN0b3J5IHpoX3ZvbAojIyMjIyMjIyMjIyMjLy8tLVNUQVJU IE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCmNhbm5vdCBvcGVuICd6aF92b2wnOiBubyBz dWNoIHBvb2wKIyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMj IyMKCgpbcm9vdEBqdWljeV0gfiMgenBvb2wgc3RhdHVzIHpoX3ZvbAojIyMjIyMjIyMjIyMj Ly8tLVNUQVJUIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCmNhbm5vdCBvcGVuICd6aF92 b2wnOiBubyBzdWNoIHBvb2wKIyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VULS0vLyMj IyMjIyMjIyMjIyMKCltyb290QGp1aWN5XSB+IyB6cG9vbCBzdGF0dXMgCiMjIyMjIyMjIyMj IyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKbm8gcG9vbHMgYXZhaWxh YmxlCiMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCgpb cm9vdEBqdWljeV0gfiMgemRiCiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0v LyMjIyMjIyMjIyMjIyMKemhfdm9sOgogICAgdmVyc2lvbjogNTAwMAogICAgbmFtZTogJ3po X3ZvbCcKICAgIHN0YXRlOiAwCiAgICB0eGc6IDE0MTA2NDQ3CiAgICBwb29sX2d1aWQ6IDI5 MTg2NzAxMjEwNTkwMDA2NDQKICAgIGhvc3RpZDogMTgwMjk4NzcxMAogICAgaG9zdG5hbWU6 ICcnCiAgICB2ZGV2X2NoaWxkcmVuOiAxCiAgICB2ZGV2X3RyZWU6CiAgICAgICAgdHlwZTog J3Jvb3QnCiAgICAgICAgaWQ6IDAKICAgICAgICBndWlkOiAyOTE4NjcwMTIxMDU5MDAwNjQ0 CiAgICAgICAgY3JlYXRlX3R4ZzogNAogICAgICAgIGNoaWxkcmVuWzBdOgogICAgICAgICAg ICB0eXBlOiAncmFpZHonCiAgICAgICAgICAgIGlkOiAwCiAgICAgICAgICAgIGd1aWQ6IDE0 MTIzNDQwOTkzNTg3OTkxMDg4CiAgICAgICAgICAgIG5wYXJpdHk6IDEKICAgICAgICAgICAg bWV0YXNsYWJfYXJyYXk6IDM0CiAgICAgICAgICAgIG1ldGFzbGFiX3NoaWZ0OiAzNgogICAg ICAgICAgICBhc2hpZnQ6IDEyCiAgICAgICAgICAgIGFzaXplOiA4OTk1MzIxNjc1Nzc2CiAg ICAgICAgICAgIGlzX2xvZzogMAogICAgICAgICAgICBjcmVhdGVfdHhnOiA0CiAgICAgICAg ICAgIGNoaWxkcmVuWzBdOgogICAgICAgICAgICAgICAgdHlwZTogJ2Rpc2snCiAgICAgICAg ICAgICAgICBpZDogMAogICAgICAgICAgICAgICAgZ3VpZDogMTc2MjQwMjA0NTA4MDQ3NDE0 MDEKICAgICAgICAgICAgICAgIHBhdGg6ICcvZGV2L2dwdGlkLzZlNWNlYTI3LTdmNTItMTFl My05Y2Q4LWQ0M2Q3ZWQ1YjU4NycKICAgICAgICAgICAgICAgIHdob2xlX2Rpc2s6IDEKICAg ICAgICAgICAgICAgIERUTDogMTM3CiAgICAgICAgICAgICAgICBjcmVhdGVfdHhnOiA0CiAg ICAgICAgICAgIGNoaWxkcmVuWzFdOgogICAgICAgICAgICAgICAgdHlwZTogJ2Rpc2snCiAg ICAgICAgICAgICAgICBpZDogMQogICAgICAgICAgICAgICAgZ3VpZDogMzI1MzI5OTA2NzUz NzI4NzQyOAogICAgICAgICAgICAgICAgcGF0aDogJy9kZXYvZ3B0aWQvMmI3MGQ5YzAtOGU0 MC0xMWUzLWFhMWMtZDQzZDdlZDViNTg3JwogICAgICAgICAgICAgICAgd2hvbGVfZGlzazog MQogICAgICAgICAgICAgICAgRFRMOiAxMzMKICAgICAgICAgICAgICAgIGNyZWF0ZV90eGc6 IDQKICAgICAgICAgICAgY2hpbGRyZW5bMl06CiAgICAgICAgICAgICAgICB0eXBlOiAnZGlz aycKICAgICAgICAgICAgICAgIGlkOiAyCiAgICAgICAgICAgICAgICBndWlkOiAxNzk5OTUy NDQxODAxNTk2MzI1OAogICAgICAgICAgICAgICAgcGF0aDogJy9kZXYvZ3B0aWQvMWU4OTg3 NTgtOTQ4OC0xMWUzLWE4NmUtZDQzZDdlZDViNTg3JwogICAgICAgICAgICAgICAgd2hvbGVf ZGlzazogMQogICAgICAgICAgICAgICAgRFRMOiAxMzQKICAgICAgICAgICAgICAgIGNyZWF0 ZV90eGc6IDQKICAgIGZlYXR1cmVzX2Zvcl9yZWFkOgogICAgIyMjIyMjIyMjIyMjIy8vLS1F TkQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290QGp1aWN5XSB+IyB6ZGIgLXUg emhfdm9sCiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMj IyMKemRiOiBjYW4ndCBvcGVuICd6aF92b2wnOiBObyBzdWNoIGZpbGUgb3IgZGlyZWN0b3J5 CiMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCgpbcm9v dEBqdWljeV0gfiMgemRiIC11IC1kIC9kZXYvCiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0Yg U1RET1VULS0vLyMjIyMjIyMjIyMjIyMKYWNwaSUgICAgICAgYWRhMCUgICAgICAgYXVkaXQl ICAgICAgZmlkbyUgICAgICAgbWRjdGwlICAgICAgc3Rkb3V0QCAgICAgdHR5dmMlCmFkMTBA ICAgICAgIGFkYTBzMSUgICAgIGJwZiUgICAgICAgIGdlb20uY3RsJSAgIG1lbSUgICAgICAg IHN5c21vdXNlJSAgIHR0eXZkJQphZDEwcDFAICAgICBhZGEwczFhJSAgICBicGYwQCAgICAg ICBnZ2N0bCUgICAgICBuZnNsb2NrJSAgICB0dHl1MCUgICAgICB0dHl2ZSUKYWQ0QCAgICAg ICAgYWRhMHMyJSAgICAgYnBzbTAlICAgICAgZ3B0LyAgICAgICAgbnRmcy8gICAgICAgdHR5 dTAuaW5pdCUgdHR5dmYlCmFkNHMxQCAgICAgIGFkYTBzMyUgICAgIGNhbS8gICAgICAgIGdw dGlkLyAgICAgIG51bGwlICAgICAgIHR0eXUwLmxvY2slIHVmcy8KYWQ0czFhQCAgICAgYWRh MHM0JSAgICAgY29uc29sZSUgICAgaW8lICAgICAgICAgcGFzczAlICAgICAgdHR5djAlICAg ICAgdWZzc3VzcGVuZCUKYWQ0czJAICAgICAgYWRhMSUgICAgICAgY29uc29sZWN0bCUgaXNj c2klICAgICAgcGFzczElICAgICAgdHR5djElICAgICAgdXJhbmRvbUAKYWQ0czNAICAgICAg YWRhMXAxJSAgICAgY3J5cHRvJSAgICAga2JkMEAgICAgICAgcGFzczIlICAgICAgdHR5djIl ICAgICAgdXNiY3RsJQphZDRzNEAgICAgICBhZGExcDEuZWxpJSBjdHR5JSAgICAgICBrYmQx QCAgICAgICBwYXNzMyUgICAgICB0dHl2MyUgICAgICB4cHQwJQphZDZAICAgICAgICBhZGEx cDIlICAgICBjdWF1MCUgICAgICBrYmRtdXgwJSAgICBwY2klICAgICAgICB0dHl2NCUgICAg ICB6ZXJvJQphZDZwMS5lbGlAICBhZGEyJSAgICAgICBjdWF1MC5pbml0JSBrbG9nJSAgICAg ICBwc20wJSAgICAgICB0dHl2NSUgICAgICB6ZnMlCmFkNnAxQCAgICAgIGFkYTJwMSUgICAg IGN1YXUwLmxvY2slIGttZW0lICAgICAgIHB0bXglICAgICAgIHR0eXY2JSAgICAgIAphZDZw MkAgICAgICBhZGEycDEuZWxpJSBkZXZjdGwlICAgICBsZWQvICAgICAgICBwdHMvICAgICAg ICB0dHl2NyUgICAgICAKYWQ4QCAgICAgICAgYWRhMnAyJSAgICAgZGV2c3RhdCUgICAgbG9n QCAgICAgICAgcmFuZG9tJSAgICAgdHR5djglICAgICAgCmFkOHAxLmVsaUAgIGFkYTMlICAg ICAgIGR0cmFjZS8gICAgIG1kMCUgICAgICAgIHNucCUgICAgICAgIHR0eXY5JSAgICAgIAph ZDhwMUAgICAgICBhZGEzcDElICAgICBkdW1wZGV2QCAgICBtZDElICAgICAgICBzdGRlcnJA ICAgICB0dHl2YSUgICAgICAKYWQ4cDJAICAgICAgYXRrYmQwJSAgICAgZmQvICAgICAgICAg bWQyJSAgICAgICAgc3RkaW5AICAgICAgdHR5dmIlICAgICAgCiMjIyMjIyMjIyMjIyMvLy0t RU5EIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0gfiMgemRiIC11 IC1kIC9kZXYvdWZzCiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMj IyMjIyMjIyMKdWZzLyAgICAgICAgdWZzc3VzcGVuZCUgCiMjIyMjIyMjIyMjIyMvLy0tRU5E IE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0gfiMgemRiIC11IC1k IC9kZXYvdWZzCiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMjIyMj IyMjIyMKemRiOiBjYW4ndCBvcGVuICcvZGV2L3Vmcyc6IE5vIHN1Y2ggZmlsZSBvciBkaXJl Y3RvcnkKIyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMK Cltyb290QGp1aWN5XSB+IyB6ZGIgLXUgLWQgL2Rldi91ZnMvRnJlZU5BU3MKIyMjIyMjIyMj IyMjIy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwpGcmVlTkFTczFhJSBG cmVlTkFTczMlICBGcmVlTkFTczQlICAKIyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VU LS0vLyMjIyMjIyMjIyMjIyMKCltyb290QGp1aWN5XSB+IyB6ZGIgLXUgLWQgL2Rldi91ZnMv RnJlZU5BU3MKIyMjIyMjIyMjIyMjIy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMj IyMjIwp6ZGI6IGNhbid0IG9wZW4gJy9kZXYvdWZzL0ZyZWVOQVNzJzogTm8gc3VjaCBmaWxl IG9yIGRpcmVjdG9yeQojIyMjIyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQtLS8vIyMjIyMj IyMjIyMjIwoKW3Jvb3RAanVpY3ldIH4jIHpkYiAtdSAtZCAvZGV2L3Vmcy9GcmVlTkFTcwoj IyMjIyMjIyMjIyMjLy8tLVNUQVJUIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCkZyZWVO QVNzMWElIEZyZWVOQVNzMyUgIEZyZWVOQVNzNCUgIAojIyMjIyMjIyMjIyMjLy8tLUVORCBP RiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwoKW3Jvb3RAanVpY3ldIH4jIHpkYiAKIyMjIyMj IyMjIyMjIy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwp6aF92b2w6CiAg ICB2ZXJzaW9uOiA1MDAwCiAgICBuYW1lOiAnemhfdm9sJwogICAgc3RhdGU6IDAKICAgIHR4 ZzogMTQxMDY0NDcKICAgIHBvb2xfZ3VpZDogMjkxODY3MDEyMTA1OTAwMDY0NAogICAgaG9z dGlkOiAxODAyOTg3NzEwCiAgICBob3N0bmFtZTogJycKICAgIHZkZXZfY2hpbGRyZW46IDEK ICAgIHZkZXZfdHJlZToKICAgICAgICB0eXBlOiAncm9vdCcKICAgICAgICBpZDogMAogICAg ICAgIGd1aWQ6IDI5MTg2NzAxMjEwNTkwMDA2NDQKICAgICAgICBjcmVhdGVfdHhnOiA0CiAg ICAgICAgY2hpbGRyZW5bMF06CiAgICAgICAgICAgIHR5cGU6ICdyYWlkeicKICAgICAgICAg ICAgaWQ6IDAKICAgICAgICAgICAgZ3VpZDogMTQxMjM0NDA5OTM1ODc5OTEwODgKICAgICAg ICAgICAgbnBhcml0eTogMQogICAgICAgICAgICBtZXRhc2xhYl9hcnJheTogMzQKICAgICAg ICAgICAgbWV0YXNsYWJfc2hpZnQ6IDM2CiAgICAgICAgICAgIGFzaGlmdDogMTIKICAgICAg ICAgICAgYXNpemU6IDg5OTUzMjE2NzU3NzYKICAgICAgICAgICAgaXNfbG9nOiAwCiAgICAg ICAgICAgIGNyZWF0ZV90eGc6IDQKICAgICAgICAgICAgY2hpbGRyZW5bMF06CiAgICAgICAg ICAgICAgICB0eXBlOiAnZGlzaycKICAgICAgICAgICAgICAgIGlkOiAwCiAgICAgICAgICAg ICAgICBndWlkOiAxNzYyNDAyMDQ1MDgwNDc0MTQwMQogICAgICAgICAgICAgICAgcGF0aDog Jy9kZXYvZ3B0aWQvNmU1Y2VhMjctN2Y1Mi0xMWUzLTljZDgtZDQzZDdlZDViNTg3JwogICAg ICAgICAgICAgICAgd2hvbGVfZGlzazogMQogICAgICAgICAgICAgICAgRFRMOiAxMzcKICAg ICAgICAgICAgICAgIGNyZWF0ZV90eGc6IDQKICAgICAgICAgICAgY2hpbGRyZW5bMV06CiAg ICAgICAgICAgICAgICB0eXBlOiAnZGlzaycKICAgICAgICAgICAgICAgIGlkOiAxCiAgICAg ICAgICAgICAgICBndWlkOiAzMjUzMjk5MDY3NTM3Mjg3NDI4CiAgICAgICAgICAgICAgICBw YXRoOiAnL2Rldi9ncHRpZC8yYjcwZDljMC04ZTQwLTExZTMtYWExYy1kNDNkN2VkNWI1ODcn CiAgICAgICAgICAgICAgICB3aG9sZV9kaXNrOiAxCiAgICAgICAgICAgICAgICBEVEw6IDEz MwogICAgICAgICAgICAgICAgY3JlYXRlX3R4ZzogNAogICAgICAgICAgICBjaGlsZHJlblsy XToKICAgICAgICAgICAgICAgIHR5cGU6ICdkaXNrJwogICAgICAgICAgICAgICAgaWQ6IDIK ICAgICAgICAgICAgICAgIGd1aWQ6IDE3OTk5NTI0NDE4MDE1OTYzMjU4CiAgICAgICAgICAg ICAgICBwYXRoOiAnL2Rldi9ncHRpZC8xZTg5ODc1OC05NDg4LTExZTMtYTg2ZS1kNDNkN2Vk NWI1ODcnCiAgICAgICAgICAgICAgICB3aG9sZV9kaXNrOiAxCiAgICAgICAgICAgICAgICBE VEw6IDEzNAogICAgICAgICAgICAgICAgY3JlYXRlX3R4ZzogNAogICAgZmVhdHVyZXNfZm9y X3JlYWQ6CiAgICAjIyMjIyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQtLS8vIyMjIyMjIyMj IyMjIwoKW3Jvb3RAanVpY3ldIH4jIHpkYiB6aF92b2wKIyMjIyMjIyMjIyMjIy8vLS1TVEFS VCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwp6ZGI6IGNhbid0IG9wZW4gJ3poX3ZvbCc6 IE5vIHN1Y2ggZmlsZSBvciBkaXJlY3RvcnkKIyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RE T1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290QGp1aWN5XSB+IyB6ZGIgJ3poX3ZvbCcKIyMj IyMjIyMjIyMjIy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwp6ZGI6IGNh bid0IG9wZW4gJ3poX3ZvbCc6IE5vIHN1Y2ggZmlsZSBvciBkaXJlY3RvcnkKIyMjIyMjIyMj IyMjIy8vLS1FTkQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290QGp1aWN5XSB+ IyB6cG9vbCBpbXBvcnQKIyMjIyMjIyMjIyMjIy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMj IyMjIyMjIyMjIwogICBwb29sOiB6aF92b2wKICAgICBpZDogMjkxODY3MDEyMTA1OTAwMDY0 NAogIHN0YXRlOiBVTkFWQUlMCiBzdGF0dXM6IE9uZSBvciBtb3JlIGRldmljZXMgYXJlIG1p c3NpbmcgZnJvbSB0aGUgc3lzdGVtLgogYWN0aW9uOiBUaGUgcG9vbCBjYW5ub3QgYmUgaW1w b3J0ZWQuIEF0dGFjaCB0aGUgbWlzc2luZwoJZGV2aWNlcyBhbmQgdHJ5IGFnYWluLgogICBz ZWU6IGh0dHA6Ly9pbGx1bW9zLm9yZy9tc2cvWkZTLTgwMDAtM0MKIGNvbmZpZzoKCgl6aF92 b2wgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBVTkFWQUlMICBp bnN1ZmZpY2llbnQgcmVwbGljYXMKCSAgcmFpZHoxLTAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgIFVOQVZBSUwgIGluc3VmZmljaWVudCByZXBsaWNhcwoJICAgIDE3 NjI0MDIwNDUwODA0NzQxNDAxICAgICAgICAgICAgICAgICAgICAgICAgVU5BVkFJTCAgY2Fu bm90IG9wZW4KCSAgICAzMjUzMjk5MDY3NTM3Mjg3NDI4ICAgICAgICAgICAgICAgICAgICAg ICAgIFVOQVZBSUwgIGNhbm5vdCBvcGVuCgkgICAgZ3B0aWQvNWRhY2Q3MzctMThhYy0xMWU2 LTljMjUtMDAxYjc4NTliOTNlICBPTkxJTkUKCSAgICAjIyMjIyMjIyMjIyMjLy8tLUVORCBP RiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwoKW3Jvb3RAanVpY3ldIH4jIHpwb29sIC1mIGlt cG9ydAojIyMjIyMjIyMjIyMjLy8tLVNUQVJUIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMj CnVucmVjb2duaXplZCBjb21tYW5kICctZicKdXNhZ2U6IHpwb29sIGNvbW1hbmQgYXJncyAu Li4KCltyb290QGp1aWN5XSB+IyB6cG9vbCBpbXBvcnQgLWYgemhfdm9sCiMjIyMjIyMjIyMj IyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKY2Fubm90IGltcG9ydCAn emhfdm9sJzogbm8gc3VjaCBwb29sIG9yIGRhdGFzZXQKCURlc3Ryb3kgYW5kIHJlLWNyZWF0 ZSB0aGUgcG9vbCBmcm9tCglhIGJhY2t1cCBzb3VyY2UuCgkjIyMjIyMjIyMjIyMjLy8tLUVO RCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwoKW3Jvb3RAanVpY3ldIH4jIHpwb29sIGlt cG9ydAojIyMjIyMjIyMjIyMjLy8tLVNUQVJUIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMj CiAgIHBvb2w6IHpoX3ZvbAogICAgIGlkOiAyOTE4NjcwMTIxMDU5MDAwNjQ0CiAgc3RhdGU6 IFVOQVZBSUwKIHN0YXR1czogT25lIG9yIG1vcmUgZGV2aWNlcyBhcmUgbWlzc2luZyBmcm9t IHRoZSBzeXN0ZW0uCiBhY3Rpb246IFRoZSBwb29sIGNhbm5vdCBiZSBpbXBvcnRlZC4gQXR0 YWNoIHRoZSBtaXNzaW5nCglkZXZpY2VzIGFuZCB0cnkgYWdhaW4uCiAgIHNlZTogaHR0cDov L2lsbHVtb3Mub3JnL21zZy9aRlMtODAwMC0zQwogY29uZmlnOgoKCXpoX3ZvbCAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIFVOQVZBSUwgIGluc3VmZmljaWVu dCByZXBsaWNhcwoJICByYWlkejEtMCAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgVU5BVkFJTCAgaW5zdWZmaWNpZW50IHJlcGxpY2FzCgkgICAgMTc2MjQwMjA0NTA4 MDQ3NDE0MDEgICAgICAgICAgICAgICAgICAgICAgICBVTkFWQUlMICBjYW5ub3Qgb3BlbgoJ ICAgIDMyNTMyOTkwNjc1MzcyODc0MjggICAgICAgICAgICAgICAgICAgICAgICAgVU5BVkFJ TCAgY2Fubm90IG9wZW4KCSAgICBncHRpZC81ZGFjZDczNy0xOGFjLTExZTYtOWMyNS0wMDFi Nzg1OWI5M2UgIE9OTElORQoJICAgICMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9VVC0t Ly8jIyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0gfiMgcHkKIyMjIyMjIyMjIyMjIy8vLS1T VEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwpweWRvYyAgICAgICAgICAgICAgICAg ICBweXRob24tc2hhcmVkICAgICAgICAgICBweXRob24tc2hhcmVkMi43LWNvbmZpZwpweWRv YzIgICAgICAgICAgICAgICAgICBweXRob24tc2hhcmVkLWNvbmZpZyAgICBweXRob24yCnB5 ZG9jMi43ICAgICAgICAgICAgICAgIHB5dGhvbi1zaGFyZWQyICAgICAgICAgIHB5dGhvbjIt Y29uZmlnCnB5dGhvbiAgICAgICAgICAgICAgICAgIHB5dGhvbi1zaGFyZWQyLWNvbmZpZyAg IHB5dGhvbjIuNwpweXRob24tY29uZmlnICAgICAgICAgICBweXRob24tc2hhcmVkMi43ICAg ICAgICBweXRob24yLjctY29uZmlnCiMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9VVC0t Ly8jIyMjIyMjIyMjIyMjCgoKW3Jvb3RAanVpY3ldIH4jIGNobW9kICt4IHpmc19yZXZlcnQu cHkKIyMjIyMjIyMjIyMjIy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwoj IyMjIyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwoKW3Jvb3RA anVpY3ldIH4jIGxsCiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMj IyMjIyMjIyMKdG90YWwgNDIKZHJ3eHIteHIteCAgIDMgcm9vdCAgd2hlZWwgICAgNTEyIE1h eSAxMyAxMzo0MiAuLwpkcnd4ci14ci14ICAyMCByb290ICB3aGVlbCAgICA1MTIgQXByIDE0 IDA4OjI0IC4uLwotcnctLS0tLS0tICAgMSByb290ICB3aGVlbCAgICA0MjcgU2VwIDI5ICAy MDE1IC5iYXNoX2hpc3RvcnkKLXJ3LXItLXItLSAgIDEgcm9vdCAgd2hlZWwgICAxMTI4IERl YyAgNyAgMjAxMyAuYmFzaHJjCi1ydy1yLS1yLS0gICAxIHJvb3QgIHdoZWVsICAgIDkxOSBE ZWMgIDcgIDIwMTMgLmNzaHJjCi1ydy0tLS0tLS0gICAxIHJvb3QgIHdoZWVsICAxNDM4MiBP Y3QgIDggIDIwMTUgLmhpc3RvcnkKLXJ3LXItLXItLSAgIDEgcm9vdCAgd2hlZWwgICAgIDgw IERlYyAyMCAgMjAxMyAuazVsb2dpbgotcnctci0tci0tICAgMSByb290ICB3aGVlbCAgICAy MjkgRGVjIDIwICAyMDEzIC5sb2dpbgotcnctci0tci0tICAgMSByb290ICB3aGVlbCAgICA0 ODkgRGVjICA3ICAyMDEzIC5wcm9maWxlCi1ydy1yLS1yLS0gICAxIHJvb3QgIHdoZWVsICAg MTEyOCBEZWMgIDcgIDIwMTMgLnNocmMKZHJ3eC0tLS0tLSAgIDIgcm9vdCAgd2hlZWwgICAg NTEyIE1hciAyNyAgMjAxNCAuc3NoLwotcnd4ci14ci14ICAgMSByb290ICB3aGVlbCAgIDE2 NzcgRGVjICA3ICAyMDEzIGNoYW5nZV9wYXNzd29yZCoKLXJ3eHIteHIteCAgIDEgcm9vdCAg d2hlZWwgICAxNjMwIERlYyAgNyAgMjAxMyBzYXZlX2NmZyoKLXJ3eHIteHIteCAgIDEgcm9v dCAgd2hlZWwgICAgOTAxIERlYyAgNyAgMjAxMyBzYXZlX3JyZHMuc2gqCi1yd3hyLXhyLXgg ICAxIHJvb3QgIHdoZWVsICAgMTU5MSBEZWMgIDcgIDIwMTMgc2F2ZV9zc2hrZXlzKgotcnd4 ci14ci14ICAgMSByb290ICB3aGVlbCAgIDE2MDcgRGVjICA3ICAyMDEzIHVwZGF0ZSoKLXJ3 eHIteHIteCAgIDEgcm9vdCAgd2hlZWwgICAyODIxIERlYyAgNyAgMjAxMyB1cGRhdGVwMSoK LXJ3eHIteHIteCAgIDEgcm9vdCAgd2hlZWwgICAzMDk3IERlYyAgNyAgMjAxMyB1cGRhdGVw MioKLXJ3eHIteHIteCAgIDEgcm9vdCAgd2hlZWwgICA0Mjk3IE1heSAxMyAxMzo0MiB6ZnNf cmV2ZXJ0LnB5KgojIyMjIyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQtLS8vIyMjIyMjIyMj IyMjIwoKW3Jvb3RAanVpY3ldIH4jIHpwb29sIGhpc3RvcnkgLWlsIHpoX3ZvbAojIyMjIyMj IyMjIyMjLy8tLVNUQVJUIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCmNhbm5vdCBvcGVu ICd6aF92b2wnOiBubyBzdWNoIHBvb2wKIyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VU LS0vLyMjIyMjIyMjIyMjIyMKCltyb290QGp1aWN5XSB+IyB6cG9vbCBoaXN0b3J5IC1pbCAK IyMjIyMjIyMjIyMjIy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwpubyBw b29scyBhdmFpbGFibGUKIyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VULS0vLyMjIyMj IyMjIyMjIyMKCltyb290QGp1aWN5XSB+IyBlY2hvIDAgPiAvc3lzL21vZHVsZS96ZnMvcGFy YW1ldGVycy9zcGFfbG9hZF92ZXJpZnlfbWV0YWRhdGEKIyMjIyMjIyMjIyMjIy8vLS1TVEFS VCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwovc3lzL21vZHVsZS96ZnMvcGFyYW1ldGVy cy9zcGFfbG9hZF92ZXJpZnlfbWV0YWRhdGE6IE5vIHN1Y2ggZmlsZSBvciBkaXJlY3Rvcnku CiMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCgpbcm9v dEBqdWljeV0gfiMgZWNobyAwID4gL3N5cy9tb2R1bGUvCiMjIyMjIyMjIyMjIyMvLy0tU1RB UlQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKL3N5cy9tb2R1bGUvIG5vdCBmb3VuZAoK IyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290 QGp1aWN5XSB+IyBlY2hvIDAgPiAvCiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VU LS0vLyMjIyMjIyMjIyMjIyMKQ09QWVJJR0hUKiAgIGJvb3QvICAgICAgICBkYXRhLyAgICAg ICAgZXRjLyAgICAgICAgIGxpYmV4ZWMvICAgICBwcm9jLyAgICAgICAgc2Jpbi8gICAgICAg IHVzci8KYmluLyAgICAgICAgIGNmZy8gICAgICAgICBkZXYvICAgICAgICAgaG9tZUAgICAg ICAgIG1lZGlhLyAgICAgICByZXNjdWUvICAgICAgc3lzQCAgICAgICAgIHZhci8KYm9vdC5j b25maWcgIGNvbmYvICAgICAgICBlbnRyb3B5ICAgICAgbGliLyAgICAgICAgIG1udC8gICAg ICAgICByb290LyAgICAgICAgdG1wQCAgICAgICAgIAojIyMjIyMjIyMjIyMjLy8tLUVORCBP RiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwoKW3Jvb3RAanVpY3ldIH4jIGVjaG8gMCA+IC8K IyMjIyMjIyMjIyMjIy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwpDT1BZ UklHSFQqICAgYm9vdC8gICAgICAgIGRhdGEvICAgICAgICBldGMvICAgICAgICAgbGliZXhl Yy8gICAgIHByb2MvICAgICAgICBzYmluLyAgICAgICAgdXNyLwpiaW4vICAgICAgICAgY2Zn LyAgICAgICAgIGRldi8gICAgICAgICBob21lQCAgICAgICAgbWVkaWEvICAgICAgIHJlc2N1 ZS8gICAgICBzeXNAICAgICAgICAgdmFyLwpib290LmNvbmZpZyAgY29uZi8gICAgICAgIGVu dHJvcHkgICAgICBsaWIvICAgICAgICAgbW50LyAgICAgICAgIHJvb3QvICAgICAgICB0bXBA ICAgICAgICAgCiMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMj IyMjCgpbcm9vdEBqdWljeV0gfiMgemRiIC11IFYxIHwgZ3JlcCB0eGcKIyMjIyMjIyMjIyMj Iy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwp6ZGI6IGNhbid0IG9wZW4g J1YxJzogTm8gc3VjaCBmaWxlIG9yIGRpcmVjdG9yeQojIyMjIyMjIyMjIyMjLy8tLUVORCBP RiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwoKW3Jvb3RAanVpY3ldIH4jIHpkYiAtZSB2MSB8 IGdyZXAgdHhnCiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMjIyMj IyMjIyMKemRiOiBjYW4ndCBvcGVuICd2MSc6IE5vIHN1Y2ggZmlsZSBvciBkaXJlY3RvcnkK IyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290 QGp1aWN5XSB+IyB6ZGIgLWUgemhfdm9sIHwgZ3JlcCB0eGcKIyMjIyMjIyMjIyMjIy8vLS1T VEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwp6ZGI6IGNhbid0IG9wZW4gJ3poX3Zv bCc6IEZpbGUgZXhpc3RzCiAgICAgICAgICAgICAgICBjcmVhdGVfdHhnOiA0CiAgICAgICAg ICAgICAgICAgICAgY3JlYXRlX3R4ZzogNAogICAgICAgICAgICAgICAgICAgIGNyZWF0ZV90 eGc6IDQKICAgICAgICAgICAgICAgICAgICBjcmVhdGVfdHhnOiA0CiAgICAgICAgICAgICAg ICAgICAgIyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMK Cltyb290QGp1aWN5XSB+IyB6ZGIgLXUgemhfdm9sIHwgZ3JlcCB0eGcKIyMjIyMjIyMjIyMj Iy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwp6ZGI6IGNhbid0IG9wZW4g J3poX3ZvbCc6IE5vIHN1Y2ggZmlsZSBvciBkaXJlY3RvcnkKIyMjIyMjIyMjIyMjIy8vLS1F TkQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290QGp1aWN5XSB+IyB6ZGIgLS1o ZWxwCiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMK Li4uLi4uCiMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMj Cgpbcm9vdEBqdWljeV0gfiMgemRiIC11IHpoX3ZvbCAKIyMjIyMjIyMjIyMjIy8vLS1TVEFS VCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwp6ZGI6IGNhbid0IG9wZW4gJ3poX3ZvbCc6 IE5vIHN1Y2ggZmlsZSBvciBkaXJlY3RvcnkKIyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RE T1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290QGp1aWN5XSB+IyB6ZGIgLWUgemhfdm9sCiMj IyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCkNvbmZp Z3VyYXRpb24gZm9yIGltcG9ydDoKICAgICAgICB2ZGV2X2NoaWxkcmVuOiAxCiAgICAgICAg dmVyc2lvbjogNTAwMAogICAgICAgIHBvb2xfZ3VpZDogMjkxODY3MDEyMTA1OTAwMDY0NAog ICAgICAgIG5hbWU6ICd6aF92b2wnCiAgICAgICAgc3RhdGU6IDAKICAgICAgICBob3N0aWQ6 IDE4MDI5ODc3MTAKICAgICAgICBob3N0bmFtZTogJ2p1aWN5LnpoZWxhbmEubG9jYWwnCiAg ICAgICAgdmRldl90cmVlOgogICAgICAgICAgICB0eXBlOiAncm9vdCcKICAgICAgICAgICAg aWQ6IDAKICAgICAgICAgICAgZ3VpZDogMjkxODY3MDEyMTA1OTAwMDY0NAogICAgICAgICAg ICBjaGlsZHJlblswXToKICAgICAgICAgICAgICAgIHR5cGU6ICdyYWlkeicKICAgICAgICAg ICAgICAgIGlkOiAwCiAgICAgICAgICAgICAgICBndWlkOiAxNDEyMzQ0MDk5MzU4Nzk5MTA4 OAogICAgICAgICAgICAgICAgbnBhcml0eTogMQogICAgICAgICAgICAgICAgbWV0YXNsYWJf YXJyYXk6IDM0CiAgICAgICAgICAgICAgICBtZXRhc2xhYl9zaGlmdDogMzYKICAgICAgICAg ICAgICAgIGFzaGlmdDogMTIKICAgICAgICAgICAgICAgIGFzaXplOiA4OTk1MzIxNjc1Nzc2 CiAgICAgICAgICAgICAgICBpc19sb2c6IDAKICAgICAgICAgICAgICAgIGNyZWF0ZV90eGc6 IDQKICAgICAgICAgICAgICAgIGNoaWxkcmVuWzBdOgogICAgICAgICAgICAgICAgICAgIHR5 cGU6ICdkaXNrJwogICAgICAgICAgICAgICAgICAgIGlkOiAwCiAgICAgICAgICAgICAgICAg ICAgZ3VpZDogMTc2MjQwMjA0NTA4MDQ3NDE0MDEKICAgICAgICAgICAgICAgICAgICBwYXRo OiAnL2Rldi9ncHRpZC82ZTVjZWEyNy03ZjUyLTExZTMtOWNkOC1kNDNkN2VkNWI1ODcnCiAg ICAgICAgICAgICAgICAgICAgd2hvbGVfZGlzazogMQogICAgICAgICAgICAgICAgICAgIERU TDogMTM3CiAgICAgICAgICAgICAgICAgICAgY3JlYXRlX3R4ZzogNAogICAgICAgICAgICAg ICAgY2hpbGRyZW5bMV06CiAgICAgICAgICAgICAgICAgICAgdHlwZTogJ2Rpc2snCiAgICAg ICAgICAgICAgICAgICAgaWQ6IDEKICAgICAgICAgICAgICAgICAgICBndWlkOiAzMjUzMjk5 MDY3NTM3Mjg3NDI4CiAgICAgICAgICAgICAgICAgICAgcGF0aDogJy9kZXYvZ3B0aWQvMmI3 MGQ5YzAtOGU0MC0xMWUzLWFhMWMtZDQzZDdlZDViNTg3JwogICAgICAgICAgICAgICAgICAg IHdob2xlX2Rpc2s6IDEKICAgICAgICAgICAgICAgICAgICBEVEw6IDEzMwogICAgICAgICAg ICAgICAgICAgIGNyZWF0ZV90eGc6IDQKICAgICAgICAgICAgICAgIGNoaWxkcmVuWzJdOgog ICAgICAgICAgICAgICAgICAgIHR5cGU6ICdkaXNrJwogICAgICAgICAgICAgICAgICAgIGlk OiAyCiAgICAgICAgICAgICAgICAgICAgZ3VpZDogMTc5OTk1MjQ0MTgwMTU5NjMyNTgKICAg ICAgICAgICAgICAgICAgICB3aG9sZV9kaXNrOiAxCiAgICAgICAgICAgICAgICAgICAgRFRM OiAxMzQKICAgICAgICAgICAgICAgICAgICBjcmVhdGVfdHhnOiA0CiAgICAgICAgICAgICAg ICAgICAgcGF0aDogJy9kZXYvZ3B0aWQvNWRhY2Q3MzctMThhYy0xMWU2LTljMjUtMDAxYjc4 NTliOTNlJwp6ZGI6IGNhbid0IG9wZW4gJ3poX3ZvbCc6IEZpbGUgZXhpc3RzCiMjIyMjIyMj IyMjIyMvLy0tRU5EIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0g fiMgemRiIC1lIC1iIHpoX3ZvbAojIyMjIyMjIyMjIyMjLy8tLVNUQVJUIE9GIFNURE9VVC0t Ly8jIyMjIyMjIyMjIyMjCnpkYjogY2FuJ3Qgb3BlbiAnemhfdm9sJzogRmlsZSBleGlzdHMK IyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290 QGp1aWN5XSB+IyB6ZGIgLWUgLWJiYiB6aF92b2wKIyMjIyMjIyMjIyMjIy8vLS1TVEFSVCBP RiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwp6ZGI6IGNhbid0IG9wZW4gJ3poX3ZvbCc6IEZp bGUgZXhpc3RzCiMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMj IyMjCgpbcm9vdEBqdWljeV0gfiMgemRiIC1lIC1iYmJiYmIgemhfdm9sCiMjIyMjIyMjIyMj IyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKemRiOiBjYW4ndCBvcGVu ICd6aF92b2wnOiBGaWxlIGV4aXN0cwojIyMjIyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQt LS8vIyMjIyMjIyMjIyMjIwoKW3Jvb3RAanVpY3ldIH4jIHpkYiAtZSAtZGRkZGQgemhfdm9s CiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKemRi OiBjYW4ndCBvcGVuICd6aF92b2wnOiBGaWxlIGV4aXN0cwojIyMjIyMjIyMjIyMjLy8tLUVO RCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwoKW3Jvb3RAanVpY3ldIH4jIHpkYiAtYyB6 aF92b2wKIyMjIyMjIyMjIyMjIy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMj Iwp6ZGI6IGNhbid0IG9wZW4gJ3poX3ZvbCc6IE5vIHN1Y2ggZmlsZSBvciBkaXJlY3RvcnkK IyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290 QGp1aWN5XSB+IyB6ZGIgLWUgemhfdm9sIC1jCiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0Yg U1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCkNvbmZpZ3VyYXRpb24gZm9yIGltcG9ydDoKICAg ICAgICB2ZGV2X2NoaWxkcmVuOiAxCiAgICAgICAgdmVyc2lvbjogNTAwMAogICAgICAgIHBv b2xfZ3VpZDogMjkxODY3MDEyMTA1OTAwMDY0NAogICAgICAgIG5hbWU6ICd6aF92b2wnCiAg ICAgICAgc3RhdGU6IDAKICAgICAgICBob3N0aWQ6IDE4MDI5ODc3MTAKICAgICAgICBob3N0 bmFtZTogJ2p1aWN5LnpoZWxhbmEubG9jYWwnCiAgICAgICAgdmRldl90cmVlOgogICAgICAg ICAgICB0eXBlOiAncm9vdCcKICAgICAgICAgICAgaWQ6IDAKICAgICAgICAgICAgZ3VpZDog MjkxODY3MDEyMTA1OTAwMDY0NAogICAgICAgICAgICBjaGlsZHJlblswXToKICAgICAgICAg ICAgICAgIHR5cGU6ICdyYWlkeicKICAgICAgICAgICAgICAgIGlkOiAwCiAgICAgICAgICAg ICAgICBndWlkOiAxNDEyMzQ0MDk5MzU4Nzk5MTA4OAogICAgICAgICAgICAgICAgbnBhcml0 eTogMQogICAgICAgICAgICAgICAgbWV0YXNsYWJfYXJyYXk6IDM0CiAgICAgICAgICAgICAg ICBtZXRhc2xhYl9zaGlmdDogMzYKICAgICAgICAgICAgICAgIGFzaGlmdDogMTIKICAgICAg ICAgICAgICAgIGFzaXplOiA4OTk1MzIxNjc1Nzc2CiAgICAgICAgICAgICAgICBpc19sb2c6 IDAKICAgICAgICAgICAgICAgIGNyZWF0ZV90eGc6IDQKICAgICAgICAgICAgICAgIGNoaWxk cmVuWzBdOgogICAgICAgICAgICAgICAgICAgIHR5cGU6ICdkaXNrJwogICAgICAgICAgICAg ICAgICAgIGlkOiAwCiAgICAgICAgICAgICAgICAgICAgZ3VpZDogMTc2MjQwMjA0NTA4MDQ3 NDE0MDEKICAgICAgICAgICAgICAgICAgICBwYXRoOiAnL2Rldi9ncHRpZC82ZTVjZWEyNy03 ZjUyLTExZTMtOWNkOC1kNDNkN2VkNWI1ODcnCiAgICAgICAgICAgICAgICAgICAgd2hvbGVf ZGlzazogMQogICAgICAgICAgICAgICAgICAgIERUTDogMTM3CiAgICAgICAgICAgICAgICAg ICAgY3JlYXRlX3R4ZzogNAogICAgICAgICAgICAgICAgY2hpbGRyZW5bMV06CiAgICAgICAg ICAgICAgICAgICAgdHlwZTogJ2Rpc2snCiAgICAgICAgICAgICAgICAgICAgaWQ6IDEKICAg ICAgICAgICAgICAgICAgICBndWlkOiAzMjUzMjk5MDY3NTM3Mjg3NDI4CiAgICAgICAgICAg ICAgICAgICAgcGF0aDogJy9kZXYvZ3B0aWQvMmI3MGQ5YzAtOGU0MC0xMWUzLWFhMWMtZDQz ZDdlZDViNTg3JwogICAgICAgICAgICAgICAgICAgIHdob2xlX2Rpc2s6IDEKICAgICAgICAg ICAgICAgICAgICBEVEw6IDEzMwogICAgICAgICAgICAgICAgICAgIGNyZWF0ZV90eGc6IDQK ICAgICAgICAgICAgICAgIGNoaWxkcmVuWzJdOgogICAgICAgICAgICAgICAgICAgIHR5cGU6 ICdkaXNrJwogICAgICAgICAgICAgICAgICAgIGlkOiAyCiAgICAgICAgICAgICAgICAgICAg Z3VpZDogMTc5OTk1MjQ0MTgwMTU5NjMyNTgKICAgICAgICAgICAgICAgICAgICB3aG9sZV9k aXNrOiAxCiAgICAgICAgICAgICAgICAgICAgRFRMOiAxMzQKICAgICAgICAgICAgICAgICAg ICBjcmVhdGVfdHhnOiA0CiAgICAgICAgICAgICAgICAgICAgcGF0aDogJy9kZXYvZ3B0aWQv NWRhY2Q3MzctMThhYy0xMWU2LTljMjUtMDAxYjc4NTliOTNlJwp6ZGI6IGNhbid0IG9wZW4g J3poX3ZvbCc6IEZpbGUgZXhpc3RzCiMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9VVC0t Ly8jIyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0gfiMgbHMgL2V0Yy96ZnMvCiMjIyMjIyMj IyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKY2FzZXMvICAgZXhw b3J0cyAgCiMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMj Cgpbcm9vdEBqdWljeV0gfiMgbHMgL2V0Yy96ZnMvCiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQg T0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKLi8gICAgICAgLi4vICAgICAgY2FzZXMvICAg ZXhwb3J0cwojIyMjIyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMj IwoKW3Jvb3RAanVpY3ldIH4jIGxzIC9ldGMvemZzL2Nhc2VzLwojIyMjIyMjIyMjIyMjLy8t LVNUQVJUIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCi4vICAuLi8KIyMjIyMjIyMjIyMj Iy8vLS1FTkQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290QGp1aWN5XSB+IyBs cyAvZXRjL3pmcy9leHBvcnRzIAojIyMjIyMjIyMjIyMjLy8tLVNUQVJUIE9GIFNURE9VVC0t Ly8jIyMjIyMjIyMjIyMjCi9ldGMvemZzL2V4cG9ydHMKIyMjIyMjIyMjIyMjIy8vLS1FTkQg T0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290QGp1aWN5XSB+IyBsZXMgL2V0Yy96 ZnMvZXhwb3J0cwojIyMjIyMjIyMjIyMjLy8tLVNUQVJUIE9GIFNURE9VVC0tLy8jIyMjIyMj IyMjIyMjCgpDT1JSRUNUPmxlc3MgL2V0Yy96ZnMvZXhwb3J0cyAoeXxufGV8YSk/IHllcwoj IyMjIyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwoKW3Jvb3RA anVpY3ldIH4jIG1jCiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMj IyMjIyMjIyMKCkNPUlJFQ1Q+bWNkICh5fG58ZXxhKT8gbm8KbWM6IENvbW1hbmQgbm90IGZv dW5kLgojIyMjIyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwoK W3Jvb3RAanVpY3ldIH4jIGxzIC92YXIvCiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RE T1VULS0vLyMjIyMjIyMjIyMjIyMKLi8gICAgICAgIGFjY291bnQvICBhdWRpdC8gICAgY2Fj aGUvICAgIGRiLyAgICAgICBnYW1lcy8gICAgbWFpbC8gICAgIG5hbWVkLyAgICBwcmVzZXJ2 ZS8gc3Bvb2wvCi4uLyAgICAgICBhZ2VudHgvICAgYXV0aHBmLyAgIGNyYXNoLyAgICBlbXB0 eS8gICAgaGVpbWRhbC8gIG1kX3NpemUgICBuZXRhdGFsay8gcnVuLyAgICAgIHRtcC8KLnNu YXAvICAgIGF0LyAgICAgICBiYWNrdXBzLyAgY3Jvbi8gICAgIGV0Yy8gICAgICBsb2cvICAg ICAgbXNncy8gICAgIHBiaS8gICAgICByd2hvLyAgICAgeXAvCiMjIyMjIyMjIyMjIyMvLy0t RU5EIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0gfiMgbHMgL3Zh ci9kYi8KIyMjIyMjIyMjIyMjIy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMj IwouLyAgICAgICAgICAgICAgICAgICAgIGZyZWVic2QtdXBkYXRlLyAgICAgICAgbnRwZC5k cmlmdCAgICAgICAgICAgICBzYW1iYS8KLi4vICAgICAgICAgICAgICAgICAgICBpcGYvICAg ICAgICAgICAgICAgICAgIG51dC8gICAgICAgICAgICAgICAgICAgc3RhdGQuc3RhdHVzCmNv bGxlY3RkLyAgICAgICAgICAgICAgbG9jYXRlLmRhdGFiYXNlICAgICAgICBwYmkvICAgICAg ICAgICAgICAgICAgIHpvbmVpbmZvCmRidXMvICAgICAgICAgICAgICAgICAgbW91bnRkdGFi ICAgICAgICAgICAgICBwa2cvCmVudHJvcHkvICAgICAgICAgICAgICAgbmZzLXN0YWJsZXJl c3RhcnQgICAgICBwb3J0cy8KZm9udGNvbmZpZy8gICAgICAgICAgICBuZnMtc3RhYmxlcmVz dGFydC5iYWsgIHBvcnRzbmFwLwojIyMjIyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQtLS8v IyMjIyMjIyMjIyMjIwoKCgpbcm9vdEBqdWljeV0gfiMgemRiIC1oIC1lIHpoX3ZvbAojIyMj IyMjIyMjIyMjLy8tLVNUQVJUIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCnpkYjogY2Fu J3Qgb3BlbiAnemhfdm9sJzogRmlsZSBleGlzdHMKIyMjIyMjIyMjIyMjIy8vLS1FTkQgT0Yg U1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290QGp1aWN5XSB+IyBwZgojIyMjIyMjIyMj IyMjLy8tLVNUQVJUIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCnBmYnRvcHMgcGZjdGwg ICBwZmxvZ2QgIHBmdHAgICAgCiMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9VVC0tLy8j IyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0gfiMgenBvb2wgaW1wb3J0IC1GIHpoX3ZvbAoj IyMjIyMjIyMjIyMjLy8tLVNUQVJUIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCmNhbm5v dCBpbXBvcnQgJ3poX3ZvbCc6IG5vIHN1Y2ggcG9vbCBvciBkYXRhc2V0CglEZXN0cm95IGFu ZCByZS1jcmVhdGUgdGhlIHBvb2wgZnJvbQoJYSBiYWNrdXAgc291cmNlLgoJIyMjIyMjIyMj IyMjIy8vLS1FTkQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290QGp1aWN5XSB+ IyB6cG9vbCBpbXBvcnQgLUYgemhfdm9sCiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RE T1VULS0vLyMjIyMjIyMjIyMjIyMKY2Fubm90IGltcG9ydCAnemhfdm9sJzogbm8gc3VjaCBw b29sIG9yIGRhdGFzZXQKCURlc3Ryb3kgYW5kIHJlLWNyZWF0ZSB0aGUgcG9vbCBmcm9tCglh IGJhY2t1cCBzb3VyY2UuCgkjIyMjIyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQtLS8vIyMj IyMjIyMjIyMjIwoKW3Jvb3RAanVpY3ldIH4jIHpkYiAtaCAtZSB6aF92b2wKIyMjIyMjIyMj IyMjIy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwp6ZGI6IGNhbid0IG9w ZW4gJ3poX3ZvbCc6IEZpbGUgZXhpc3RzCiMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9V VC0tLy8jIyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0gfiMgemRiIC1lIHpoX3ZvbAojIyMj IyMjIyMjIyMjLy8tLVNUQVJUIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCgpDb25maWd1 cmF0aW9uIGZvciBpbXBvcnQ6CiAgICAgICAgdmRldl9jaGlsZHJlbjogMQogICAgICAgIHZl cnNpb246IDUwMDAKICAgICAgICBwb29sX2d1aWQ6IDI5MTg2NzAxMjEwNTkwMDA2NDQKICAg ICAgICBuYW1lOiAnemhfdm9sJwogICAgICAgIHN0YXRlOiAwCiAgICAgICAgaG9zdGlkOiAx ODAyOTg3NzEwCiAgICAgICAgaG9zdG5hbWU6ICcnCiAgICAgICAgdmRldl90cmVlOgogICAg ICAgICAgICB0eXBlOiAncm9vdCcKICAgICAgICAgICAgaWQ6IDAKICAgICAgICAgICAgZ3Vp ZDogMjkxODY3MDEyMTA1OTAwMDY0NAogICAgICAgICAgICBjaGlsZHJlblswXToKICAgICAg ICAgICAgICAgIHR5cGU6ICdyYWlkeicKICAgICAgICAgICAgICAgIGlkOiAwCiAgICAgICAg ICAgICAgICBndWlkOiAxNDEyMzQ0MDk5MzU4Nzk5MTA4OAogICAgICAgICAgICAgICAgbnBh cml0eTogMQogICAgICAgICAgICAgICAgbWV0YXNsYWJfYXJyYXk6IDM0CiAgICAgICAgICAg ICAgICBtZXRhc2xhYl9zaGlmdDogMzYKICAgICAgICAgICAgICAgIGFzaGlmdDogMTIKICAg ICAgICAgICAgICAgIGFzaXplOiA4OTk1MzIxNjc1Nzc2CiAgICAgICAgICAgICAgICBpc19s b2c6IDAKICAgICAgICAgICAgICAgIGNyZWF0ZV90eGc6IDQKICAgICAgICAgICAgICAgIGNo aWxkcmVuWzBdOgogICAgICAgICAgICAgICAgICAgIHR5cGU6ICdkaXNrJwogICAgICAgICAg ICAgICAgICAgIGlkOiAwCiAgICAgICAgICAgICAgICAgICAgZ3VpZDogMTc2MjQwMjA0NTA4 MDQ3NDE0MDEKICAgICAgICAgICAgICAgICAgICBwYXRoOiAnL2Rldi9ncHRpZC82ZTVjZWEy Ny03ZjUyLTExZTMtOWNkOC1kNDNkN2VkNWI1ODcnCiAgICAgICAgICAgICAgICAgICAgd2hv bGVfZGlzazogMQogICAgICAgICAgICAgICAgICAgIERUTDogMTM3CiAgICAgICAgICAgICAg ICAgICAgY3JlYXRlX3R4ZzogNAogICAgICAgICAgICAgICAgY2hpbGRyZW5bMV06CiAgICAg ICAgICAgICAgICAgICAgdHlwZTogJ2Rpc2snCiAgICAgICAgICAgICAgICAgICAgaWQ6IDEK ICAgICAgICAgICAgICAgICAgICBndWlkOiAzMjUzMjk5MDY3NTM3Mjg3NDI4CiAgICAgICAg ICAgICAgICAgICAgd2hvbGVfZGlzazogMQogICAgICAgICAgICAgICAgICAgIERUTDogMTMz CiAgICAgICAgICAgICAgICAgICAgY3JlYXRlX3R4ZzogNAogICAgICAgICAgICAgICAgICAg IHBhdGg6ICcvZGV2L2dwdGlkLzJiNzBkOWMwLThlNDAtMTFlMy1hYTFjLWQ0M2Q3ZWQ1YjU4 NycKICAgICAgICAgICAgICAgIGNoaWxkcmVuWzJdOgogICAgICAgICAgICAgICAgICAgIHR5 cGU6ICdkaXNrJwogICAgICAgICAgICAgICAgICAgIGlkOiAyCiAgICAgICAgICAgICAgICAg ICAgZ3VpZDogMTc5OTk1MjQ0MTgwMTU5NjMyNTgKICAgICAgICAgICAgICAgICAgICBwYXRo OiAnL2Rldi9ncHRpZC8xZTg5ODc1OC05NDg4LTExZTMtYTg2ZS1kNDNkN2VkNWI1ODcnCiAg ICAgICAgICAgICAgICAgICAgd2hvbGVfZGlzazogMQogICAgICAgICAgICAgICAgICAgIERU TDogMTM0CiAgICAgICAgICAgICAgICAgICAgY3JlYXRlX3R4ZzogNAp6ZGI6IGNhbid0IG9w ZW4gJ3poX3ZvbCc6IEZpbGUgZXhpc3RzCiMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9V VC0tLy8jIyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0gfiMgY2FtY29udHJvbCBkZXZsaXN0 CiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKPFBh dHJpb3QgUHlybyBTRSAzMzJBQkJGMD4gICAgICAgICBhdCBzY2J1czAgdGFyZ2V0IDAgbHVu IDAgKGFkYTAscGFzczApCjxTVDMwMDBETTAwMS0xQ0gxNjYgQ0MyOT4gICAgICAgICAgYXQg c2NidXMxIHRhcmdldCAwIGx1biAwIChwYXNzMSxhZGExKQo8U1QzMDAwRE0wMDEtMUNIMTY2 IENDMjk+ICAgICAgICAgIGF0IHNjYnVzMiB0YXJnZXQgMCBsdW4gMCAoYWRhMixwYXNzMikK PFNUMzAwMERNMDAxLTlZTjE2NiBDQzRIPiAgICAgICAgICBhdCBzY2J1czMgdGFyZ2V0IDAg bHVuIDAgKHBhc3MzLGFkYTMpCiMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9VVC0tLy8j IyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0gfiMgY2FtY29udHJvbCBkZXZsaXN0CiMjIyMj IyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKPFBhdHJpb3Qg UHlybyBTRSAzMzJBQkJGMD4gICAgICAgICBhdCBzY2J1czAgdGFyZ2V0IDAgbHVuIDAgKGFk YTAscGFzczApCjxTVDMwMDBETTAwMS0xQ0gxNjYgQ0MyOT4gICAgICAgICAgYXQgc2NidXMx IHRhcmdldCAwIGx1biAwIChwYXNzMSxhZGExKQo8U1QzMDAwRE0wMDEtMUNIMTY2IENDMjk+ ICAgICAgICAgIGF0IHNjYnVzMiB0YXJnZXQgMCBsdW4gMCAoYWRhMixwYXNzMikKPFNUMzAw MERNMDAxLTlZTjE2NiBDQzRIPiAgICAgICAgICBhdCBzY2J1czMgdGFyZ2V0IDAgbHVuIDAg KHBhc3MzLGFkYTMpCiMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9VVC0tLy8jIyMjIyMj IyMjIyMjCgpbcm9vdEBqdWljeV0gfiMgenBvb2wgbGlzdAojIyMjIyMjIyMjIyMjLy8tLVNU QVJUIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCm5vIHBvb2xzIGF2YWlsYWJsZQojIyMj IyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwoKW3Jvb3RAanVp Y3ldIH4jIHpwb29sIGltcG9ydCAtRiB6aF92b2wKIyMjIyMjIyMjIyMjIy8vLS1TVEFSVCBP RiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwpjYW5ub3QgaW1wb3J0ICd6aF92b2wnOiBubyBz dWNoIHBvb2wgb3IgZGF0YXNldAoJRGVzdHJveSBhbmQgcmUtY3JlYXRlIHRoZSBwb29sIGZy b20KCWEgYmFja3VwIHNvdXJjZS4KCSMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9VVC0t Ly8jIyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0gfiMgemRiIC1lIHpoX3ZvbAojIyMjIyMj IyMjIyMjLy8tLVNUQVJUIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCgpDb25maWd1cmF0 aW9uIGZvciBpbXBvcnQ6CiAgICAgICAgdmRldl9jaGlsZHJlbjogMQogICAgICAgIHZlcnNp b246IDUwMDAKICAgICAgICBwb29sX2d1aWQ6IDI5MTg2NzAxMjEwNTkwMDA2NDQKICAgICAg ICBuYW1lOiAnemhfdm9sJwogICAgICAgIHN0YXRlOiAwCiAgICAgICAgaG9zdGlkOiAxODAy OTg3NzEwCiAgICAgICAgaG9zdG5hbWU6ICcnCiAgICAgICAgdmRldl90cmVlOgogICAgICAg ICAgICB0eXBlOiAncm9vdCcKICAgICAgICAgICAgaWQ6IDAKICAgICAgICAgICAgZ3VpZDog MjkxODY3MDEyMTA1OTAwMDY0NAogICAgICAgICAgICBjaGlsZHJlblswXToKICAgICAgICAg ICAgICAgIHR5cGU6ICdyYWlkeicKICAgICAgICAgICAgICAgIGlkOiAwCiAgICAgICAgICAg ICAgICBndWlkOiAxNDEyMzQ0MDk5MzU4Nzk5MTA4OAogICAgICAgICAgICAgICAgbnBhcml0 eTogMQogICAgICAgICAgICAgICAgbWV0YXNsYWJfYXJyYXk6IDM0CiAgICAgICAgICAgICAg ICBtZXRhc2xhYl9zaGlmdDogMzYKICAgICAgICAgICAgICAgIGFzaGlmdDogMTIKICAgICAg ICAgICAgICAgIGFzaXplOiA4OTk1MzIxNjc1Nzc2CiAgICAgICAgICAgICAgICBpc19sb2c6 IDAKICAgICAgICAgICAgICAgIGNyZWF0ZV90eGc6IDQKICAgICAgICAgICAgICAgIGNoaWxk cmVuWzBdOgogICAgICAgICAgICAgICAgICAgIHR5cGU6ICdkaXNrJwogICAgICAgICAgICAg ICAgICAgIGlkOiAwCiAgICAgICAgICAgICAgICAgICAgZ3VpZDogMTc2MjQwMjA0NTA4MDQ3 NDE0MDEKICAgICAgICAgICAgICAgICAgICBwYXRoOiAnL2Rldi9ncHRpZC82ZTVjZWEyNy03 ZjUyLTExZTMtOWNkOC1kNDNkN2VkNWI1ODcnCiAgICAgICAgICAgICAgICAgICAgd2hvbGVf ZGlzazogMQogICAgICAgICAgICAgICAgICAgIERUTDogMTM3CiAgICAgICAgICAgICAgICAg ICAgY3JlYXRlX3R4ZzogNAogICAgICAgICAgICAgICAgY2hpbGRyZW5bMV06CiAgICAgICAg ICAgICAgICAgICAgdHlwZTogJ2Rpc2snCiAgICAgICAgICAgICAgICAgICAgaWQ6IDEKICAg ICAgICAgICAgICAgICAgICBndWlkOiAzMjUzMjk5MDY3NTM3Mjg3NDI4CiAgICAgICAgICAg ICAgICAgICAgd2hvbGVfZGlzazogMQogICAgICAgICAgICAgICAgICAgIERUTDogMTMzCiAg ICAgICAgICAgICAgICAgICAgY3JlYXRlX3R4ZzogNAogICAgICAgICAgICAgICAgICAgIHBh dGg6ICcvZGV2L2dwdGlkLzJiNzBkOWMwLThlNDAtMTFlMy1hYTFjLWQ0M2Q3ZWQ1YjU4NycK ICAgICAgICAgICAgICAgIGNoaWxkcmVuWzJdOgogICAgICAgICAgICAgICAgICAgIHR5cGU6 ICdkaXNrJwogICAgICAgICAgICAgICAgICAgIGlkOiAyCiAgICAgICAgICAgICAgICAgICAg Z3VpZDogMTc5OTk1MjQ0MTgwMTU5NjMyNTgKICAgICAgICAgICAgICAgICAgICBwYXRoOiAn L2Rldi9ncHRpZC8xZTg5ODc1OC05NDg4LTExZTMtYTg2ZS1kNDNkN2VkNWI1ODcnCiAgICAg ICAgICAgICAgICAgICAgd2hvbGVfZGlzazogMQogICAgICAgICAgICAgICAgICAgIERUTDog MTM0CiAgICAgICAgICAgICAgICAgICAgY3JlYXRlX3R4ZzogNAp6ZGI6IGNhbid0IG9wZW4g J3poX3ZvbCc6IEZpbGUgZXhpc3RzCiMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9VVC0t Ly8jIyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0gfiMgcmVib290CiMjIyMjIyMjIyMjIyMv Ly0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKcGFja2V0X3dyaXRlX3dhaXQ6 IENvbm5lY3Rpb24gdG8gMTcyLjIwLjQuNTogQnJva2VuIHBpcGUKZXZnZW5AUVdFQm9vazp+ JCBzc2ggcm9vdEBqdWljeQpyb290QGp1aWN5J3MgcGFzc3dvcmQ6IApGcmVlQlNEIDkuMi1S RUxFQVNFIChGUkVFTkFTLmFtZDY0KSAjMCByKzIzMTVlYTM6IEZyaSBEZWMgMjAgMTI6NDg6 NTAgUFNUIDIwMTMKCglGcmVlTkFTIChjKSAyMDA5LTIwMTMsIFRoZSBGcmVlTkFTIERldmVs b3BtZW50IFRlYW0KCUFsbCByaWdodHMgcmVzZXJ2ZWQuCglGcmVlTkFTIGlzIHJlbGVhc2Vk IHVuZGVyIHRoZSBtb2RpZmllZCBCU0QgbGljZW5zZS4KCglGb3IgbW9yZSBpbmZvcm1hdGlv biwgZG9jdW1lbnRhdGlvbiwgaGVscCBvciBzdXBwb3J0LCBnbyBoZXJlOgogCWh0dHA6Ly9m cmVlbmFzLm9yZwpXZWxjb21lIHRvIEZyZWVOQVMKICAgICAgICAgICAgLgogICAgICAgICAg ICAgfH4KICAgICAgICAgICAgL3xcCiAgICAgICAgICAgfC0uLXwKICAgICAgICAgICAnLTot JwogICAgICAgICAgICBbfF0KICAgICAgICAgICAgW3xdCiAgICAgICAgICAgIFt8XQogICAg ICAgICAgICBbfF0KICAgICAgICAgICAgW3xdCiAgICAgICAgICAgLlt8XS4KICAgICAgICAg ICA6L3xcOgogICAgICAgICAgIFsvfFxdCiAgICAgICAgICAgWy98XF0KICAgICAgICAgLjpf I3wjXzouCiAgICAgICAgIHxfICctJyBffAogICAgICAgICAvXDotLi06L1wKICAgICAgICAv XHxfW3xdX3wvXAogICAgICBfL1x8fiBbfF0gfnwvXF8KICAgICAgWycnPS0uW3xdLi09Jydd CiAgICAgIDotLl8gICB8ICAgXy4tOgogICAgICAvL1w7OjotOi06OjsvXFwKICAgICAvXC4n LVxcL3xcLy8tJy4vXAogICAuJ1wvJyAgIDpcfC86ICAgJ1wvJy4KIC4vL1woJyAgICBbXHwv XSAgICAnKS9cXC4KJyc6XVtcLicgIC5bXHwvXS4gICcuL11bOicnCiAgICAnJyAgICA6L1x8 L1w6ICAgICcnCiAgICAgICAgIC5bXC98XC9dLgogICAgICAgICAgICcufC4nCiAgICAgICAg ICAgICAnCgojIyMjIyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMj IwoKW3Jvb3RAanVpY3ldIH4jIHpwb29sIGltcG9ydCAtRiB6aF92b2wKIyMjIyMjIyMjIyMj Iy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwpjYW5ub3QgaW1wb3J0ICd6 aF92b2wnOiBJL08gZXJyb3IKCURlc3Ryb3kgYW5kIHJlLWNyZWF0ZSB0aGUgcG9vbCBmcm9t CglhIGJhY2t1cCBzb3VyY2UuCgkjIyMjIyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQtLS8v IyMjIyMjIyMjIyMjIwoKW3Jvb3RAanVpY3ldIH4jIHpwb29sIGxpc3QKIyMjIyMjIyMjIyMj Iy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwpubyBwb29scyBhdmFpbGFi bGUKIyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKClty b290QGp1aWN5XSB+IyB6ZGIgLWUgemhfdm9sCiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0Yg U1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCkNvbmZpZ3VyYXRpb24gZm9yIGltcG9ydDoKICAg ICAgICB2ZGV2X2NoaWxkcmVuOiAxCiAgICAgICAgdmVyc2lvbjogNTAwMAogICAgICAgIHBv b2xfZ3VpZDogMjkxODY3MDEyMTA1OTAwMDY0NAogICAgICAgIG5hbWU6ICd6aF92b2wnCiAg ICAgICAgc3RhdGU6IDAKICAgICAgICBob3N0aWQ6IDE4MDI5ODc3MTAKICAgICAgICBob3N0 bmFtZTogJ2p1aWN5LnpoZWxhbmEubG9jYWwnCiAgICAgICAgdmRldl90cmVlOgogICAgICAg ICAgICB0eXBlOiAncm9vdCcKICAgICAgICAgICAgaWQ6IDAKICAgICAgICAgICAgZ3VpZDog MjkxODY3MDEyMTA1OTAwMDY0NAogICAgICAgICAgICBjaGlsZHJlblswXToKICAgICAgICAg ICAgICAgIHR5cGU6ICdyYWlkeicKICAgICAgICAgICAgICAgIGlkOiAwCiAgICAgICAgICAg ICAgICBndWlkOiAxNDEyMzQ0MDk5MzU4Nzk5MTA4OAogICAgICAgICAgICAgICAgbnBhcml0 eTogMQogICAgICAgICAgICAgICAgbWV0YXNsYWJfYXJyYXk6IDM0CiAgICAgICAgICAgICAg ICBtZXRhc2xhYl9zaGlmdDogMzYKICAgICAgICAgICAgICAgIGFzaGlmdDogMTIKICAgICAg ICAgICAgICAgIGFzaXplOiA4OTk1MzIxNjc1Nzc2CiAgICAgICAgICAgICAgICBpc19sb2c6 IDAKICAgICAgICAgICAgICAgIGNyZWF0ZV90eGc6IDQKICAgICAgICAgICAgICAgIGNoaWxk cmVuWzBdOgogICAgICAgICAgICAgICAgICAgIHR5cGU6ICdkaXNrJwogICAgICAgICAgICAg ICAgICAgIGlkOiAwCiAgICAgICAgICAgICAgICAgICAgZ3VpZDogMTc2MjQwMjA0NTA4MDQ3 NDE0MDEKICAgICAgICAgICAgICAgICAgICBwYXRoOiAnL2Rldi9ncHRpZC82ZTVjZWEyNy03 ZjUyLTExZTMtOWNkOC1kNDNkN2VkNWI1ODcnCiAgICAgICAgICAgICAgICAgICAgd2hvbGVf ZGlzazogMQogICAgICAgICAgICAgICAgICAgIERUTDogMTM3CiAgICAgICAgICAgICAgICAg ICAgY3JlYXRlX3R4ZzogNAogICAgICAgICAgICAgICAgY2hpbGRyZW5bMV06CiAgICAgICAg ICAgICAgICAgICAgdHlwZTogJ2Rpc2snCiAgICAgICAgICAgICAgICAgICAgaWQ6IDEKICAg ICAgICAgICAgICAgICAgICBndWlkOiAzMjUzMjk5MDY3NTM3Mjg3NDI4CiAgICAgICAgICAg ICAgICAgICAgd2hvbGVfZGlzazogMQogICAgICAgICAgICAgICAgICAgIERUTDogMTMzCiAg ICAgICAgICAgICAgICAgICAgY3JlYXRlX3R4ZzogNAogICAgICAgICAgICAgICAgICAgIHBh dGg6ICcvZGV2L2dwdGlkLzJiNzBkOWMwLThlNDAtMTFlMy1hYTFjLWQ0M2Q3ZWQ1YjU4NycK ICAgICAgICAgICAgICAgIGNoaWxkcmVuWzJdOgogICAgICAgICAgICAgICAgICAgIHR5cGU6 ICdkaXNrJwogICAgICAgICAgICAgICAgICAgIGlkOiAyCiAgICAgICAgICAgICAgICAgICAg Z3VpZDogMTc5OTk1MjQ0MTgwMTU5NjMyNTgKICAgICAgICAgICAgICAgICAgICB3aG9sZV9k aXNrOiAxCiAgICAgICAgICAgICAgICAgICAgRFRMOiAxMzQKICAgICAgICAgICAgICAgICAg ICBjcmVhdGVfdHhnOiA0CiAgICAgICAgICAgICAgICAgICAgcGF0aDogJy9kZXYvZ3B0aWQv NWRhY2Q3MzctMThhYy0xMWU2LTljMjUtMDAxYjc4NTliOTNlJwp6ZGI6IGNhbid0IG9wZW4g J3poX3ZvbCc6IEZpbGUgZXhpc3RzCiMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9VVC0t Ly8jIyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0gfiMgbHMgL2Jvb3QvemZzL3pwb29sLmNh Y2hlIAojIyMjIyMjIyMjIyMjLy8tLVNUQVJUIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMj Ci9ib290L3pmcy96cG9vbC5jYWNoZUAKIyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VU LS0vLyMjIyMjIyMjIyMjIyMKCltyb290QGp1aWN5XSB+IyB6ZGIgLUMgLVUgL2Jvb3QvemZz L3pwb29sLmNhY2hlCiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMj IyMjIyMjIyMKemhfdm9sOgogICAgdmVyc2lvbjogNTAwMAogICAgbmFtZTogJ3poX3ZvbCcK ICAgIHN0YXRlOiAwCiAgICB0eGc6IDE0MTA2NDQ3CiAgICBwb29sX2d1aWQ6IDI5MTg2NzAx MjEwNTkwMDA2NDQKICAgIGhvc3RpZDogMTgwMjk4NzcxMAogICAgaG9zdG5hbWU6ICcnCiAg ICB2ZGV2X2NoaWxkcmVuOiAxCiAgICB2ZGV2X3RyZWU6CiAgICAgICAgdHlwZTogJ3Jvb3Qn CiAgICAgICAgaWQ6IDAKICAgICAgICBndWlkOiAyOTE4NjcwMTIxMDU5MDAwNjQ0CiAgICAg ICAgY3JlYXRlX3R4ZzogNAogICAgICAgIGNoaWxkcmVuWzBdOgogICAgICAgICAgICB0eXBl OiAncmFpZHonCiAgICAgICAgICAgIGlkOiAwCiAgICAgICAgICAgIGd1aWQ6IDE0MTIzNDQw OTkzNTg3OTkxMDg4CiAgICAgICAgICAgIG5wYXJpdHk6IDEKICAgICAgICAgICAgbWV0YXNs YWJfYXJyYXk6IDM0CiAgICAgICAgICAgIG1ldGFzbGFiX3NoaWZ0OiAzNgogICAgICAgICAg ICBhc2hpZnQ6IDEyCiAgICAgICAgICAgIGFzaXplOiA4OTk1MzIxNjc1Nzc2CiAgICAgICAg ICAgIGlzX2xvZzogMAogICAgICAgICAgICBjcmVhdGVfdHhnOiA0CiAgICAgICAgICAgIGNo aWxkcmVuWzBdOgogICAgICAgICAgICAgICAgdHlwZTogJ2Rpc2snCiAgICAgICAgICAgICAg ICBpZDogMAogICAgICAgICAgICAgICAgZ3VpZDogMTc2MjQwMjA0NTA4MDQ3NDE0MDEKICAg ICAgICAgICAgICAgIHBhdGg6ICcvZGV2L2dwdGlkLzZlNWNlYTI3LTdmNTItMTFlMy05Y2Q4 LWQ0M2Q3ZWQ1YjU4NycKICAgICAgICAgICAgICAgIHdob2xlX2Rpc2s6IDEKICAgICAgICAg ICAgICAgIERUTDogMTM3CiAgICAgICAgICAgICAgICBjcmVhdGVfdHhnOiA0CiAgICAgICAg ICAgIGNoaWxkcmVuWzFdOgogICAgICAgICAgICAgICAgdHlwZTogJ2Rpc2snCiAgICAgICAg ICAgICAgICBpZDogMQogICAgICAgICAgICAgICAgZ3VpZDogMzI1MzI5OTA2NzUzNzI4NzQy OAogICAgICAgICAgICAgICAgcGF0aDogJy9kZXYvZ3B0aWQvMmI3MGQ5YzAtOGU0MC0xMWUz LWFhMWMtZDQzZDdlZDViNTg3JwogICAgICAgICAgICAgICAgd2hvbGVfZGlzazogMQogICAg ICAgICAgICAgICAgRFRMOiAxMzMKICAgICAgICAgICAgICAgIGNyZWF0ZV90eGc6IDQKICAg ICAgICAgICAgY2hpbGRyZW5bMl06CiAgICAgICAgICAgICAgICB0eXBlOiAnZGlzaycKICAg ICAgICAgICAgICAgIGlkOiAyCiAgICAgICAgICAgICAgICBndWlkOiAxNzk5OTUyNDQxODAx NTk2MzI1OAogICAgICAgICAgICAgICAgcGF0aDogJy9kZXYvZ3B0aWQvMWU4OTg3NTgtOTQ4 OC0xMWUzLWE4NmUtZDQzZDdlZDViNTg3JwogICAgICAgICAgICAgICAgd2hvbGVfZGlzazog MQogICAgICAgICAgICAgICAgRFRMOiAxMzQKICAgICAgICAgICAgICAgIGNyZWF0ZV90eGc6 IDQKICAgIGZlYXR1cmVzX2Zvcl9yZWFkOgogICAgIyMjIyMjIyMjIyMjIy8vLS1FTkQgT0Yg U1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290QGp1aWN5XSB+IyB6cG9vbCBpbXBvcnQg LUQKIyMjIyMjIyMjIyMjIy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwpu byBwb29scyBhdmFpbGFibGUgdG8gaW1wb3J0CiMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNU RE9VVC0tLy8jIyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0gfiMgenBvb2wgY3JlYXRlIHpo X3ZvbCBhZGEwIGFkYTEKIyMjIyMjIyMjIyMjIy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMj IyMjIyMjIyMjIwpjYW5ub3QgY3JlYXRlICd6aF92b2wnOiBubyBzdWNoIHBvb2wgb3IgZGF0 YXNldAojIyMjIyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwoK W3Jvb3RAanVpY3ldIH4jIHpwb29sIGNyZWF0ZQojIyMjIyMjIyMjIyMjLy8tLVNUQVJUIE9G IFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCm1pc3NpbmcgcG9vbCBuYW1lIGFyZ3VtZW50CnVz YWdlOgoJY3JlYXRlIFstZm5kXSBbLW8gcHJvcGVydHk9dmFsdWVdIC4uLiAKCSAgICBbLU8g ZmlsZS1zeXN0ZW0tcHJvcGVydHk9dmFsdWVdIC4uLiAKCSAgICBbLW0gbW91bnRwb2ludF0g Wy1SIHJvb3RdIDxwb29sPiA8dmRldj4gLi4uCgkgICAgIyMjIyMjIyMjIyMjIy8vLS1FTkQg T0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290QGp1aWN5XSB+IyBncGFydCBsaXN0 IC1sCiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMK Z3BhcnQ6IGlsbGVnYWwgb3B0aW9uIC0tIGwKdXNhZ2U6IGdwYXJ0IGFkZCAtdCB0eXBlIFst YSBhbGlnbm1lbnRdIFstYiBzdGFydF0gWy1zIHNpemVdIFstaSBpbmRleF0gWy1sIGxhYmVs XSBbLWYgZmxhZ3NdIGdlb20KICAgICAgIGdwYXJ0IGJhY2t1cCBnZW9tCiAgICAgICBncGFy dCBib290Y29kZSBbLWIgYm9vdGNvZGVdIFstcCBwYXJ0Y29kZSAtaSBpbmRleF0gWy1mIGZs YWdzXSBnZW9tCiAgICAgICBncGFydCBjb21taXQgZ2VvbQogICAgICAgZ3BhcnQgY3JlYXRl IC1zIHNjaGVtZSBbLW4gZW50cmllc10gWy1mIGZsYWdzXSBwcm92aWRlcgogICAgICAgZ3Bh cnQgZGVsZXRlIC1pIGluZGV4IFstZiBmbGFnc10gZ2VvbQogICAgICAgZ3BhcnQgZGVzdHJv eSBbLUZdIFstZiBmbGFnc10gZ2VvbQogICAgICAgZ3BhcnQgbW9kaWZ5IC1pIGluZGV4IFst bCBsYWJlbF0gWy10IHR5cGVdIFstZiBmbGFnc10gZ2VvbQogICAgICAgZ3BhcnQgc2V0IC1h IGF0dHJpYiAtaSBpbmRleCBbLWYgZmxhZ3NdIGdlb20KICAgICAgIGdwYXJ0IHNob3cgWy1s IHwgLXJdIFstcF0gW2dlb20gLi4uXQogICAgICAgZ3BhcnQgdW5kbyBnZW9tCiAgICAgICBn cGFydCB1bnNldCAtYSBhdHRyaWIgLWkgaW5kZXggWy1mIGZsYWdzXSBnZW9tCiAgICAgICBn cGFydCByZXNpemUgLWkgaW5kZXggWy1hIGFsaWdubWVudF0gWy1zIHNpemVdIFstZiBmbGFn c10gZ2VvbQogICAgICAgZ3BhcnQgcmVzdG9yZSBbLWxGXSBbLWYgZmxhZ3NdIHByb3ZpZGVy IFsuLi5dCiAgICAgICBncGFydCByZWNvdmVyIFstZiBmbGFnc10gZ2VvbQogICAgICAgZ3Bh cnQgaGVscAogICAgICAgZ3BhcnQgbGlzdCBbLWFdIFtuYW1lIC4uLl0KICAgICAgIGdwYXJ0 IHN0YXR1cyBbLWFnc10gW25hbWUgLi4uXQogICAgICAgZ3BhcnQgbG9hZCBbLXZdCiAgICAg ICBncGFydCB1bmxvYWQgWy12XQogICAgICAgIyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RE T1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290QGp1aWN5XSB+IyBncGFydCBsaXN0IC1hCiMj IyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKR2VvbSBu YW1lOiBhZGEwCm1vZGlmaWVkOiBmYWxzZQpzdGF0ZTogT0sKZndoZWFkczogMTYKZndzZWN0 b3JzOiA2MwpsYXN0OiAxMTcyMzE0MDcKZmlyc3Q6IDYzCmVudHJpZXM6IDQKc2NoZW1lOiBN QlIKUHJvdmlkZXJzOgoxLiBOYW1lOiBhZGEwczEKICAgTWVkaWFzaXplOiA5ODgyOTE1ODQg KDk0Mk0pCiAgIFNlY3RvcnNpemU6IDUxMgogICBTdHJpcGVzaXplOiAwCiAgIFN0cmlwZW9m ZnNldDogMzIyNTYKICAgTW9kZTogcjF3MGUxCiAgIGF0dHJpYjogYWN0aXZlCiAgIHJhd3R5 cGU6IDE2NQogICBsZW5ndGg6IDk4ODI5MTU4NAogICBvZmZzZXQ6IDMyMjU2CiAgIHR5cGU6 IGZyZWVic2QKICAgaW5kZXg6IDEKICAgZW5kOiAxOTMwMzE5CiAgIHN0YXJ0OiA2MwoyLiBO YW1lOiBhZGEwczIKICAgTWVkaWFzaXplOiA5ODgyOTE1ODQgKDk0Mk0pCiAgIFNlY3RvcnNp emU6IDUxMgogICBTdHJpcGVzaXplOiAwCiAgIFN0cmlwZW9mZnNldDogOTg4MzU2MDk2CiAg IE1vZGU6IHIwdzBlMAogICByYXd0eXBlOiAxNjUKICAgbGVuZ3RoOiA5ODgyOTE1ODQKICAg b2Zmc2V0OiA5ODgzNTYwOTYKICAgdHlwZTogZnJlZWJzZAogICBpbmRleDogMgogICBlbmQ6 IDM4NjA2MzkKICAgc3RhcnQ6IDE5MzAzODMKMy4gTmFtZTogYWRhMHMzCiAgIE1lZGlhc2l6 ZTogMTU0ODI4OCAoMS41TSkKICAgU2VjdG9yc2l6ZTogNTEyCiAgIFN0cmlwZXNpemU6IDAK ICAgU3RyaXBlb2Zmc2V0OiAxOTc2NjQ3NjgwCiAgIE1vZGU6IHIwdzBlMAogICByYXd0eXBl OiAxNjUKICAgbGVuZ3RoOiAxNTQ4Mjg4CiAgIG9mZnNldDogMTk3NjY0NzY4MAogICB0eXBl OiBmcmVlYnNkCiAgIGluZGV4OiAzCiAgIGVuZDogMzg2MzY2MwogICBzdGFydDogMzg2MDY0 MAo0LiBOYW1lOiBhZGEwczQKICAgTWVkaWFzaXplOiAyMTE1OTkzNiAoMjBNKQogICBTZWN0 b3JzaXplOiA1MTIKICAgU3RyaXBlc2l6ZTogMAogICBTdHJpcGVvZmZzZXQ6IDE5NzgxOTU5 NjgKICAgTW9kZTogcjF3MWUyCiAgIHJhd3R5cGU6IDE2NQogICBsZW5ndGg6IDIxMTU5OTM2 CiAgIG9mZnNldDogMTk3ODE5NTk2OAogICB0eXBlOiBmcmVlYnNkCiAgIGluZGV4OiA0CiAg IGVuZDogMzkwNDk5MQogICBzdGFydDogMzg2MzY2NApDb25zdW1lcnM6CjEuIE5hbWU6IGFk YTAKICAgTWVkaWFzaXplOiA2MDAyMjQ4MDg5NiAoNTVHKQogICBTZWN0b3JzaXplOiA1MTIK ICAgTW9kZTogcjJ3MWU0CgpHZW9tIG5hbWU6IGFkYTBzMQptb2RpZmllZDogZmFsc2UKc3Rh dGU6IE9LCmZ3aGVhZHM6IDE2CmZ3c2VjdG9yczogNjMKbGFzdDogMTkzMDI1NgpmaXJzdDog MAplbnRyaWVzOiA4CnNjaGVtZTogQlNEClByb3ZpZGVyczoKMS4gTmFtZTogYWRhMHMxYQog ICBNZWRpYXNpemU6IDk4ODI4MzM5MiAoOTQyTSkKICAgU2VjdG9yc2l6ZTogNTEyCiAgIFN0 cmlwZXNpemU6IDAKICAgU3RyaXBlb2Zmc2V0OiA0MDQ0OAogICBNb2RlOiByMXcwZTEKICAg cmF3dHlwZTogMAogICBsZW5ndGg6IDk4ODI4MzM5MgogICBvZmZzZXQ6IDgxOTIKICAgdHlw ZTogITAKICAgaW5kZXg6IDEKICAgZW5kOiAxOTMwMjU2CiAgIHN0YXJ0OiAxNgpDb25zdW1l cnM6CjEuIE5hbWU6IGFkYTBzMQogICBNZWRpYXNpemU6IDk4ODI5MTU4NCAoOTQyTSkKICAg U2VjdG9yc2l6ZTogNTEyCiAgIFN0cmlwZXNpemU6IDAKICAgU3RyaXBlb2Zmc2V0OiAzMjI1 NgogICBNb2RlOiByMXcwZTEKCkdlb20gbmFtZTogYWRhMQptb2RpZmllZDogZmFsc2UKc3Rh dGU6IE9LCmZ3aGVhZHM6IDE2CmZ3c2VjdG9yczogNjMKbGFzdDogNTg2MDUzMzEzNApmaXJz dDogMzQKZW50cmllczogMTI4CnNjaGVtZTogR1BUClByb3ZpZGVyczoKMS4gTmFtZTogYWRh MXAxCiAgIE1lZGlhc2l6ZTogMzIyMTIyNTQ3MiAoMy4wRykKICAgU2VjdG9yc2l6ZTogNTEy CiAgIFN0cmlwZXNpemU6IDQwOTYKICAgU3RyaXBlb2Zmc2V0OiAwCiAgIE1vZGU6IHIxdzFl MQogICByYXd1dWlkOiA1ZDk4NWJhYS0xOGFjLTExZTYtOWMyNS0wMDFiNzg1OWI5M2UKICAg cmF3dHlwZTogNTE2ZTdjYjUtNmVjZi0xMWQ2LThmZjgtMDAwMjJkMDk3MTJiCiAgIGxhYmVs OiAobnVsbCkKICAgbGVuZ3RoOiAzMjIxMjI1NDcyCiAgIG9mZnNldDogNjU1MzYKICAgdHlw ZTogZnJlZWJzZC1zd2FwCiAgIGluZGV4OiAxCiAgIGVuZDogNjI5MTU4MwogICBzdGFydDog MTI4CjIuIE5hbWU6IGFkYTFwMgogICBNZWRpYXNpemU6IDI5OTczNzE2NzA1MjggKDIuN1Qp CiAgIFNlY3RvcnNpemU6IDUxMgogICBTdHJpcGVzaXplOiA0MDk2CiAgIFN0cmlwZW9mZnNl dDogMAogICBNb2RlOiByMHcwZTAKICAgcmF3dXVpZDogNWRhY2Q3MzctMThhYy0xMWU2LTlj MjUtMDAxYjc4NTliOTNlCiAgIHJhd3R5cGU6IDUxNmU3Y2JhLTZlY2YtMTFkNi04ZmY4LTAw MDIyZDA5NzEyYgogICBsYWJlbDogKG51bGwpCiAgIGxlbmd0aDogMjk5NzM3MTY3MDUyOAog ICBvZmZzZXQ6IDMyMjEyOTEwMDgKICAgdHlwZTogZnJlZWJzZC16ZnMKICAgaW5kZXg6IDIK ICAgZW5kOiA1ODYwNTMzMTI3CiAgIHN0YXJ0OiA2MjkxNTg0CkNvbnN1bWVyczoKMS4gTmFt ZTogYWRhMQogICBNZWRpYXNpemU6IDMwMDA1OTI5ODIwMTYgKDIuN1QpCiAgIFNlY3RvcnNp emU6IDUxMgogICBTdHJpcGVzaXplOiA0MDk2CiAgIFN0cmlwZW9mZnNldDogMAogICBNb2Rl OiByMXcxZTIKCkdlb20gbmFtZTogYWRhMgptb2RpZmllZDogZmFsc2UKc3RhdGU6IE9LCmZ3 aGVhZHM6IDE2CmZ3c2VjdG9yczogNjMKbGFzdDogNTg2MDUzMzEzNApmaXJzdDogMzQKZW50 cmllczogMTI4CnNjaGVtZTogR1BUClByb3ZpZGVyczoKMS4gTmFtZTogYWRhMnAxCiAgIE1l ZGlhc2l6ZTogMzIyMTIyNTQ3MiAoMy4wRykKICAgU2VjdG9yc2l6ZTogNTEyCiAgIFN0cmlw ZXNpemU6IDQwOTYKICAgU3RyaXBlb2Zmc2V0OiAwCiAgIE1vZGU6IHIxdzFlMQogICByYXd1 dWlkOiA1ZTE2NDcyMC0xOGFjLTExZTYtOWMyNS0wMDFiNzg1OWI5M2UKICAgcmF3dHlwZTog NTE2ZTdjYjUtNmVjZi0xMWQ2LThmZjgtMDAwMjJkMDk3MTJiCiAgIGxhYmVsOiAobnVsbCkK ICAgbGVuZ3RoOiAzMjIxMjI1NDcyCiAgIG9mZnNldDogNjU1MzYKICAgdHlwZTogZnJlZWJz ZC1zd2FwCiAgIGluZGV4OiAxCiAgIGVuZDogNjI5MTU4MwogICBzdGFydDogMTI4CjIuIE5h bWU6IGFkYTJwMgogICBNZWRpYXNpemU6IDI5OTczNzE2NzA1MjggKDIuN1QpCiAgIFNlY3Rv cnNpemU6IDUxMgogICBTdHJpcGVzaXplOiA0MDk2CiAgIFN0cmlwZW9mZnNldDogMAogICBN b2RlOiByMHcwZTAKICAgcmF3dXVpZDogNWUyYWIwNGMtMThhYy0xMWU2LTljMjUtMDAxYjc4 NTliOTNlCiAgIHJhd3R5cGU6IDUxNmU3Y2JhLTZlY2YtMTFkNi04ZmY4LTAwMDIyZDA5NzEy YgogICBsYWJlbDogKG51bGwpCiAgIGxlbmd0aDogMjk5NzM3MTY3MDUyOAogICBvZmZzZXQ6 IDMyMjEyOTEwMDgKICAgdHlwZTogZnJlZWJzZC16ZnMKICAgaW5kZXg6IDIKICAgZW5kOiA1 ODYwNTMzMTI3CiAgIHN0YXJ0OiA2MjkxNTg0CkNvbnN1bWVyczoKMS4gTmFtZTogYWRhMgog ICBNZWRpYXNpemU6IDMwMDA1OTI5ODIwMTYgKDIuN1QpCiAgIFNlY3RvcnNpemU6IDUxMgog ICBTdHJpcGVzaXplOiA0MDk2CiAgIFN0cmlwZW9mZnNldDogMAogICBNb2RlOiByMXcxZTIK Ckdlb20gbmFtZTogYWRhMwptb2RpZmllZDogZmFsc2UKc3RhdGU6IE9LCmZ3aGVhZHM6IDE2 CmZ3c2VjdG9yczogNjMKbGFzdDogNTg2MDUzMzEzNApmaXJzdDogMzQKZW50cmllczogMTI4 CnNjaGVtZTogR1BUClByb3ZpZGVyczoKMS4gTmFtZTogYWRhM3AxCiAgIE1lZGlhc2l6ZTog MzIyMTIyNTQ3MiAoMy4wRykKICAgU2VjdG9yc2l6ZTogNTEyCiAgIFN0cmlwZXNpemU6IDQw OTYKICAgU3RyaXBlb2Zmc2V0OiAwCiAgIE1vZGU6IHIxdzFlMQogICByYXd1dWlkOiAyYjU3 MGJiOS04ZTQwLTExZTMtYWExYy1kNDNkN2VkNWI1ODcKICAgcmF3dHlwZTogNTE2ZTdjYjUt NmVjZi0xMWQ2LThmZjgtMDAwMjJkMDk3MTJiCiAgIGxhYmVsOiAobnVsbCkKICAgbGVuZ3Ro OiAzMjIxMjI1NDcyCiAgIG9mZnNldDogNjU1MzYKICAgdHlwZTogZnJlZWJzZC1zd2FwCiAg IGluZGV4OiAxCiAgIGVuZDogNjI5MTU4MwogICBzdGFydDogMTI4CjIuIE5hbWU6IGFkYTNw MgogICBNZWRpYXNpemU6IDI5OTczNzE2NzA1MjggKDIuN1QpCiAgIFNlY3RvcnNpemU6IDUx MgogICBTdHJpcGVzaXplOiA0MDk2CiAgIFN0cmlwZW9mZnNldDogMAogICBNb2RlOiByMHcw ZTAKICAgcmF3dXVpZDogMmI3MGQ5YzAtOGU0MC0xMWUzLWFhMWMtZDQzZDdlZDViNTg3CiAg IHJhd3R5cGU6IDUxNmU3Y2JhLTZlY2YtMTFkNi04ZmY4LTAwMDIyZDA5NzEyYgogICBsYWJl bDogKG51bGwpCiAgIGxlbmd0aDogMjk5NzM3MTY3MDUyOAogICBvZmZzZXQ6IDMyMjEyOTEw MDgKICAgdHlwZTogZnJlZWJzZC16ZnMKICAgaW5kZXg6IDIKICAgZW5kOiA1ODYwNTMzMTI3 CiAgIHN0YXJ0OiA2MjkxNTg0CkNvbnN1bWVyczoKMS4gTmFtZTogYWRhMwogICBNZWRpYXNp emU6IDMwMDA1OTI5ODIwMTYgKDIuN1QpCiAgIFNlY3RvcnNpemU6IDUxMgogICBTdHJpcGVz aXplOiA0MDk2CiAgIFN0cmlwZW9mZnNldDogMAogICBNb2RlOiByMXcxZTIKCiMjIyMjIyMj IyMjIyMvLy0tRU5EIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0g fiMgenBvb2wgY3JlYXRlIHpoX3ZvbCBhZGEwM3AxIGFkYTNwMgojIyMjIyMjIyMjIyMjLy8t LVNUQVJUIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCmNhbm5vdCBvcGVuICdhZGEwM3Ax Jzogbm8gc3VjaCBHRU9NIHByb3ZpZGVyCm11c3QgYmUgYSBmdWxsIHBhdGggb3Igc2hvcnRo YW5kIGRldmljZSBuYW1lCiMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9VVC0tLy8jIyMj IyMjIyMjIyMjCgpbcm9vdEBqdWljeV0gfiMgenBvb2wgY3JlYXRlIHpoX3ZvbCBhZGEwcDEg YWRhMXAxIAojIyMjIyMjIyMjIyMjLy8tLVNUQVJUIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMj IyMjCmNhbm5vdCBvcGVuICdhZGEwcDEnOiBubyBzdWNoIEdFT00gcHJvdmlkZXIKbXVzdCBi ZSBhIGZ1bGwgcGF0aCBvciBzaG9ydGhhbmQgZGV2aWNlIG5hbWUKIyMjIyMjIyMjIyMjIy8v LS1FTkQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290QGp1aWN5XSB+IyB6cG9v bCBjcmVhdGUgemhfdm9sIGFkYTBwMgojIyMjIyMjIyMjIyMjLy8tLVNUQVJUIE9GIFNURE9V VC0tLy8jIyMjIyMjIyMjIyMjCmNhbm5vdCBvcGVuICdhZGEwcDInOiBubyBzdWNoIEdFT00g cHJvdmlkZXIKbXVzdCBiZSBhIGZ1bGwgcGF0aCBvciBzaG9ydGhhbmQgZGV2aWNlIG5hbWUK IyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290 QGp1aWN5XSB+IyB6cG9vbCBjcmVhdGUgemhfdm9sIC9kZXYvCiMjIyMjIyMjIyMjIyMvLy0t U1RBUlQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKYWNwaSUgICAgICAgYWQ4QCAgICAg ICAgYWRhMnAxJSAgICAgY3J5cHRvJSAgICAgaXNjc2klICAgICAgcGFzczAlICAgICAgdHR5 dTAuaW5pdCUgdHR5dmQlCmFkMTBAICAgICAgIGFkOHAxLmVsaUAgIGFkYTJwMS5lbGklIGN0 dHklICAgICAgIGtiZDBAICAgICAgIHBhc3MxJSAgICAgIHR0eXUwLmxvY2slIHR0eXZlJQph ZDEwcDEuZWxpQCBhZDhwMUAgICAgICBhZGEycDIlICAgICBjdWF1MCUgICAgICBrYmQxQCAg ICAgICBwYXNzMiUgICAgICB0dHl2MCUgICAgICB0dHl2ZiUKYWQxMHAxQCAgICAgYWQ4cDJA ICAgICAgYWRhMyUgICAgICAgY3VhdTAuaW5pdCUga2JkbXV4MCUgICAgcGFzczMlICAgICAg dHR5djElICAgICAgdWZzLwphZDEwcDJAICAgICBhZGEwJSAgICAgICBhZGEzcDElICAgICBj dWF1MC5sb2NrJSBrbG9nJSAgICAgICBwY2klICAgICAgICB0dHl2MiUgICAgICB1ZnNzdXNw ZW5kJQphZDRAICAgICAgICBhZGEwczElICAgICBhZGEzcDEuZWxpJSBkZXZjdGwlICAgICBr bWVtJSAgICAgICBwc20wJSAgICAgICB0dHl2MyUgICAgICB1cmFuZG9tQAphZDRzMUAgICAg ICBhZGEwczFhJSAgICBhZGEzcDIlICAgICBkZXZzdGF0JSAgICBsZWQvICAgICAgICBwdG14 JSAgICAgICB0dHl2NCUgICAgICB1c2JjdGwlCmFkNHMxYUAgICAgIGFkYTBzMiUgICAgIGF0 a2JkMCUgICAgIGR0cmFjZS8gICAgIGxvZ0AgICAgICAgIHB0cy8gICAgICAgIHR0eXY1JSAg ICAgIHhwdDAlCmFkNHMyQCAgICAgIGFkYTBzMyUgICAgIGF1ZGl0JSAgICAgIGR1bXBkZXZA ICAgIG1kMCUgICAgICAgIHJhbmRvbSUgICAgIHR0eXY2JSAgICAgIHplcm8lCmFkNHMzQCAg ICAgIGFkYTBzNCUgICAgIGJwZiUgICAgICAgIGZkLyAgICAgICAgIG1kMSUgICAgICAgIHNu cCUgICAgICAgIHR0eXY3JSAgICAgIHpmcyUKYWQ0czRAICAgICAgYWRhMSUgICAgICAgYnBm MEAgICAgICAgZmlkbyUgICAgICAgbWQyJSAgICAgICAgc3RkZXJyQCAgICAgdHR5djglICAg ICAgCmFkNkAgICAgICAgIGFkYTFwMSUgICAgIGJwc20wJSAgICAgIGdlb20uY3RsJSAgIG1k Y3RsJSAgICAgIHN0ZGluQCAgICAgIHR0eXY5JSAgICAgIAphZDZwMS5lbGlAICBhZGExcDEu ZWxpJSBjYW0vICAgICAgICBnZ2N0bCUgICAgICBtZW0lICAgICAgICBzdGRvdXRAICAgICB0 dHl2YSUgICAgICAKYWQ2cDFAICAgICAgYWRhMXAyJSAgICAgY29uc29sZSUgICAgZ3B0aWQv ICAgICAgbmZzbG9jayUgICAgc3lzbW91c2UlICAgdHR5dmIlICAgICAgCmFkNnAyQCAgICAg IGFkYTIlICAgICAgIGNvbnNvbGVjdGwlIGlvJSAgICAgICAgIG51bGwlICAgICAgIHR0eXUw JSAgICAgIHR0eXZjJSAgICAgIAojIyMjIyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQtLS8v IyMjIyMjIyMjIyMjIwoKW3Jvb3RAanVpY3ldIH4jIHpwb29sIGNyZWF0ZSB6aF92b2wgL2Rl di9hZGEKIyMjIyMjIyMjIyMjIy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMj IwphZGEwJSAgICAgICBhZGEwczIlICAgICBhZGExJSAgICAgICBhZGExcDIlICAgICBhZGEy cDEuZWxpJSBhZGEzcDElICAgICAKYWRhMHMxJSAgICAgYWRhMHMzJSAgICAgYWRhMXAxJSAg ICAgYWRhMiUgICAgICAgYWRhMnAyJSAgICAgYWRhM3AxLmVsaSUgCmFkYTBzMWElICAgIGFk YTBzNCUgICAgIGFkYTFwMS5lbGklIGFkYTJwMSUgICAgIGFkYTMlICAgICAgIGFkYTNwMiUg ICAgIAojIyMjIyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwoK W3Jvb3RAanVpY3ldIH4jIHpwb29sIGNyZWF0ZSB6aF92b2wgL2Rldi9hZGEwCiMjIyMjIyMj IyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKYWRhMCUgICAgYWRh MHMxJSAgYWRhMHMxYSUgYWRhMHMyJSAgYWRhMHMzJSAgYWRhMHM0JSAgCiMjIyMjIyMjIyMj IyMvLy0tRU5EIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0gfiMg enBvb2wgY3JlYXRlIHpoX3ZvbCAvZGV2L2FkYTAKIyMjIyMjIyMjIyMjIy8vLS1TVEFSVCBP RiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwphZGEwJSAgICBhZGEwczElICBhZGEwczFhJSBh ZGEwczIlICBhZGEwczMlICBhZGEwczQlICAKIyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RE T1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290QGp1aWN5XSB+IyB6cG9vbCBjcmVhdGUgemhf dm9sIC9kZXYvYWRhMCAvZGV2L2FkYTEKIyMjIyMjIyMjIyMjIy8vLS1TVEFSVCBPRiBTVERP VVQtLS8vIyMjIyMjIyMjIyMjIwpjYW5ub3QgY3JlYXRlICd6aF92b2wnOiBubyBzdWNoIHBv b2wgb3IgZGF0YXNldAojIyMjIyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQtLS8vIyMjIyMj IyMjIyMjIwoKW3Jvb3RAanVpY3ldIH4jIHpwb29sIGNyZWF0ZSB6aF92b2wgL2Rldi9hZGEw cyAvZGV2L2FkYTEKIyMjIyMjIyMjIyMjIy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMj IyMjIyMjIwphZGEwczElICBhZGEwczFhJSBhZGEwczIlICBhZGEwczMlICBhZGEwczQlICAK IyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290 QGp1aWN5XSB+IyB6cG9vbCBjcmVhdGUgemhfdm9sIC9kZXYvYWRhMHMyIC9kZXYvYWRhMXMy CiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKY2Fu bm90IG9wZW4gJy9kZXYvYWRhMXMyJzogTm8gc3VjaCBmaWxlIG9yIGRpcmVjdG9yeQojIyMj IyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwoKW3Jvb3RAanVp Y3ldIH4jIHpwb29sIGNyZWF0ZSB6aF92b2wgL2Rldi9hZGEwczIgCiMjIyMjIyMjIyMjIyMv Ly0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKY2hhbmdlX3Bhc3N3b3JkKiBz YXZlX3JyZHMuc2gqICAgIHVwZGF0ZSogICAgICAgICAgdXBkYXRlcDIqICAgICAgICAKc2F2 ZV9jZmcqICAgICAgICBzYXZlX3NzaGtleXMqICAgIHVwZGF0ZXAxKiAgICAgICAgemZzX3Jl dmVydC5weSogICAKIyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VULS0vLyMjIyMjIyMj IyMjIyMKCltyb290QGp1aWN5XSB+IyB6cG9vbCBjcmVhdGUgemhfdm9sIC9kZXYvYWRhMHMy IAojIyMjIyMjIyMjIyMjLy8tLVNUQVJUIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCmNh bm5vdCBtb3VudCAnL3poX3ZvbCc6IGZhaWxlZCB0byBjcmVhdGUgbW91bnRwb2ludAojIyMj IyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwoKW3Jvb3RAanVp Y3ldIH4jIGdwYXJ0IHNob3cgLWwKIyMjIyMjIyMjIyMjIy8vLS1TVEFSVCBPRiBTVERPVVQt LS8vIyMjIyMjIyMjIyMjIwo9PiAgICAgICA2MyAgMTE3MjMxMzQ1ICBhZGEwICBNQlIgICg1 NUcpCiAgICAgICAgIDYzICAgIDE5MzAyNTcgICAgIDEgIChudWxsKSAgW2FjdGl2ZV0gICg5 NDJNKQogICAgMTkzMDMyMCAgICAgICAgIDYzICAgICAgICAtIGZyZWUgLSAgKDMxaykKICAg IDE5MzAzODMgICAgMTkzMDI1NyAgICAgMiAgKG51bGwpICAoOTQyTSkKICAgIDM4NjA2NDAg ICAgICAgMzAyNCAgICAgMyAgKG51bGwpICAoMS41TSkKICAgIDM4NjM2NjQgICAgICA0MTMy OCAgICAgNCAgKG51bGwpICAoMjBNKQogICAgMzkwNDk5MiAgMTEzMzI2NDE2ICAgICAgICAt IGZyZWUgLSAgKDU0RykKCj0+ICAgICAgMCAgMTkzMDI1NyAgYWRhMHMxICBCU0QgICg5NDJN KQogICAgICAgIDAgICAgICAgMTYgICAgICAgICAgLSBmcmVlIC0gICg4LjBrKQogICAgICAg MTYgIDE5MzAyNDEgICAgICAgMSAgKG51bGwpICAoOTQyTSkKCj0+ICAgICAgICAzNCAgNTg2 MDUzMzEwMSAgYWRhMSAgR1BUICAoMi43VCkKICAgICAgICAgIDM0ICAgICAgICAgIDk0ICAg ICAgICAtIGZyZWUgLSAgKDQ3aykKICAgICAgICAgMTI4ICAgICA2MjkxNDU2ICAgICAxICAo bnVsbCkgICgzLjBHKQogICAgIDYyOTE1ODQgIDU4NTQyNDE1NDQgICAgIDIgIChudWxsKSAg KDIuN1QpCiAgNTg2MDUzMzEyOCAgICAgICAgICAgNyAgICAgICAgLSBmcmVlIC0gICgzLjVr KQoKPT4gICAgICAgIDM0ICA1ODYwNTMzMTAxICBhZGEyICBHUFQgICgyLjdUKQogICAgICAg ICAgMzQgICAgICAgICAgOTQgICAgICAgIC0gZnJlZSAtICAoNDdrKQogICAgICAgICAxMjgg ICAgIDYyOTE0NTYgICAgIDEgIChudWxsKSAgKDMuMEcpCiAgICAgNjI5MTU4NCAgNTg1NDI0 MTU0NCAgICAgMiAgKG51bGwpICAoMi43VCkKICA1ODYwNTMzMTI4ICAgICAgICAgICA3ICAg ICAgICAtIGZyZWUgLSAgKDMuNWspCgo9PiAgICAgICAgMzQgIDU4NjA1MzMxMDEgIGFkYTMg IEdQVCAgKDIuN1QpCiAgICAgICAgICAzNCAgICAgICAgICA5NCAgICAgICAgLSBmcmVlIC0g ICg0N2spCiAgICAgICAgIDEyOCAgICAgNjI5MTQ1NiAgICAgMSAgKG51bGwpICAoMy4wRykK ICAgICA2MjkxNTg0ICA1ODU0MjQxNTQ0ICAgICAyICAobnVsbCkgICgyLjdUKQogIDU4NjA1 MzMxMjggICAgICAgICAgIDcgICAgICAgIC0gZnJlZSAtICAoMy41aykKCiMjIyMjIyMjIyMj IyMvLy0tRU5EIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0gfiMg emRiIC1sIC9kZXYvYWRhMHMyCiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0v LyMjIyMjIyMjIyMjIyMKLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0KTEFCRUwgMAotLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLQogICAgdmVyc2lvbjogNTAwMAogICAgbmFtZTogJ3poX3ZvbCcKICAgIHN0YXRlOiAw CiAgICB0eGc6IDUxCiAgICBwb29sX2d1aWQ6IDEwMTQ5NjU0MzQ3NTA3MjQ0NzQyCiAgICBo b3N0aWQ6IDE4MDI5ODc3MTAKICAgIGhvc3RuYW1lOiAnanVpY3kuemhlbGFuYS5sb2NhbCcK ICAgIHRvcF9ndWlkOiA1ODkyNTA4MzM0NjkxNDk1Mzg0CiAgICBndWlkOiA1ODkyNTA4MzM0 NjkxNDk1Mzg0CiAgICB2ZGV2X2NoaWxkcmVuOiAxCiAgICB2ZGV2X3RyZWU6CiAgICAgICAg dHlwZTogJ2Rpc2snCiAgICAgICAgaWQ6IDAKICAgICAgICBndWlkOiA1ODkyNTA4MzM0Njkx NDk1Mzg0CiAgICAgICAgcGF0aDogJy9kZXYvYWRhMHMyJwogICAgICAgIHdob2xlX2Rpc2s6 IDEKICAgICAgICBtZXRhc2xhYl9hcnJheTogMzMKICAgICAgICBtZXRhc2xhYl9zaGlmdDog MjMKICAgICAgICBhc2hpZnQ6IDEyCiAgICAgICAgYXNpemU6IDk4MzU2NDI4OAogICAgICAg IGlzX2xvZzogMAogICAgICAgIGNyZWF0ZV90eGc6IDQKICAgIGZlYXR1cmVzX2Zvcl9yZWFk OgotLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLQpMQUJFTCAx Ci0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tCiAgICB2ZXJz aW9uOiA1MDAwCiAgICBuYW1lOiAnemhfdm9sJwogICAgc3RhdGU6IDAKICAgIHR4ZzogNTEK ICAgIHBvb2xfZ3VpZDogMTAxNDk2NTQzNDc1MDcyNDQ3NDIKICAgIGhvc3RpZDogMTgwMjk4 NzcxMAogICAgaG9zdG5hbWU6ICdqdWljeS56aGVsYW5hLmxvY2FsJwogICAgdG9wX2d1aWQ6 IDU4OTI1MDgzMzQ2OTE0OTUzODQKICAgIGd1aWQ6IDU4OTI1MDgzMzQ2OTE0OTUzODQKICAg IHZkZXZfY2hpbGRyZW46IDEKICAgIHZkZXZfdHJlZToKICAgICAgICB0eXBlOiAnZGlzaycK ICAgICAgICBpZDogMAogICAgICAgIGd1aWQ6IDU4OTI1MDgzMzQ2OTE0OTUzODQKICAgICAg ICBwYXRoOiAnL2Rldi9hZGEwczInCiAgICAgICAgd2hvbGVfZGlzazogMQogICAgICAgIG1l dGFzbGFiX2FycmF5OiAzMwogICAgICAgIG1ldGFzbGFiX3NoaWZ0OiAyMwogICAgICAgIGFz aGlmdDogMTIKICAgICAgICBhc2l6ZTogOTgzNTY0Mjg4CiAgICAgICAgaXNfbG9nOiAwCiAg ICAgICAgY3JlYXRlX3R4ZzogNAogICAgZmVhdHVyZXNfZm9yX3JlYWQ6Ci0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tCkxBQkVMIDIKLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0KICAgIHZlcnNpb246IDUwMDAKICAg IG5hbWU6ICd6aF92b2wnCiAgICBzdGF0ZTogMAogICAgdHhnOiA1MQogICAgcG9vbF9ndWlk OiAxMDE0OTY1NDM0NzUwNzI0NDc0MgogICAgaG9zdGlkOiAxODAyOTg3NzEwCiAgICBob3N0 bmFtZTogJ2p1aWN5LnpoZWxhbmEubG9jYWwnCiAgICB0b3BfZ3VpZDogNTg5MjUwODMzNDY5 MTQ5NTM4NAogICAgZ3VpZDogNTg5MjUwODMzNDY5MTQ5NTM4NAogICAgdmRldl9jaGlsZHJl bjogMQogICAgdmRldl90cmVlOgogICAgICAgIHR5cGU6ICdkaXNrJwogICAgICAgIGlkOiAw CiAgICAgICAgZ3VpZDogNTg5MjUwODMzNDY5MTQ5NTM4NAogICAgICAgIHBhdGg6ICcvZGV2 L2FkYTBzMicKICAgICAgICB3aG9sZV9kaXNrOiAxCiAgICAgICAgbWV0YXNsYWJfYXJyYXk6 IDMzCiAgICAgICAgbWV0YXNsYWJfc2hpZnQ6IDIzCiAgICAgICAgYXNoaWZ0OiAxMgogICAg ICAgIGFzaXplOiA5ODM1NjQyODgKICAgICAgICBpc19sb2c6IDAKICAgICAgICBjcmVhdGVf dHhnOiA0CiAgICBmZWF0dXJlc19mb3JfcmVhZDoKLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0KTEFCRUwgMwotLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLQogICAgdmVyc2lvbjogNTAwMAogICAgbmFtZTogJ3poX3Zv bCcKICAgIHN0YXRlOiAwCiAgICB0eGc6IDUxCiAgICBwb29sX2d1aWQ6IDEwMTQ5NjU0MzQ3 NTA3MjQ0NzQyCiAgICBob3N0aWQ6IDE4MDI5ODc3MTAKICAgIGhvc3RuYW1lOiAnanVpY3ku emhlbGFuYS5sb2NhbCcKICAgIHRvcF9ndWlkOiA1ODkyNTA4MzM0NjkxNDk1Mzg0CiAgICBn dWlkOiA1ODkyNTA4MzM0NjkxNDk1Mzg0CiAgICB2ZGV2X2NoaWxkcmVuOiAxCiAgICB2ZGV2 X3RyZWU6CiAgICAgICAgdHlwZTogJ2Rpc2snCiAgICAgICAgaWQ6IDAKICAgICAgICBndWlk OiA1ODkyNTA4MzM0NjkxNDk1Mzg0CiAgICAgICAgcGF0aDogJy9kZXYvYWRhMHMyJwogICAg ICAgIHdob2xlX2Rpc2s6IDEKICAgICAgICBtZXRhc2xhYl9hcnJheTogMzMKICAgICAgICBt ZXRhc2xhYl9zaGlmdDogMjMKICAgICAgICBhc2hpZnQ6IDEyCiAgICAgICAgYXNpemU6IDk4 MzU2NDI4OAogICAgICAgIGlzX2xvZzogMAogICAgICAgIGNyZWF0ZV90eGc6IDQKICAgIGZl YXR1cmVzX2Zvcl9yZWFkOgogICAgIyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VULS0v LyMjIyMjIyMjIyMjIyMKCltyb290QGp1aWN5XSB+IyB6cG9vbCBpbXBvcnQKIyMjIyMjIyMj IyMjIy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwogICBwb29sOiB6aF92 b2wKICAgICBpZDogMjkxODY3MDEyMTA1OTAwMDY0NAogIHN0YXRlOiBGQVVMVEVECiBzdGF0 dXM6IE9uZSBvciBtb3JlIGRldmljZXMgYXJlIG1pc3NpbmcgZnJvbSB0aGUgc3lzdGVtLgog YWN0aW9uOiBUaGUgcG9vbCBjYW5ub3QgYmUgaW1wb3J0ZWQuIEF0dGFjaCB0aGUgbWlzc2lu ZwoJZGV2aWNlcyBhbmQgdHJ5IGFnYWluLgoJVGhlIHBvb2wgbWF5IGJlIGFjdGl2ZSBvbiBh bm90aGVyIHN5c3RlbSwgYnV0IGNhbiBiZSBpbXBvcnRlZCB1c2luZwoJdGhlICctZicgZmxh Zy4KICAgc2VlOiBodHRwOi8vaWxsdW1vcy5vcmcvbXNnL1pGUy04MDAwLTNDCiBjb25maWc6 CgoJemhfdm9sICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgRkFV TFRFRCAgY29ycnVwdGVkIGRhdGEKCSAgcmFpZHoxLTAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgIERFR1JBREVECgkgICAgMTc2MjQwMjA0NTA4MDQ3NDE0MDEgICAg ICAgICAgICAgICAgICAgICAgICBVTkFWQUlMICBjYW5ub3Qgb3BlbgoJICAgIGdwdGlkLzJi NzBkOWMwLThlNDAtMTFlMy1hYTFjLWQ0M2Q3ZWQ1YjU4NyAgT05MSU5FCgkgICAgZ3B0aWQv NWRhY2Q3MzctMThhYy0xMWU2LTljMjUtMDAxYjc4NTliOTNlICBPTkxJTkUKCSAgICAjIyMj IyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwoKW3Jvb3RAanVp Y3ldIH4jIHpwb29sIGltcG9ydCAtZgojIyMjIyMjIyMjIyMjLy8tLVNUQVJUIE9GIFNURE9V VC0tLy8jIyMjIyMjIyMjIyMjCiAgIHBvb2w6IHpoX3ZvbAogICAgIGlkOiAyOTE4NjcwMTIx MDU5MDAwNjQ0CiAgc3RhdGU6IEZBVUxURUQKIHN0YXR1czogT25lIG9yIG1vcmUgZGV2aWNl cyBhcmUgbWlzc2luZyBmcm9tIHRoZSBzeXN0ZW0uCiBhY3Rpb246IFRoZSBwb29sIGNhbm5v dCBiZSBpbXBvcnRlZC4gQXR0YWNoIHRoZSBtaXNzaW5nCglkZXZpY2VzIGFuZCB0cnkgYWdh aW4uCglUaGUgcG9vbCBtYXkgYmUgYWN0aXZlIG9uIGFub3RoZXIgc3lzdGVtLCBidXQgY2Fu IGJlIGltcG9ydGVkIHVzaW5nCgl0aGUgJy1mJyBmbGFnLgogICBzZWU6IGh0dHA6Ly9pbGx1 bW9zLm9yZy9tc2cvWkZTLTgwMDAtM0MKIGNvbmZpZzoKCgl6aF92b2wgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICBGQVVMVEVEICBjb3JydXB0ZWQgZGF0YQoJ ICByYWlkejEtMCAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgREVHUkFE RUQKCSAgICAxNzYyNDAyMDQ1MDgwNDc0MTQwMSAgICAgICAgICAgICAgICAgICAgICAgIFVO QVZBSUwgIGNhbm5vdCBvcGVuCgkgICAgZ3B0aWQvMmI3MGQ5YzAtOGU0MC0xMWUzLWFhMWMt ZDQzZDdlZDViNTg3ICBPTkxJTkUKCSAgICBncHRpZC81ZGFjZDczNy0xOGFjLTExZTYtOWMy NS0wMDFiNzg1OWI5M2UgIE9OTElORQoJICAgICMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNU RE9VVC0tLy8jIyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0gfiMgemRiCiMjIyMjIyMjIyMj IyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKemhfdm9sOgogICAgdmVy c2lvbjogNTAwMAogICAgbmFtZTogJ3poX3ZvbCcKICAgIHN0YXRlOiAwCiAgICB0eGc6IDE0 MTA2NDQ3CiAgICBwb29sX2d1aWQ6IDI5MTg2NzAxMjEwNTkwMDA2NDQKICAgIGhvc3RpZDog MTgwMjk4NzcxMAogICAgaG9zdG5hbWU6ICcnCiAgICB2ZGV2X2NoaWxkcmVuOiAxCiAgICB2 ZGV2X3RyZWU6CiAgICAgICAgdHlwZTogJ3Jvb3QnCiAgICAgICAgaWQ6IDAKICAgICAgICBn dWlkOiAyOTE4NjcwMTIxMDU5MDAwNjQ0CiAgICAgICAgY3JlYXRlX3R4ZzogNAogICAgICAg IGNoaWxkcmVuWzBdOgogICAgICAgICAgICB0eXBlOiAncmFpZHonCiAgICAgICAgICAgIGlk OiAwCiAgICAgICAgICAgIGd1aWQ6IDE0MTIzNDQwOTkzNTg3OTkxMDg4CiAgICAgICAgICAg IG5wYXJpdHk6IDEKICAgICAgICAgICAgbWV0YXNsYWJfYXJyYXk6IDM0CiAgICAgICAgICAg IG1ldGFzbGFiX3NoaWZ0OiAzNgogICAgICAgICAgICBhc2hpZnQ6IDEyCiAgICAgICAgICAg IGFzaXplOiA4OTk1MzIxNjc1Nzc2CiAgICAgICAgICAgIGlzX2xvZzogMAogICAgICAgICAg ICBjcmVhdGVfdHhnOiA0CiAgICAgICAgICAgIGNoaWxkcmVuWzBdOgogICAgICAgICAgICAg ICAgdHlwZTogJ2Rpc2snCiAgICAgICAgICAgICAgICBpZDogMAogICAgICAgICAgICAgICAg Z3VpZDogMTc2MjQwMjA0NTA4MDQ3NDE0MDEKICAgICAgICAgICAgICAgIHBhdGg6ICcvZGV2 L2dwdGlkLzZlNWNlYTI3LTdmNTItMTFlMy05Y2Q4LWQ0M2Q3ZWQ1YjU4NycKICAgICAgICAg ICAgICAgIHdob2xlX2Rpc2s6IDEKICAgICAgICAgICAgICAgIERUTDogMTM3CiAgICAgICAg ICAgICAgICBjcmVhdGVfdHhnOiA0CiAgICAgICAgICAgIGNoaWxkcmVuWzFdOgogICAgICAg ICAgICAgICAgdHlwZTogJ2Rpc2snCiAgICAgICAgICAgICAgICBpZDogMQogICAgICAgICAg ICAgICAgZ3VpZDogMzI1MzI5OTA2NzUzNzI4NzQyOAogICAgICAgICAgICAgICAgcGF0aDog Jy9kZXYvZ3B0aWQvMmI3MGQ5YzAtOGU0MC0xMWUzLWFhMWMtZDQzZDdlZDViNTg3JwogICAg ICAgICAgICAgICAgd2hvbGVfZGlzazogMQogICAgICAgICAgICAgICAgRFRMOiAxMzMKICAg ICAgICAgICAgICAgIGNyZWF0ZV90eGc6IDQKICAgICAgICAgICAgY2hpbGRyZW5bMl06CiAg ICAgICAgICAgICAgICB0eXBlOiAnZGlzaycKICAgICAgICAgICAgICAgIGlkOiAyCiAgICAg ICAgICAgICAgICBndWlkOiAxNzk5OTUyNDQxODAxNTk2MzI1OAogICAgICAgICAgICAgICAg cGF0aDogJy9kZXYvZ3B0aWQvMWU4OTg3NTgtOTQ4OC0xMWUzLWE4NmUtZDQzZDdlZDViNTg3 JwogICAgICAgICAgICAgICAgd2hvbGVfZGlzazogMQogICAgICAgICAgICAgICAgRFRMOiAx MzQKICAgICAgICAgICAgICAgIGNyZWF0ZV90eGc6IDQKICAgIGZlYXR1cmVzX2Zvcl9yZWFk OgogICAgIyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMK Cltyb290QGp1aWN5XSB+IyB6cG9vbCBpbXBvcnQgLWYgLW8gcmVhZG9ubHk9b24gemhfdm9s IG1udAojIyMjIyMjIyMjIyMjLy8tLVNUQVJUIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMj CmNhbm5vdCBpbXBvcnQgJ3poX3ZvbCcgYXMgJ21udCc6IEkvTyBlcnJvcgoJRGVzdHJveSBh bmQgcmUtY3JlYXRlIHRoZSBwb29sIGZyb20KCWEgYmFja3VwIHNvdXJjZS4KCSMjIyMjIyMj IyMjIyMvLy0tRU5EIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0g fiMgbHMgL21udAojIyMjIyMjIyMjIyMjLy8tLVNUQVJUIE9GIFNURE9VVC0tLy8jIyMjIyMj IyMjIyMjCi4vICAgICAgIC4uLyAgICAgIC5zbmFwLyAgIG1kX3NpemUKIyMjIyMjIyMjIyMj Iy8vLS1FTkQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290QGp1aWN5XSB+IyBt b3VudCAtbyBydyAvCiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMj IyMjIyMjIyMKIyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMj IyMKCltyb290QGp1aWN5XSB+IyBta2RpciAvbW50L3poX3ZvbAojIyMjIyMjIyMjIyMjLy8t LVNUQVJUIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCiMjIyMjIyMjIyMjIyMvLy0tRU5E IE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0gfiMgenBvb2wgaW1w b3J0IC1OIC1mIC1vIHJlYWRvbmx5PW9uIHpoX3ZvbCAvbW50L3podm9sCiMjIyMjIyMjIyMj IyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKY2Fubm90IGltcG9ydCAn L21udC96aHZvbCc6IGludmFsaWQgY2hhcmFjdGVyICcvJyBpbiBwb29sIG5hbWUKIyMjIyMj IyMjIyMjIy8vLS1FTkQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290QGp1aWN5 XSB+IyB6cG9vbCBpbXBvcnQgLU4gLWYgLW8gcmVhZG9ubHk9b24gLVIgL21udC96aF92b2wg emhfdm9sCiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMj IyMKY2Fubm90IGltcG9ydCAnemhfdm9sJzogYSBwb29sIHdpdGggdGhhdCBuYW1lIGFscmVh ZHkgZXhpc3RzCnVzZSB0aGUgZm9ybSAnenBvb2wgaW1wb3J0IDxwb29sIHwgaWQ+IDxuZXdw b29sPicgdG8gZ2l2ZSBpdCBhIG5ldyBuYW1lCiMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNU RE9VVC0tLy8jIyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0gfiMgenBvb2wgaW1wb3J0IC1m IC1vIHJlYWRvbmx5PW9uIC1SIC9tbnQvemhfdm9sIHpoX3ZvbAojIyMjIyMjIyMjIyMjLy8t LVNUQVJUIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCmNhbm5vdCBpbXBvcnQgJ3poX3Zv bCc6IGEgcG9vbCB3aXRoIHRoYXQgbmFtZSBhbHJlYWR5IGV4aXN0cwp1c2UgdGhlIGZvcm0g J3pwb29sIGltcG9ydCA8cG9vbCB8IGlkPiA8bmV3cG9vbD4nIHRvIGdpdmUgaXQgYSBuZXcg bmFtZQojIyMjIyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwoK W3Jvb3RAanVpY3ldIH4jIHpwb29sIGltcG9ydCAtZiAtbyByZWFkb25seT1vbiAvbW50L3po X3ZvbCB6aF92b2wKIyMjIyMjIyMjIyMjIy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMj IyMjIyMjIwpjYW5ub3QgaW1wb3J0ICcvbW50L3poX3ZvbCc6IG5vIHN1Y2ggcG9vbCBhdmFp bGFibGUKIyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMK Cltyb290QGp1aWN5XSB+IyB6cG9vbCBpbXBvcnQgLWYgLW8gcmVhZG9ubHk9b24gemhfdm9s CiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKY2Fu bm90IGltcG9ydCAnemhfdm9sJzogYSBwb29sIHdpdGggdGhhdCBuYW1lIGFscmVhZHkgZXhp c3RzCnVzZSB0aGUgZm9ybSAnenBvb2wgaW1wb3J0IDxwb29sIHwgaWQ+IDxuZXdwb29sPicg dG8gZ2l2ZSBpdCBhIG5ldyBuYW1lCiMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9VVC0t Ly8jIyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0gfiMgenBvb2wgaW1wb3J0IC1mIC1vIHJl YWRvbmx5PW9uIHpoX3ZvbCBuZXdwb29sCiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RE T1VULS0vLyMjIyMjIyMjIyMjIyMKY2Fubm90IGltcG9ydCAnemhfdm9sJyBhcyAnbmV3cG9v bCc6IEkvTyBlcnJvcgoJRGVzdHJveSBhbmQgcmUtY3JlYXRlIHRoZSBwb29sIGZyb20KCWEg YmFja3VwIHNvdXJjZS4KCSMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9VVC0tLy8jIyMj IyMjIyMjIyMjCgpbcm9vdEBqdWljeV0gfiMgemRiIC1laCB6aF92b2wKIyMjIyMjIyMjIyMj Iy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwp6aF92b2wKICAgICAgICB2 ZGV2X2NoaWxkcmVuOiAxCiAgICAgICAgdmVyc2lvbjogNTAwMAogICAgICAgIHBvb2xfZ3Vp ZDogMjkxODY3MDEyMTA1OTAwMDY0NAogICAgICAgIG5hbWU6ICd6aF92b2wnCiAgICAgICAg c3RhdGU6IDAKICAgICAgICBob3N0aWQ6IDE4MDI5ODc3MTAKICAgICAgICBob3N0bmFtZTog J2p1aWN5LnpoZWxhbmEubG9jYWwnCiAgICAgICAgdmRldl90cmVlOgogICAgICAgICAgICB0 eXBlOiAncm9vdCcKICAgICAgICAgICAgaWQ6IDAKICAgICAgICAgICAgZ3VpZDogMjkxODY3 MDEyMTA1OTAwMDY0NAogICAgICAgICAgICBjaGlsZHJlblswXToKICAgICAgICAgICAgICAg IHR5cGU6ICdyYWlkeicKICAgICAgICAgICAgICAgIGlkOiAwCiAgICAgICAgICAgICAgICBn dWlkOiAxNDEyMzQ0MDk5MzU4Nzk5MTA4OAogICAgICAgICAgICAgICAgbnBhcml0eTogMQog ICAgICAgICAgICAgICAgbWV0YXNsYWJfYXJyYXk6IDM0CiAgICAgICAgICAgICAgICBtZXRh c2xhYl9zaGlmdDogMzYKICAgICAgICAgICAgICAgIGFzaGlmdDogMTIKICAgICAgICAgICAg ICAgIGFzaXplOiA4OTk1MzIxNjc1Nzc2CiAgICAgICAgICAgICAgICBpc19sb2c6IDAKICAg ICAgICAgICAgICAgIGNyZWF0ZV90eGc6IDQKICAgICAgICAgICAgICAgIGNoaWxkcmVuWzBd OgogICAgICAgICAgICAgICAgICAgIHR5cGU6ICdkaXNrJwogICAgICAgICAgICAgICAgICAg IGlkOiAwCiAgICAgICAgICAgICAgICAgICAgZ3VpZDogMTc2MjQwMjA0NTA4MDQ3NDE0MDEK ICAgICAgICAgICAgICAgICAgICBwYXRoOiAnL2Rldi9ncHRpZC82ZTVjZWEyNy03ZjUyLTEx ZTMtOWNkOC1kNDNkN2VkNWI1ODcnCiAgICAgICAgICAgICAgICAgICAgd2hvbGVfZGlzazog MQogICAgICAgICAgICAgICAgICAgIERUTDogMTM3CiAgICAgICAgICAgICAgICAgICAgY3Jl YXRlX3R4ZzogNAogICAgICAgICAgICAgICAgY2hpbGRyZW5bMV06CiAgICAgICAgICAgICAg ICAgICAgdHlwZTogJ2Rpc2snCiAgICAgICAgICAgICAgICAgICAgaWQ6IDEKICAgICAgICAg ICAgICAgICAgICBndWlkOiAzMjUzMjk5MDY3NTM3Mjg3NDI4CiAgICAgICAgICAgICAgICAg ICAgd2hvbGVfZGlzazogMQogICAgICAgICAgICAgICAgICAgIERUTDogMTMzCiAgICAgICAg ICAgICAgICAgICAgY3JlYXRlX3R4ZzogNAogICAgICAgICAgICAgICAgICAgIHBhdGg6ICcv ZGV2L2dwdGlkLzJiNzBkOWMwLThlNDAtMTFlMy1hYTFjLWQ0M2Q3ZWQ1YjU4NycKICAgICAg ICAgICAgICAgIGNoaWxkcmVuWzJdOgogICAgICAgICAgICAgICAgICAgIHR5cGU6ICdkaXNr JwogICAgICAgICAgICAgICAgICAgIGlkOiAyCiAgICAgICAgICAgICAgICAgICAgZ3VpZDog MTc5OTk1MjQ0MTgwMTU5NjMyNTgKICAgICAgICAgICAgICAgICAgICB3aG9sZV9kaXNrOiAx CiAgICAgICAgICAgICAgICAgICAgRFRMOiAxMzQKICAgICAgICAgICAgICAgICAgICBjcmVh dGVfdHhnOiA0CiAgICAgICAgICAgICAgICAgICAgcGF0aDogJy9kZXYvZ3B0aWQvNWRhY2Q3 MzctMThhYy0xMWU2LTljMjUtMDAxYjc4NTliOTNlJwp6aF92b2wKICAgICAgICB2ZGV2X2No aWxkcmVuOiAxCiAgICAgICAgdmVyc2lvbjogNTAwMAogICAgICAgIHBvb2xfZ3VpZDogMTAx NDk2NTQzNDc1MDcyNDQ3NDIKICAgICAgICBuYW1lOiAnemhfdm9sJwogICAgICAgIHN0YXRl OiAwCiAgICAgICAgaG9zdGlkOiAxODAyOTg3NzEwCiAgICAgICAgaG9zdG5hbWU6ICdqdWlj eS56aGVsYW5hLmxvY2FsJwogICAgICAgIHZkZXZfdHJlZToKICAgICAgICAgICAgdHlwZTog J3Jvb3QnCiAgICAgICAgICAgIGlkOiAwCiAgICAgICAgICAgIGd1aWQ6IDEwMTQ5NjU0MzQ3 NTA3MjQ0NzQyCiAgICAgICAgICAgIGNoaWxkcmVuWzBdOgogICAgICAgICAgICAgICAgdHlw ZTogJ2Rpc2snCiAgICAgICAgICAgICAgICBpZDogMAogICAgICAgICAgICAgICAgZ3VpZDog NTg5MjUwODMzNDY5MTQ5NTM4NAogICAgICAgICAgICAgICAgd2hvbGVfZGlzazogMQogICAg ICAgICAgICAgICAgbWV0YXNsYWJfYXJyYXk6IDMzCiAgICAgICAgICAgICAgICBtZXRhc2xh Yl9zaGlmdDogMjMKICAgICAgICAgICAgICAgIGFzaGlmdDogMTIKICAgICAgICAgICAgICAg IGFzaXplOiA5ODM1NjQyODgKICAgICAgICAgICAgICAgIGlzX2xvZzogMAogICAgICAgICAg ICAgICAgY3JlYXRlX3R4ZzogNAogICAgICAgICAgICAgICAgcGF0aDogJy9kZXYvYWRhMHMy Jwp6ZGI6IAlNYXRjaGVkIDIgcG9vbHMgLSB1c2UgcG9vbCBHVUlEIGluc3RlYWQgb2YgcG9v bCBuYW1lIG9yIAoJcG9vbCBuYW1lIHBhcnQgb2YgYSBkYXRhc2V0IG5hbWUgdG8gc2VsZWN0 IHBvb2wKCSMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMj Cgpbcm9vdEBqdWljeV0gfiMgenBvb2wgc3RhdHVzCiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQg T0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKICBwb29sOiB6aF92b2wKIHN0YXRlOiBPTkxJ TkUKICBzY2FuOiBub25lIHJlcXVlc3RlZApjb25maWc6CgoJTkFNRSAgICAgICAgU1RBVEUg ICAgIFJFQUQgV1JJVEUgQ0tTVU0KCXpoX3ZvbCAgICAgIE9OTElORSAgICAgICAwICAgICAw ICAgICAwCgkgIGFkYTBzMiAgICBPTkxJTkUgICAgICAgMCAgICAgMCAgICAgMAoKZXJyb3Jz OiBObyBrbm93biBkYXRhIGVycm9ycwojIyMjIyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQt LS8vIyMjIyMjIyMjIyMjIwoKW3Jvb3RAanVpY3ldIH4jIHpwb29sIGFkZCB6aF92b2wgL2Rl di9hZGExczIKIyMjIyMjIyMjIyMjIy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMj IyMjIwpjYW5ub3Qgb3BlbiAnL2Rldi9hZGExczInOiBObyBzdWNoIGZpbGUgb3IgZGlyZWN0 b3J5CiMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCgpb cm9vdEBqdWljeV0gfiMgenBvb2wgYWRkIHpoX3ZvbCAvZGV2L2FkYTJzMgojIyMjIyMjIyMj IyMjLy8tLVNUQVJUIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCmNhbm5vdCBvcGVuICcv ZGV2L2FkYTJzMic6IE5vIHN1Y2ggZmlsZSBvciBkaXJlY3RvcnkKIyMjIyMjIyMjIyMjIy8v LS1FTkQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290QGp1aWN5XSB+IyB6cG9v bCBhZGQgemhfdm9sIGFkYTFzMgojIyMjIyMjIyMjIyMjLy8tLVNUQVJUIE9GIFNURE9VVC0t Ly8jIyMjIyMjIyMjIyMjCmNhbm5vdCBvcGVuICdhZGExczInOiBubyBzdWNoIEdFT00gcHJv dmlkZXIKbXVzdCBiZSBhIGZ1bGwgcGF0aCBvciBzaG9ydGhhbmQgZGV2aWNlIG5hbWUKIyMj IyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290QGp1 aWN5XSB+IyB6cG9vbCBhZGQgemhfdm9sIC9kZXYvYWRhMnMyCiMjIyMjIyMjIyMjIyMvLy0t U1RBUlQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKY2Fubm90IG9wZW4gJy9kZXYvYWRh MnMyJzogTm8gc3VjaCBmaWxlIG9yIGRpcmVjdG9yeQojIyMjIyMjIyMjIyMjLy8tLUVORCBP RiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwoKW3Jvb3RAanVpY3ldIH4jIHpwb29sIGFkZCB6 aF92b2wgL2Rldi9hZGEyCiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMj IyMjIyMjIyMjIyMKYWRhMiUgICAgICAgYWRhMnAxJSAgICAgYWRhMnAxLmVsaSUgYWRhMnAy JSAgICAgCiMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMj Cgpbcm9vdEBqdWljeV0gfiMgenBvb2wgYWRkIHpoX3ZvbCAvZGV2L2FkYTJwMgojIyMjIyMj IyMjIyMjLy8tLVNUQVJUIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCiMjIyMjIyMjIyMj IyMvLy0tRU5EIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0gfiMg enBvb2wgc3RhdHVzCiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMj IyMjIyMjIyMKICBwb29sOiB6aF92b2wKIHN0YXRlOiBPTkxJTkUKICBzY2FuOiBub25lIHJl cXVlc3RlZApjb25maWc6CgoJTkFNRSAgICAgICAgU1RBVEUgICAgIFJFQUQgV1JJVEUgQ0tT VU0KCXpoX3ZvbCAgICAgIE9OTElORSAgICAgICAwICAgICAwICAgICAwCgkgIGFkYTBzMiAg ICBPTkxJTkUgICAgICAgMCAgICAgMCAgICAgMAoJICBhZGEycDIgICAgT05MSU5FICAgICAg IDAgICAgIDAgICAgIDAKCmVycm9yczogTm8ga25vd24gZGF0YSBlcnJvcnMKIyMjIyMjIyMj IyMjIy8vLS1FTkQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290QGp1aWN5XSB+ IyB6cG9vbCBhZGQgemhfdm9sIC9kZXYvYWRhMXAyCiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQg T0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKaW52YWxpZCB2ZGV2IHNwZWNpZmljYXRpb24K dXNlICctZicgdG8gb3ZlcnJpZGUgdGhlIGZvbGxvd2luZyBlcnJvcnM6Ci9kZXYvYWRhMXAy IGlzIHBhcnQgb2YgcG90ZW50aWFsbHkgYWN0aXZlIHBvb2wgJ3poX3ZvbCcKIyMjIyMjIyMj IyMjIy8vLS1FTkQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290QGp1aWN5XSB+ IyB6cG9vbCBzdGF0dXMKIyMjIyMjIyMjIyMjIy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMj IyMjIyMjIyMjIwogIHBvb2w6IHpoX3ZvbAogc3RhdGU6IE9OTElORQogIHNjYW46IG5vbmUg cmVxdWVzdGVkCmNvbmZpZzoKCglOQU1FICAgICAgICBTVEFURSAgICAgUkVBRCBXUklURSBD S1NVTQoJemhfdm9sICAgICAgT05MSU5FICAgICAgIDAgICAgIDAgICAgIDAKCSAgYWRhMHMy ICAgIE9OTElORSAgICAgICAwICAgICAwICAgICAwCgkgIGFkYTJwMiAgICBPTkxJTkUgICAg ICAgMCAgICAgMCAgICAgMAoKZXJyb3JzOiBObyBrbm93biBkYXRhIGVycm9ycwojIyMjIyMj IyMjIyMjLy8tLUVORCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwoKCgpbcm9vdEBqdWlj eV0gfiMgenBvb2wgaGlzdG9yeSB6aF92b2wKIyMjIyMjIyMjIyMjIy8vLS1TVEFSVCBPRiBT VERPVVQtLS8vIyMjIyMjIyMjIyMjIwpIaXN0b3J5IGZvciAnemhfdm9sJwoyMDE2LTA1LTEz LjE2OjU5OjQ0IHpwb29sIGFkZCB6aF92b2wgL2Rldi9hZGEycDIKCiMjIyMjIyMjIyMjIyMv Ly0tRU5EIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0gfiMgenBv b2wgaW1wb3J0IC1mIC1vIHJlYWRvbmx5PW9uIHpoX3ZvbCAKIyMjIyMjIyMjIyMjIy8vLS1T VEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwpjYW5ub3QgaW1wb3J0ICd6aF92b2wn OiBhIHBvb2wgd2l0aCB0aGF0IG5hbWUgYWxyZWFkeSBleGlzdHMKdXNlIHRoZSBmb3JtICd6 cG9vbCBpbXBvcnQgPHBvb2wgfCBpZD4gPG5ld3Bvb2w+JyB0byBnaXZlIGl0IGEgbmV3IG5h bWUKIyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKClty b290QGp1aWN5XSB+IyB6cG9vbCBpbXBvcnQgLWYgemhfdm9sCiMjIyMjIyMjIyMjIyMvLy0t U1RBUlQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKY2Fubm90IGltcG9ydCAnemhfdm9s JzogYSBwb29sIHdpdGggdGhhdCBuYW1lIGFscmVhZHkgZXhpc3RzCnVzZSB0aGUgZm9ybSAn enBvb2wgaW1wb3J0IDxwb29sIHwgaWQ+IDxuZXdwb29sPicgdG8gZ2l2ZSBpdCBhIG5ldyBu YW1lCiMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCgpb cm9vdEBqdWljeV0gfiMgemRiCiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0v LyMjIyMjIyMjIyMjIyMKemhfdm9sOgogICAgdmVyc2lvbjogNTAwMAogICAgbmFtZTogJ3po X3ZvbCcKICAgIHN0YXRlOiAwCiAgICB0eGc6IDE0OTEKICAgIHBvb2xfZ3VpZDogMTAxNDk2 NTQzNDc1MDcyNDQ3NDIKICAgIGhvc3RpZDogMTgwMjk4NzcxMAogICAgaG9zdG5hbWU6ICdq dWljeS56aGVsYW5hLmxvY2FsJwogICAgdmRldl9jaGlsZHJlbjogMgogICAgdmRldl90cmVl OgogICAgICAgIHR5cGU6ICdyb290JwogICAgICAgIGlkOiAwCiAgICAgICAgZ3VpZDogMTAx NDk2NTQzNDc1MDcyNDQ3NDIKICAgICAgICBjcmVhdGVfdHhnOiA0CiAgICAgICAgY2hpbGRy ZW5bMF06CiAgICAgICAgICAgIHR5cGU6ICdkaXNrJwogICAgICAgICAgICBpZDogMAogICAg ICAgICAgICBndWlkOiA1ODkyNTA4MzM0NjkxNDk1Mzg0CiAgICAgICAgICAgIHBhdGg6ICcv ZGV2L2FkYTBzMicKICAgICAgICAgICAgd2hvbGVfZGlzazogMQogICAgICAgICAgICBtZXRh c2xhYl9hcnJheTogMzMKICAgICAgICAgICAgbWV0YXNsYWJfc2hpZnQ6IDIzCiAgICAgICAg ICAgIGFzaGlmdDogMTIKICAgICAgICAgICAgYXNpemU6IDk4MzU2NDI4OAogICAgICAgICAg ICBpc19sb2c6IDAKICAgICAgICAgICAgY3JlYXRlX3R4ZzogNAogICAgICAgIGNoaWxkcmVu WzFdOgogICAgICAgICAgICB0eXBlOiAnZGlzaycKICAgICAgICAgICAgaWQ6IDEKICAgICAg ICAgICAgZ3VpZDogMjk2NjY5NDMwNzc4Njk3OTM3CiAgICAgICAgICAgIHBhdGg6ICcvZGV2 L2FkYTJwMicKICAgICAgICAgICAgd2hvbGVfZGlzazogMQogICAgICAgICAgICBtZXRhc2xh Yl9hcnJheTogMzcKICAgICAgICAgICAgbWV0YXNsYWJfc2hpZnQ6IDM0CiAgICAgICAgICAg IGFzaGlmdDogMTIKICAgICAgICAgICAgYXNpemU6IDI5OTczNjY4MTY3NjgKICAgICAgICAg ICAgaXNfbG9nOiAwCiAgICAgICAgICAgIGNyZWF0ZV90eGc6IDE0ODkKICAgIGZlYXR1cmVz X2Zvcl9yZWFkOgogICAgIyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VULS0vLyMjIyMj IyMjIyMjIyMKCltyb290QGp1aWN5XSB+IyB6CiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0Yg U1RET1VULS0vLyMjIyMjIyMjIyMjIyMKemNhdCAgICAgICAgICB6ZHVtcCAgICAgICAgIHpm cyAgICAgICAgICAgemljICAgICAgICAgICB6bW9yZSAgICAgICAgIHp0ZXN0ICAgICAgICAg CnpjbXAgICAgICAgICAgemVncmVwICAgICAgICB6ZnNfcmV2ZXJ0LnB5IHppbHN0YXQgICAg ICAgem5ldyAgICAgICAgICB6enogICAgICAgICAgIAp6ZGIgICAgICAgICAgIHpmZ3JlcCAg ICAgICAgemdyZXAgICAgICAgICB6aW5qZWN0ICAgICAgIHpwb29sICAgICAgICAgCnpkaWZm ICAgICAgICAgemZvcmNlICAgICAgICB6aGFjayAgICAgICAgIHpsZXNzICAgICAgICAgenN0 cmVhbWR1bXAgICAKIyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VULS0vLyMjIyMjIyMj IyMjIyMKCgpbcm9vdEBqdWljeV0gfiMgemZzIGdldCBtb3VudHBvaW50IHBvb2wvZmlsZXN5 c3RlbQojIyMjIyMjIyMjIyMjLy8tLVNUQVJUIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMj CmNhbm5vdCBvcGVuICdwb29sL2ZpbGVzeXN0ZW0nOiBkYXRhc2V0IGRvZXMgbm90IGV4aXN0 CiMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCgpbcm9v dEBqdWljeV0gfiMgemZzIGdldCBtb3VudHBvaW50IHpoX3ZvbAojIyMjIyMjIyMjIyMjLy8t LVNUQVJUIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCk5BTUUgICAgUFJPUEVSVFkgICAg VkFMVUUgICAgICAgU09VUkNFCnpoX3ZvbCAgbW91bnRwb2ludCAgL3poX3ZvbCAgICAgZGVm YXVsdAojIyMjIyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwoK Cltyb290QGp1aWN5XSB+IyBscyAvbW50LwojIyMjIyMjIyMjIyMjLy8tLVNUQVJUIE9GIFNU RE9VVC0tLy8jIyMjIyMjIyMjIyMjCi4vICAgICAgIC4uLyAgICAgIC5zbmFwLyAgIG1kX3Np emUgIHpoX3ZvbC8KIyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VULS0vLyMjIyMjIyMj IyMjIyMKCltyb290QGp1aWN5XSB+IyBscyAvbW50L3poX3ZvbC8KIyMjIyMjIyMjIyMjIy8v LS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwouLyAgLi4vCiMjIyMjIyMjIyMj IyMvLy0tRU5EIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0gfiMg ZGYgLWgKIyMjIyMjIyMjIyMjIy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMj IwpGaWxlc3lzdGVtICAgICAgICAgICAgIFNpemUgICAgVXNlZCAgIEF2YWlsIENhcGFjaXR5 ICBNb3VudGVkIG9uCi9kZXYvdWZzL0ZyZWVOQVNzMWEgICAgOTI2TSAgICA1OTZNICAgIDI1 NU0gICAgNzAlICAgIC8KZGV2ZnMgICAgICAgICAgICAgICAgICAxLjBrICAgIDEuMGsgICAg ICAwQiAgIDEwMCUgICAgL2RldgovZGV2L21kMCAgICAgICAgICAgICAgIDQuNk0gICAgMy43 TSAgICA0ODVrICAgIDg5JSAgICAvZXRjCi9kZXYvbWQxICAgICAgICAgICAgICAgODIzayAg ICAyLjBrICAgIDc1NmsgICAgIDAlICAgIC9tbnQKL2Rldi9tZDIgICAgICAgICAgICAgICAy LjNHICAgICAyNE0gICAgMi4xRyAgICAgMSUgICAgL3ZhcgovZGV2L3Vmcy9GcmVlTkFTczQg ICAgICAxOU0gICAgICAyTSAgICAgMTZNICAgIDExJSAgICAvZGF0YQojIyMjIyMjIyMjIyMj Ly8tLUVORCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwoKW3Jvb3RAanVpY3ldIH4jIGxz IC9kZXYvdWZzL0ZyZWVOQVNzNAojIyMjIyMjIyMjIyMjLy8tLVNUQVJUIE9GIFNURE9VVC0t Ly8jIyMjIyMjIyMjIyMjCi9kZXYvdWZzL0ZyZWVOQVNzNAojIyMjIyMjIyMjIyMjLy8tLUVO RCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwoKW3Jvb3RAanVpY3ldIH4jIGxzIC1hIC9k ZXYvdWZzL0ZyZWVOQVNzNAojIyMjIyMjIyMjIyMjLy8tLVNUQVJUIE9GIFNURE9VVC0tLy8j IyMjIyMjIyMjIyMjCi9kZXYvdWZzL0ZyZWVOQVNzNAojIyMjIyMjIyMjIyMjLy8tLUVORCBP RiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwoKW3Jvb3RAanVpY3ldIH4jIGxlc3MgL2Rldi91 ZnMvRnJlZU5BU3M0CiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMj IyMjIyMjIyMKL2Rldi91ZnMvRnJlZU5BU3M0IGlzIG5vdCBhIHJlZ3VsYXIgZmlsZSAodXNl IC1mIHRvIHNlZSBpdCkKIyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VULS0vLyMjIyMj IyMjIyMjIyMKCltyb290QGp1aWN5XSB+IyBscyAvZGF0YQojIyMjIyMjIyMjIyMjLy8tLVNU QVJUIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCi4vICAgICAgICAgICAgICAgLnNuYXAv ICAgICAgICAgICBmYWN0b3J5LXYxLmRiICAgIHJyZF9kaXIudGFyLmJ6MiAgemZzLwouLi8g ICAgICAgICAgICAgIGNyYXNoLyAgICAgICAgICAgZnJlZW5hcy12MS5kYiAgICBzc2gvCiMj IyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCgpbcm9vdEBq dWljeV0gfiMgbHMgL2RhdGEvemZzLwojIyMjIyMjIyMjIyMjLy8tLVNUQVJUIE9GIFNURE9V VC0tLy8jIyMjIyMjIyMjIyMjCi4vICAgICAgICAgICAgICAgICAuLi8gICAgICAgICAgICAg ICAgenBvb2wuY2FjaGUgICAgICAgIHpwb29sLmNhY2hlLnNhdmVkCiMjIyMjIyMjIyMjIyMv Ly0tRU5EIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0gfiMgbHMg LWwgL2RhdGEvemZzLwojIyMjIyMjIyMjIyMjLy8tLVNUQVJUIE9GIFNURE9VVC0tLy8jIyMj IyMjIyMjIyMjCnRvdGFsIDUKZHJ3eHIteHIteCAgMiByb290ICB3aGVlbCAgIDUxMiBNYXkg MTMgMTU6MDAgLi8KZHJ3eHIteHIteCAgNiByb290ICB3aGVlbCAgIDUxMiBNYXkgMTMgMTc6 MDAgLi4vCi1ydy1yLS1yLS0gIDEgcm9vdCAgd2hlZWwgIDE5NDAgQXByIDE0IDIzOjA5IHpw b29sLmNhY2hlCi1ydy1yLS1yLS0gIDEgcm9vdCAgd2hlZWwgIDE5NDAgTWF5IDEzIDE1OjAw IHpwb29sLmNhY2hlLnNhdmVkCiMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9VVC0tLy8j IyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0gfiMgY3AgL2RhdGEvemZzL3pwb29sLmNhY2hl IC9kYXRhL3pmcy96cG9vbC5jYWNoZS5FUzAwMQojIyMjIyMjIyMjIyMjLy8tLVNUQVJUIE9G IFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCiMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9V VC0tLy8jIyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0gfiMgY3AgL2RhdGEvemZzL3pwb29s LmNhY2hlLnNhdmVkICAvZGF0YS96ZnMvenBvb2wuY2FjaGUuc2F2ZWQuRVMwMDEKIyMjIyMj IyMjIyMjIy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwojIyMjIyMjIyMj IyMjLy8tLUVORCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwoKW3Jvb3RAanVpY3ldIH4j IHpmcyBtb3VudAojIyMjIyMjIyMjIyMjLy8tLVNUQVJUIE9GIFNURE9VVC0tLy8jIyMjIyMj IyMjIyMjCiMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMj Cgpbcm9vdEBqdWljeV0gfiMgbW91bnQKIyMjIyMjIyMjIyMjIy8vLS1TVEFSVCBPRiBTVERP VVQtLS8vIyMjIyMjIyMjIyMjIwovZGV2L3Vmcy9GcmVlTkFTczFhIG9uIC8gKHVmcywgbG9j YWwsIHNvZnQtdXBkYXRlcykKZGV2ZnMgb24gL2RldiAoZGV2ZnMsIGxvY2FsLCBtdWx0aWxh YmVsKQovZGV2L21kMCBvbiAvZXRjICh1ZnMsIGxvY2FsKQovZGV2L21kMSBvbiAvbW50ICh1 ZnMsIGxvY2FsKQovZGV2L21kMiBvbiAvdmFyICh1ZnMsIGxvY2FsKQovZGV2L3Vmcy9GcmVl TkFTczQgb24gL2RhdGEgKHVmcywgbG9jYWwsIG5vYXRpbWUsIHNvZnQtdXBkYXRlcykKIyMj IyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290QGp1 aWN5XSB+IyB6ZGIKIyMjIyMjIyMjIyMjIy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMj IyMjIyMjIwp6aF92b2w6CiAgICB2ZXJzaW9uOiA1MDAwCiAgICBuYW1lOiAnemhfdm9sJwog ICAgc3RhdGU6IDAKICAgIHR4ZzogMTQ5MQogICAgcG9vbF9ndWlkOiAxMDE0OTY1NDM0NzUw NzI0NDc0MgogICAgaG9zdGlkOiAxODAyOTg3NzEwCiAgICBob3N0bmFtZTogJ2p1aWN5Lnpo ZWxhbmEubG9jYWwnCiAgICB2ZGV2X2NoaWxkcmVuOiAyCiAgICB2ZGV2X3RyZWU6CiAgICAg ICAgdHlwZTogJ3Jvb3QnCiAgICAgICAgaWQ6IDAKICAgICAgICBndWlkOiAxMDE0OTY1NDM0 NzUwNzI0NDc0MgogICAgICAgIGNyZWF0ZV90eGc6IDQKICAgICAgICBjaGlsZHJlblswXToK ICAgICAgICAgICAgdHlwZTogJ2Rpc2snCiAgICAgICAgICAgIGlkOiAwCiAgICAgICAgICAg IGd1aWQ6IDU4OTI1MDgzMzQ2OTE0OTUzODQKICAgICAgICAgICAgcGF0aDogJy9kZXYvYWRh MHMyJwogICAgICAgICAgICB3aG9sZV9kaXNrOiAxCiAgICAgICAgICAgIG1ldGFzbGFiX2Fy cmF5OiAzMwogICAgICAgICAgICBtZXRhc2xhYl9zaGlmdDogMjMKICAgICAgICAgICAgYXNo aWZ0OiAxMgogICAgICAgICAgICBhc2l6ZTogOTgzNTY0Mjg4CiAgICAgICAgICAgIGlzX2xv ZzogMAogICAgICAgICAgICBjcmVhdGVfdHhnOiA0CiAgICAgICAgY2hpbGRyZW5bMV06CiAg ICAgICAgICAgIHR5cGU6ICdkaXNrJwogICAgICAgICAgICBpZDogMQogICAgICAgICAgICBn dWlkOiAyOTY2Njk0MzA3Nzg2OTc5MzcKICAgICAgICAgICAgcGF0aDogJy9kZXYvYWRhMnAy JwogICAgICAgICAgICB3aG9sZV9kaXNrOiAxCiAgICAgICAgICAgIG1ldGFzbGFiX2FycmF5 OiAzNwogICAgICAgICAgICBtZXRhc2xhYl9zaGlmdDogMzQKICAgICAgICAgICAgYXNoaWZ0 OiAxMgogICAgICAgICAgICBhc2l6ZTogMjk5NzM2NjgxNjc2OAogICAgICAgICAgICBpc19s b2c6IDAKICAgICAgICAgICAgY3JlYXRlX3R4ZzogMTQ4OQogICAgZmVhdHVyZXNfZm9yX3Jl YWQ6CiAgICAjIyMjIyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMj IwoKW3Jvb3RAanVpY3ldIH4jIHpkYiAtZSB6aF92b2wgfCBncmVwIHR4ZwojIyMjIyMjIyMj IyMjLy8tLVNUQVJUIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCnpkYjogCU1hdGNoZWQg MiBwb29scyAtIHVzZSBwb29sIEdVSUQgaW5zdGVhZCBvZiBwb29sIG5hbWUgb3IgCglwb29s IG5hbWUgcGFydCBvZiBhIGRhdGFzZXQgbmFtZSB0byBzZWxlY3QgcG9vbAogICAgICAgICAg ICAgICAgY3JlYXRlX3R4ZzogNAogICAgICAgICAgICAgICAgICAgIGNyZWF0ZV90eGc6IDQK ICAgICAgICAgICAgICAgICAgICBjcmVhdGVfdHhnOiA0CiAgICAgICAgICAgICAgICAgICAg Y3JlYXRlX3R4ZzogNAogICAgICAgICAgICAgICAgY3JlYXRlX3R4ZzogNAogICAgICAgICAg ICAgICAgY3JlYXRlX3R4ZzogMTQ4OQojIyMjIyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQt LS8vIyMjIyMjIyMjIyMjIwoKW3Jvb3RAanVpY3ldIH4jIHpwb29sIHJlbW92ZSB6aF92b2wg L2Rldi9hZGExcDIKIyMjIyMjIyMjIyMjIy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMj IyMjIyMjIwpjYW5ub3QgcmVtb3ZlIC9kZXYvYWRhMXAyOiBubyBzdWNoIGRldmljZSBpbiBw b29sCiMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCgpb cm9vdEBqdWljeV0gfiMgenBvb2wgcmVtb3ZlIHpoX3ZvbCAvZGV2L2FkYTFwCiMjIyMjIyMj IyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKYWRhMXAxJSAgICAg YWRhMXAxLmVsaSUgYWRhMXAyJSAgICAgCiMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9V VC0tLy8jIyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0gfiMgenBvb2wgcmVtb3ZlIHpoX3Zv bCAvZGV2L2FkYTFwCiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMj IyMjIyMjIyMKYWRhMXAxJSAgICAgYWRhMXAxLmVsaSUgYWRhMXAyJSAgICAgCiMjIyMjIyMj IyMjIyMvLy0tRU5EIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0g fiMgenBvb2wgcmVtb3ZlIHpoX3ZvbCAvZGV2L2FkYTFwMgojIyMjIyMjIyMjIyMjLy8tLVNU QVJUIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCmNhbm5vdCByZW1vdmUgL2Rldi9hZGEx cDI6IG5vIHN1Y2ggZGV2aWNlIGluIHBvb2wKIyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RE T1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290QGp1aWN5XSB+IyB6cG9vbCByZW1vdmUgemhf dm9sIC9kZXYvYWRhMHAyCiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMj IyMjIyMjIyMjIyMKY2Fubm90IHJlbW92ZSAvZGV2L2FkYTBwMjogbm8gc3VjaCBkZXZpY2Ug aW4gcG9vbAojIyMjIyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMj IwoKW3Jvb3RAanVpY3ldIH4jIHpwb29sIHJlbW92ZSB6aF92b2wgL2Rldi9hZGEycDIKIyMj IyMjIyMjIyMjIy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwpjYW5ub3Qg cmVtb3ZlIC9kZXYvYWRhMnAyOiBvbmx5IGluYWN0aXZlIGhvdCBzcGFyZXMsIGNhY2hlLCB0 b3AtbGV2ZWwsIG9yIGxvZyBkZXZpY2VzIGNhbiBiZSByZW1vdmVkCiMjIyMjIyMjIyMjIyMv Ly0tRU5EIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCgpbcm9vdEBqdWljeV0gfiMgenBv b2wgcmVtb3ZlIHpoX3ZvbCAvZGV2L2FkYTFwMgojIyMjIyMjIyMjIyMjLy8tLVNUQVJUIE9G IFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCmNhbm5vdCByZW1vdmUgL2Rldi9hZGExcDI6IG5v IHN1Y2ggZGV2aWNlIGluIHBvb2wKIyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VULS0v LyMjIyMjIyMjIyMjIyMKCltyb290QGp1aWN5XSB+IyB6cG9vbCByZW1vdmUgemhfdm9sIC9k ZXYvYWRhMHAyCiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMjIyMj IyMjIyMKY2Fubm90IHJlbW92ZSAvZGV2L2FkYTBwMjogbm8gc3VjaCBkZXZpY2UgaW4gcG9v bAojIyMjIyMjIyMjIyMjLy8tLUVORCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwoKW3Jv b3RAanVpY3ldIH4jIHpwb29sIHN0YXR1cwojIyMjIyMjIyMjIyMjLy8tLVNUQVJUIE9GIFNU RE9VVC0tLy8jIyMjIyMjIyMjIyMjCiAgcG9vbDogemhfdm9sCiBzdGF0ZTogT05MSU5FCiAg c2Nhbjogbm9uZSByZXF1ZXN0ZWQKY29uZmlnOgoKCU5BTUUgICAgICAgIFNUQVRFICAgICBS RUFEIFdSSVRFIENLU1VNCgl6aF92b2wgICAgICBPTkxJTkUgICAgICAgMCAgICAgMCAgICAg MAoJICBhZGEwczIgICAgT05MSU5FICAgICAgIDAgICAgIDAgICAgIDAKCSAgYWRhMnAyICAg IE9OTElORSAgICAgICAwICAgICAwICAgICAwCgplcnJvcnM6IE5vIGtub3duIGRhdGEgZXJy b3JzCiMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCgoK W3Jvb3RAanVpY3ldIH4jIHpwb29sIGRldGFjaCB6aF92b2wgL2Rldi9hZGEycDIKCiMjIyMj IyMjIyMjIyMvLy0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKY2Fubm90IGRl dGFjaCAvZGV2L2FkYTJwMjogb25seSBhcHBsaWNhYmxlIHRvIG1pcnJvciBhbmQgcmVwbGFj aW5nIHZkZXZzCiMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMj IyMjCgoKW3Jvb3RAanVpY3ldIH4jIHpmcyBnZXQgYWxsCgojIyMjIyMjIyMjIyMjLy8tLVNU QVJUIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCk5BTUUgICAgUFJPUEVSVFkgICAgICAg ICAgICAgIFZBTFVFICAgICAgICAgICAgICAgICAgU09VUkNFCnpoX3ZvbCAgdHlwZSAgICAg ICAgICAgICAgICAgIGZpbGVzeXN0ZW0gICAgICAgICAgICAgLQp6aF92b2wgIGNyZWF0aW9u ICAgICAgICAgICAgICBGcmkgTWF5IDEzIDE1OjM0IDIwMTYgIC0Kemhfdm9sICB1c2VkICAg ICAgICAgICAgICAgICAgNTQwSyAgICAgICAgICAgICAgICAgICAtCnpoX3ZvbCAgYXZhaWxh YmxlICAgICAgICAgICAgIDIuNjhUICAgICAgICAgICAgICAgICAgLQp6aF92b2wgIHJlZmVy ZW5jZWQgICAgICAgICAgICAxNDRLICAgICAgICAgICAgICAgICAgIC0Kemhfdm9sICBjb21w cmVzc3JhdGlvICAgICAgICAgMS4wMHggICAgICAgICAgICAgICAgICAtCnpoX3ZvbCAgbW91 bnRlZCAgICAgICAgICAgICAgIG5vICAgICAgICAgICAgICAgICAgICAgLQp6aF92b2wgIHF1 b3RhICAgICAgICAgICAgICAgICBub25lICAgICAgICAgICAgICAgICAgIGRlZmF1bHQKemhf dm9sICByZXNlcnZhdGlvbiAgICAgICAgICAgbm9uZSAgICAgICAgICAgICAgICAgICBkZWZh dWx0CnpoX3ZvbCAgcmVjb3Jkc2l6ZSAgICAgICAgICAgIDEyOEsgICAgICAgICAgICAgICAg ICAgZGVmYXVsdAp6aF92b2wgIG1vdW50cG9pbnQgICAgICAgICAgICAvemhfdm9sICAgICAg ICAgICAgICAgIGRlZmF1bHQKemhfdm9sICBzaGFyZW5mcyAgICAgICAgICAgICAgb2ZmICAg ICAgICAgICAgICAgICAgICBkZWZhdWx0CnpoX3ZvbCAgY2hlY2tzdW0gICAgICAgICAgICAg IG9uICAgICAgICAgICAgICAgICAgICAgZGVmYXVsdAp6aF92b2wgIGNvbXByZXNzaW9uICAg ICAgICAgICBvZmYgICAgICAgICAgICAgICAgICAgIGRlZmF1bHQKemhfdm9sICBhdGltZSAg ICAgICAgICAgICAgICAgb24gICAgICAgICAgICAgICAgICAgICBkZWZhdWx0CnpoX3ZvbCAg ZGV2aWNlcyAgICAgICAgICAgICAgIG9uICAgICAgICAgICAgICAgICAgICAgZGVmYXVsdAp6 aF92b2wgIGV4ZWMgICAgICAgICAgICAgICAgICBvbiAgICAgICAgICAgICAgICAgICAgIGRl ZmF1bHQKemhfdm9sICBzZXR1aWQgICAgICAgICAgICAgICAgb24gICAgICAgICAgICAgICAg ICAgICBkZWZhdWx0CnpoX3ZvbCAgcmVhZG9ubHkgICAgICAgICAgICAgIG9mZiAgICAgICAg ICAgICAgICAgICAgZGVmYXVsdAp6aF92b2wgIGphaWxlZCAgICAgICAgICAgICAgICBvZmYg ICAgICAgICAgICAgICAgICAgIGRlZmF1bHQKemhfdm9sICBzbmFwZGlyICAgICAgICAgICAg ICAgaGlkZGVuICAgICAgICAgICAgICAgICBkZWZhdWx0CnpoX3ZvbCAgYWNsbW9kZSAgICAg ICAgICAgICAgIGRpc2NhcmQgICAgICAgICAgICAgICAgZGVmYXVsdAp6aF92b2wgIGFjbGlu aGVyaXQgICAgICAgICAgICByZXN0cmljdGVkICAgICAgICAgICAgIGRlZmF1bHQKemhfdm9s ICBjYW5tb3VudCAgICAgICAgICAgICAgb24gICAgICAgICAgICAgICAgICAgICBkZWZhdWx0 CnpoX3ZvbCAgeGF0dHIgICAgICAgICAgICAgICAgIG9uICAgICAgICAgICAgICAgICAgICAg ZGVmYXVsdAp6aF92b2wgIGNvcGllcyAgICAgICAgICAgICAgICAxICAgICAgICAgICAgICAg ICAgICAgIGRlZmF1bHQKemhfdm9sICB2ZXJzaW9uICAgICAgICAgICAgICAgNSAgICAgICAg ICAgICAgICAgICAgICAtCnpoX3ZvbCAgdXRmOG9ubHkgICAgICAgICAgICAgIG9mZiAgICAg ICAgICAgICAgICAgICAgLQp6aF92b2wgIG5vcm1hbGl6YXRpb24gICAgICAgICBub25lICAg ICAgICAgICAgICAgICAgIC0Kemhfdm9sICBjYXNlc2Vuc2l0aXZpdHkgICAgICAgc2Vuc2l0 aXZlICAgICAgICAgICAgICAtCnpoX3ZvbCAgdnNjYW4gICAgICAgICAgICAgICAgIG9mZiAg ICAgICAgICAgICAgICAgICAgZGVmYXVsdAp6aF92b2wgIG5ibWFuZCAgICAgICAgICAgICAg ICBvZmYgICAgICAgICAgICAgICAgICAgIGRlZmF1bHQKemhfdm9sICBzaGFyZXNtYiAgICAg ICAgICAgICAgb2ZmICAgICAgICAgICAgICAgICAgICBkZWZhdWx0CnpoX3ZvbCAgcmVmcXVv dGEgICAgICAgICAgICAgIG5vbmUgICAgICAgICAgICAgICAgICAgZGVmYXVsdAp6aF92b2wg IHJlZnJlc2VydmF0aW9uICAgICAgICBub25lICAgICAgICAgICAgICAgICAgIGRlZmF1bHQK emhfdm9sICBwcmltYXJ5Y2FjaGUgICAgICAgICAgYWxsICAgICAgICAgICAgICAgICAgICBk ZWZhdWx0CnpoX3ZvbCAgc2Vjb25kYXJ5Y2FjaGUgICAgICAgIGFsbCAgICAgICAgICAgICAg ICAgICAgZGVmYXVsdAp6aF92b2wgIHVzZWRieXNuYXBzaG90cyAgICAgICAwICAgICAgICAg ICAgICAgICAgICAgIC0Kemhfdm9sICB1c2VkYnlkYXRhc2V0ICAgICAgICAgMTQ0SyAgICAg ICAgICAgICAgICAgICAtCnpoX3ZvbCAgdXNlZGJ5Y2hpbGRyZW4gICAgICAgIDM5NksgICAg ICAgICAgICAgICAgICAgLQp6aF92b2wgIHVzZWRieXJlZnJlc2VydmF0aW9uICAwICAgICAg ICAgICAgICAgICAgICAgIC0Kemhfdm9sICBsb2diaWFzICAgICAgICAgICAgICAgbGF0ZW5j eSAgICAgICAgICAgICAgICBkZWZhdWx0CnpoX3ZvbCAgZGVkdXAgICAgICAgICAgICAgICAg IG9mZiAgICAgICAgICAgICAgICAgICAgZGVmYXVsdAp6aF92b2wgIG1sc2xhYmVsICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIC0Kemhfdm9sICBzeW5jICAgICAgICAg ICAgICAgICAgc3RhbmRhcmQgICAgICAgICAgICAgICBkZWZhdWx0CnpoX3ZvbCAgcmVmY29t cHJlc3NyYXRpbyAgICAgIDEuMDB4ICAgICAgICAgICAgICAgICAgLQp6aF92b2wgIHdyaXR0 ZW4gICAgICAgICAgICAgICAxNDRLICAgICAgICAgICAgICAgICAgIC0Kemhfdm9sICBsb2dp Y2FsdXNlZCAgICAgICAgICAgMTA0SyAgICAgICAgICAgICAgICAgICAtCnpoX3ZvbCAgbG9n aWNhbHJlZmVyZW5jZWQgICAgIDQzLjVLICAgICAgICAgICAgICAgICAgLQojIyMjIyMjIyMj IyMjLy8tLUVORCBPRiBTVERPVVQtLS8vIyMjIyMjIyMjIyMjIwoKCltyb290QGp1aWN5XSB+ IyB6ZnMgc2V0IG1vdW50cG9pbnQ9L21udC96aF92b2wgemhfdm9sCiMjIyMjIyMjIyMjIyMv Ly0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKIyMjIyMjIyMjIyMjIy8vLS1F TkQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCltyb290QGp1aWN5XSB+IyBscyAvbW50 L3poX3ZvbC8KIyMjIyMjIyMjIyMjIy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMj IyMjIwouLyAgLi4vCiMjIyMjIyMjIyMjIyMvLy0tRU5EIE9GIFNURE9VVC0tLy8jIyMjIyMj IyMjIyMjCgpbcm9vdEBqdWljeV0gfiMgemRiCiMjIyMjIyMjIyMjIyMvLy0tU1RBUlQgT0Yg U1RET1VULS0vLyMjIyMjIyMjIyMjIyMKemhfdm9sOgogICAgdmVyc2lvbjogNTAwMAogICAg bmFtZTogJ3poX3ZvbCcKICAgIHN0YXRlOiAwCiAgICB0eGc6IDE0OTEKICAgIHBvb2xfZ3Vp ZDogMTAxNDk2NTQzNDc1MDcyNDQ3NDIKICAgIGhvc3RpZDogMTgwMjk4NzcxMAogICAgaG9z dG5hbWU6ICdqdWljeS56aGVsYW5hLmxvY2FsJwogICAgdmRldl9jaGlsZHJlbjogMgogICAg dmRldl90cmVlOgogICAgICAgIHR5cGU6ICdyb290JwogICAgICAgIGlkOiAwCiAgICAgICAg Z3VpZDogMTAxNDk2NTQzNDc1MDcyNDQ3NDIKICAgICAgICBjcmVhdGVfdHhnOiA0CiAgICAg ICAgY2hpbGRyZW5bMF06CiAgICAgICAgICAgIHR5cGU6ICdkaXNrJwogICAgICAgICAgICBp ZDogMAogICAgICAgICAgICBndWlkOiA1ODkyNTA4MzM0NjkxNDk1Mzg0CiAgICAgICAgICAg IHBhdGg6ICcvZGV2L2FkYTBzMicKICAgICAgICAgICAgd2hvbGVfZGlzazogMQogICAgICAg ICAgICBtZXRhc2xhYl9hcnJheTogMzMKICAgICAgICAgICAgbWV0YXNsYWJfc2hpZnQ6IDIz CiAgICAgICAgICAgIGFzaGlmdDogMTIKICAgICAgICAgICAgYXNpemU6IDk4MzU2NDI4OAog ICAgICAgICAgICBpc19sb2c6IDAKICAgICAgICAgICAgY3JlYXRlX3R4ZzogNAogICAgICAg IGNoaWxkcmVuWzFdOgogICAgICAgICAgICB0eXBlOiAnZGlzaycKICAgICAgICAgICAgaWQ6 IDEKICAgICAgICAgICAgZ3VpZDogMjk2NjY5NDMwNzc4Njk3OTM3CiAgICAgICAgICAgIHBh dGg6ICcvZGV2L2FkYTJwMicKICAgICAgICAgICAgd2hvbGVfZGlzazogMQogICAgICAgICAg ICBtZXRhc2xhYl9hcnJheTogMzcKICAgICAgICAgICAgbWV0YXNsYWJfc2hpZnQ6IDM0CiAg ICAgICAgICAgIGFzaGlmdDogMTIKICAgICAgICAgICAgYXNpemU6IDI5OTczNjY4MTY3NjgK ICAgICAgICAgICAgaXNfbG9nOiAwCiAgICAgICAgICAgIGNyZWF0ZV90eGc6IDE0ODkKICAg IGZlYXR1cmVzX2Zvcl9yZWFkOgogICAgIyMjIyMjIyMjIyMjIy8vLS1FTkQgT0YgU1RET1VU LS0vLyMjIyMjIyMjIyMjIyMKCltyb290QGp1aWN5XSB+IyBtdW50CiMjIyMjIyMjIyMjIyMv Ly0tU1RBUlQgT0YgU1RET1VULS0vLyMjIyMjIyMjIyMjIyMKCkNPUlJFQ1Q+bW91bnQgKHl8 bnxlfGEpPyB5ZXMKL2Rldi91ZnMvRnJlZU5BU3MxYSBvbiAvICh1ZnMsIGxvY2FsLCBzb2Z0 LXVwZGF0ZXMpCmRldmZzIG9uIC9kZXYgKGRldmZzLCBsb2NhbCwgbXVsdGlsYWJlbCkKL2Rl di9tZDAgb24gL2V0YyAodWZzLCBsb2NhbCkKL2Rldi9tZDEgb24gL21udCAodWZzLCBsb2Nh bCkKL2Rldi9tZDIgb24gL3ZhciAodWZzLCBsb2NhbCkKL2Rldi91ZnMvRnJlZU5BU3M0IG9u IC9kYXRhICh1ZnMsIGxvY2FsLCBub2F0aW1lLCBzb2Z0LXVwZGF0ZXMpCiMjIyMjIyMjIyMj IyMvLy0tRU5EIE9GIFNURE9VVC0tLy8jIyMjIyMjIyMjIyMjCgoKW3Jvb3RAanVpY3ldIH4j IHJlYm9vdAoKIyMjIyMjIyMjIyMjIy8vLS1TVEFSVCBPRiBTVERPVVQtLS8vIyMjIyMjIyMj IyMjIwoKMzUyICAxMjo1MCAgIHpwb29sIGhpc3RvcnkKMzUzICAxMjo1MSAgIHpkYgozNTQg IDEyOjUxICAgenBvb2wgY3JlYXRlCjM1NSAgMTI6NTUgICBtb3VudCAtdXcgLwozNTYgIDEy OjU1ICAgenBvb2wgaGlzdG9yeQozNTcgIDEyOjU1ICAgenBvb2wgaGlzdG9yeSB6aF92b2wK MzU4ICAxMjo1OSAgIHptb3JlCjM1OSAgMTM6MDEgICB6cG9vbCBzdGF0dXMgemhfdm9sCjM2 MCAgMTM6MDEgICB6cG9vbCBzdGF0dXMKMzYxICAxMzowMSAgIHpkYgozNjIgIDEzOjAxICAg emRiIC1kCjM2MyAgMTM6MDEgICB6ZGIgLXUKMzY0ICAxMzowMiAgIHpkYiAtdSB6aF92b2wK MzY1ICAxMzowMiAgIHpkYiAtdSAtZCAvZGV2L3VmcwozNjYgIDEzOjAyICAgemRiIC11IC1k IC9kZXYvdWZzL0ZyZWVOQVNzCjM2NyAgMTM6MDQgICB6ZGIKMzY4ICAxMzowNCAgIHpkYiB6 aF92b2wKMzY5ICAxMzowNSAgIHpkYiAnemhfdm9sJwozNzAgIDEzOjA1ICAgemRiIC1iCjM3 MSAgMTM6MDYgICB6cG9vbAozNzIgIDEzOjA4ICAgenBvb2wgaW1wb3J0CjM3MyAgMTM6Mzcg ICB6cG9vbCAtZiBpbXBvcnQKMzc0ICAxMzozNyAgIHpwb29sIGltcG9ydCAtZiB6aF92b2wK Mzc1ICAxMzozOCAgIHpwb29sIGltcG9ydAozNzYgIDEzOjQxICAgdmkgemZzX3JldmVydC5w eQozNzcgIDEzOjQyICAgY2htb2QgK3ggemZzX3JldmVydC5weQozNzggIDEzOjQyICAgbGwK Mzc5ICAxMzo0NiAgIHpwb29sIGhpc3RvcnkgLWlsIHpoX3ZvbAozODAgIDEzOjQ2ICAgenBv b2wgaGlzdG9yeSAtaWwKMzgxICAxNDowMiAgIGVjaG8gMCA+IC9zeXMvbW9kdWxlL3pmcy9w YXJhbWV0ZXJzL3NwYV9sb2FkX3ZlcmlmeV9tZXRhZGF0YQozODIgIDE0OjAyICAgemRiIC11 IFYxIHwgZ3JlcCB0eGcKMzgzICAxNDowNCAgIHpkYiAtZSB2MSB8IGdyZXAgdHhnCjM4NCAg MTQ6MDQgICB6ZGIgLWUgemhfdm9sIHwgZ3JlcCB0eGcKMzg1ICAxNDowNCAgIHpkYiAtdSB6 aF92b2wgfCBncmVwIHR4ZwozODYgIDE0OjA2ICAgemRiIC0taGVscAozODcgIDE0OjA5ICAg emRiIC11IHpoX3ZvbAozODggIDE0OjA5ICAgemRiIC1lIHpoX3ZvbAozODkgIDE0OjIzICAg emRiIC1lIC1iIHpoX3ZvbAozOTAgIDE0OjI0ICAgemRiIC1lIC1iYmIgemhfdm9sCjM5MSAg MTQ6MjQgICB6ZGIgLWUgLWJiYmJiYiB6aF92b2wKMzkyICAxNDoyNSAgIHpkYiAtZSAtZGRk ZGQgemhfdm9sCjM5MyAgMTQ6MjcgICB6ZGIgLWMgemhfdm9sCjM5NCAgMTQ6MjcgICB6ZGIg LWUgemhfdm9sIC1jCjM5NSAgMTQ6MjcgICBscyAvZXRjL3pmcy8KMzk2ICAxNDoyNyAgIGxz IC9ldGMvemZzL2Nhc2VzLwozOTcgIDE0OjI3ICAgbHMgL2V0Yy96ZnMvZXhwb3J0cwozOTgg IDE0OjI4ICAgbGVzcyAvZXRjL3pmcy9leHBvcnRzCjM5OSAgMTQ6MjggICBtYwo0MDAgIDE0 OjI4ICAgbHMgL3Zhci8KNDAxICAxNDoyOCAgIGxzIC92YXIvZGIvCjQwMiAgMTQ6MzAgICB6 ZGIgLWgKNDAzICAxNDozMCAgIHpkYiAtaCAtZSB6aF92b2wKNDA0ICAxNDozMiAgIHpwb29s IGltcG9ydCAtRiB6aF92b2wKNDA1ICAxNDozOCAgIHpwb29sIGltcG9ydCAtRiB6aF92b2wK NDA2ICAxNDozOCAgIHpkYiAtaAo0MDcgIDE0OjM5ICAgemRiIC1oIC1lIHpoX3ZvbAo0MDgg IDE0OjM5ICAgemRiIC1lIHpoX3ZvbAo0MDkgIDE0OjQwICAgY2FtY29udHJvbCBkZXZsaXN0 CjQxMCAgMTQ6NTQgICBjYW1jb250cm9sIGRldmxpc3QKNDExICAxNDo1NSAgIHpwb29sIGxp c3QKNDEyICAxNDo1NSAgIHpwb29sIGltcG9ydCAtRiB6aF92b2wKNDEzICAxNDo1NiAgIHpk YiAtZSB6aF92b2wKNDE0ICAxNDo1NiAgIHJlYm9vdAo0MTUgIDE1OjA0ICAgenBvb2wgaW1w b3J0IC1GIHpoX3ZvbAo0MTYgIDE1OjA3ICAgenBvb2wgbGlzdAo0MTcgIDE1OjA3ICAgemRi IC1lIHpoX3ZvbAo0MTggIDE1OjExICAgbHMgL2Jvb3QvemZzL3pwb29sLmNhY2hlCjQxOSAg MTU6MTUgICB6ZGIgLUMgLVUgL2Jvb3QvemZzL3pwb29sLmNhY2hlCjQyMCAgMTU6MTUgICB6 cG9vbCBpbXBvcnQgLUQKNDIxICAxNToxNiAgIHpwb29sIGNyZWF0ZSB6aF92b2wgYWRhMCBh ZGExCjQyMiAgMTU6MTYgICB6cG9vbCBjcmVhdGUKNDIzICAxNToxNyAgIGdwYXJ0IGxpc3Qg LWwKNDI0ICAxNToxNyAgIGdwYXJ0IGxpc3QgLWEKNDI1ICAxNToxOCAgIHpwb29sIGNyZWF0 ZSB6aF92b2wgYWRhMDNwMSBhZGEzcDIKNDI2ICAxNToyMSAgIHpwb29sIGNyZWF0ZSB6aF92 b2wgYWRhMHAxIGFkYTFwMQo0MjcgIDE1OjMzICAgenBvb2wgY3JlYXRlIHpoX3ZvbCBhZGEw cDIKNDI4ICAxNTozMyAgIHpwb29sIGNyZWF0ZSB6aF92b2wgL2Rldi9hZGEwIC9kZXYvYWRh MQo0MjkgIDE1OjM0ICAgenBvb2wgY3JlYXRlIHpoX3ZvbCAvZGV2L2FkYTBzMiAvZGV2L2Fk YTFzMgo0MzAgIDE1OjM0ICAgenBvb2wgY3JlYXRlIHpoX3ZvbCAvZGV2L2FkYTBzMgo0MzEg IDE1OjM0ICAgZ3BhcnQgc2hvdyAtbAo0MzIgIDE1OjM1ICAgemRiIC1sIC9kZXYvYWRhMHAy CjQzMyAgMTU6MzUgICB6ZGIgLWwgL2Rldi9hZGEwczIKNDM0ICAxNTo0MCAgIHpwb29sIGlt cG9ydAo0MzUgIDE1OjQxICAgenBvb2wgaW1wb3J0IC1mCjQzNiAgMTU6NDIgICB6ZGIKNDM3 ICAxNTo1MiAgIHpwb29sIGltcG9ydCAtZiAtbyByZWFkb25seT1vbiB6aF92b2wgbW50CjQz OCAgMTU6NTMgICBscyAvbW50CjQzOSAgMTU6NTQgICBtb3VudCAtbyBydyAvCjQ0MCAgMTU6 NTQgICBta2RpciAvbW50L3poX3ZvbAo0NDEgIDE1OjU0ICAgenBvb2wgaW1wb3J0IC1OIC1m IC1vIHJlYWRvbmx5PW9uIHpoX3ZvbCAvbW50L3podm9sCjQ0MiAgMTU6NTYgICB6cG9vbCBp bXBvcnQgLU4gLWYgLW8gcmVhZG9ubHk9b24gLVIgL21udC96aF92b2wgemhfdm9sCjQ0MyAg MTU6NTYgICB6cG9vbCBpbXBvcnQgLWYgLW8gcmVhZG9ubHk9b24gLVIgL21udC96aF92b2wg emhfdm9sCjQ0NCAgMTU6NTcgICB6cG9vbCBpbXBvcnQgLWYgLW8gcmVhZG9ubHk9b24gL21u dC96aF92b2wgemhfdm9sCjQ0NSAgMTU6NTggICB6cG9vbCBpbXBvcnQgLWYgLW8gcmVhZG9u bHk9b24gemhfdm9sCjQ0NiAgMTU6NTggICB6cG9vbCBpbXBvcnQgLWYgLW8gcmVhZG9ubHk9 b24gemhfdm9sIG5ld3Bvb2wKNDQ3ICAxNTo1OSAgIHpkYiAtZWggemhfdm9sCjQ0OCAgMTY6 MTEgICB6cG9vbAo0NDkgIDE2OjU3ICAgenBvb2wgc3RhdHVzCjQ1MCAgMTY6NTggICB6cG9v bCBhZGQgemhfdm9sIC9kZXYvYWRhMXMyCjQ1MSAgMTY6NTkgICB6cG9vbCBhZGQgemhfdm9s IC9kZXYvYWRhMnMyCjQ1MiAgMTY6NTkgICB6cG9vbCBhZGQgemhfdm9sIGFkYTFzMgo0NTMg IDE2OjU5ICAgenBvb2wgYWRkIHpoX3ZvbCAvZGV2L2FkYTJzMgo0NTQgIDE2OjU5ICAgenBv b2wgYWRkIHpoX3ZvbCAvZGV2L2FkYTJwMgo0NTUgIDE2OjU5ICAgenBvb2wgc3RhdHVzCjQ1 NiAgMTY6NTkgICB6cG9vbCBhZGQgemhfdm9sIC9kZXYvYWRhMXAyCjQ1NyAgMTc6MDAgICB6 cG9vbCBzdGF0dXMKNDU4ICAxNzowMSAgIHpwb29sIG1vdW50CjQ1OSAgMTc6MDEgICB6cG9v bCAtaAo0NjAgIDE3OjAxICAgenBvb2wgaG9zdG9yeQo0NjEgIDE3OjAxICAgenBvb2wgaG9z dG9yeSB6aF92b2wKNDYyICAxNzowMSAgIHpwb29sIGhpc3Rvcnkgemhfdm9sCjQ2MyAgMTc6 MDMgICB6cG9vbCBpbXBvcnQgLWYgLW8gcmVhZG9ubHk9b24gemhfdm9sCjQ2NCAgMTc6MDMg ICB6cG9vbCBpbXBvcnQgLWYgemhfdm9sCjQ2NSAgMTc6MDMgICB6ZGIKNDY2ICAxNzowNCAg IHpwb29sIC0taGVscAo0NjcgIDE3OjA1ICAgemZzIGdldCBtb3VudHBvaW50IHBvb2wvZmls ZXN5c3RlbQo0NjggIDE3OjA2ICAgemZzIGdldCBtb3VudHBvaW50IHpoX3ZvbAo0NjkgIDE3 OjA2ICAgbHMgLwo0NzAgIDE3OjA2ICAgbHMgL21udC8KNDcxICAxNzowNiAgIGxzIC9tbnQv emhfdm9sLwo0NzIgIDE3OjA2ICAgZGYgLWgKNDczICAxNzowNiAgIGxzIC9kZXYvdWZzL0Zy ZWVOQVNzNAo0NzQgIDE3OjA2ICAgbHMgLWEgL2Rldi91ZnMvRnJlZU5BU3M0CjQ3NSAgMTc6 MDcgICBsZXNzIC9kZXYvdWZzL0ZyZWVOQVNzNAo0NzYgIDE3OjA3ICAgbHMgL2RhdGEKNDc3 ICAxNzowNyAgIGxzIC9kYXRhL3pmcy8KNDc4ICAxNzowNyAgIGxzIC1sIC9kYXRhL3pmcy8K NDc5ICAxNzowOCAgIGNwIC9kYXRhL3pmcy96cG9vbC5jYWNoZSAvZGF0YS96ZnMvenBvb2wu Y2FjaGUuRVMwMDEKNDgwICAxNzowOSAgIGNwIC9kYXRhL3pmcy96cG9vbC5jYWNoZS5zYXZl ZCAvZGF0YS96ZnMvenBvb2wuY2FjaGUuc2F2ZWQuRVMwMDEKNDgxICAxNzowOSAgIHpmcyBt b3VudAo0ODIgIDE3OjA5ICAgbW91bnQKNDgzICAxNzoxNiAgIHpkYgo0ODQgIDE3OjIxICAg emRiIC1lIHpoX3ZvbCB8IGdyZXAgdHhnCjQ4NSAgMTc6MjggICB6cG9vbCByZW1vdmUgemhf dm9sIC9kZXYvYWRhMXAyCjQ4NiAgMTc6MjggICB6cG9vbCByZW1vdmUgemhfdm9sIC9kZXYv YWRhMXAyCjQ4NyAgMTc6MjggICB6cG9vbCByZW1vdmUgemhfdm9sIC9kZXYvYWRhMHAyCjQ4 OCAgMTc6MjggICB6cG9vbCByZW1vdmUgemhfdm9sIC9kZXYvYWRhMnAyCjQ4OSAgMTc6Mjkg ICB6cG9vbCByZW1vdmUgemhfdm9sIC9kZXYvYWRhMXAyCjQ5MCAgMTc6MjkgICB6cG9vbCBy ZW1vdmUgemhfdm9sIC9kZXYvYWRhMHAyCjQ5MSAgMTc6MjkgICB6cG9vbCBzdGF0dXMKNDky ICAxNzoyOSAgIHpwb29sCjQ5MyAgMTc6MzAgICB6cG9vbCBkZXRhY2ggemhfdm9sIC9kZXYv YWRhMnAyCjQ5NCAgMTc6MzEgICB6ZnMgZ2V0IGFsbAo0OTUgIDE3OjMyICAgemZzIHNldCBt b3VudHBvaW50PS9tbnQvemhfdm9sCjQ5NiAgMTc6MzMgICB6ZnMgc2V0IG1vdW50cG9pbnQ9 L21udC96aF92b2wgemhfdm9sCjQ5NyAgMTc6MzMgICBscyAvbW50L3poX3ZvbC8KNDk4ICAx NzozNCAgIHpkYgo0OTkgIDE3OjM0ICAgbW91bnQKNTAwICAxNzozNCAgIHJlYm9vdAo1MDEg IDE3OjUxICAgemRiCjUwMiAgMTc6NTEgICBtb3VudAo1MDMgIDE3OjUyICAgenBvb2wgZGVz dHJveSB6aF92b2wKNTA0ICAxNzo1MiAgIG1vdW50CjUwNSAgMTc6NTIgICB6ZGIKNTA2ICAx Nzo1MiAgIHpwb29sIHN0YXR1cwo1MDcgIDE3OjUyICAgaGlzdG9yeSB8IGxlc3MK --------------000201070805010504040008-- From owner-freebsd-fs@freebsd.org Fri May 27 07:36:31 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BB4ADB4C082 for ; Fri, 27 May 2016 07:36:31 +0000 (UTC) (envelope-from blackcatzilla@gmail.com) Received: from mail-ig0-x22d.google.com (mail-ig0-x22d.google.com [IPv6:2607:f8b0:4001:c05::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 88CE418C9 for ; Fri, 27 May 2016 07:36:31 +0000 (UTC) (envelope-from blackcatzilla@gmail.com) Received: by mail-ig0-x22d.google.com with SMTP id ww4so103486036igb.1 for ; Fri, 27 May 2016 00:36:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=os73k/z/pWMqqQ21UciM2zS24PEJUVjet1JJ4JPlLLg=; b=ncNvQWCjawgp1CCjq9D6xBTdAPjPOztW7b9zgWfXmhZPZkImPCUr70LBneb3uG90tm y3XmQkV+SVWeNhf6IcFJo94w5VexKtAlnCl0FNeCK+oa/EpyClqcnwqJlElHQnQnkiUA 50Hd6zYXW3cVNBFPkO7dPTh9yInBG+Zqwm/P9XS9tLq47Jrh5IOpGDiYoJJnl8m4KSXE awLTmnnERJ2HlN7CukF7Q7gfF2OZtdbt+xu7W+yVHxann53YlXf4ShB7CjnYGwFpY34n bdr+V6dCz0K/3wB4wG38H04m2SJCX/DCPWYAphAulOcrxUDI+ZidYBLL0+F2V56Qjojs 32qQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=os73k/z/pWMqqQ21UciM2zS24PEJUVjet1JJ4JPlLLg=; b=ge4YiG/pFcukQiHHqlBmfW8Oe4mLZJNNRDqpkcVwj0wTiuxzlIhRG2lhrICpZUVpqy U5BQcHH/EdKpoQGUk4ZtaCtLoKBMtzouzjc0vdM76WD81/GGvvE6PxZxJGYIB8NRl0jI IiXWL0fbZ4VlI6lP8z7RbNDFH1xFLuoaKVbt/mWm8Bz8L3nL12XARonqvRSYreesPVcV 1Lcq35awdHlMNhQ+sx8bprgAPTia/xsWMnyg5QwrgdKD0IjwFvl/bQ8RxmjykUaL4wY8 jZKz9qeZTlXbJWsf1iIV5IPHrk56+3gVLk7pi+usptd+CIw4siFBGA9WKvHkR2XMhFf1 Qyvw== X-Gm-Message-State: ALyK8tJrQ1trf+7ZlpEt0DkMH+DV4/6I9eaZTGmPOmyjA+nWE6llc3673KM7i59h3o59KR2P5yv/FUcmss92Fw== X-Received: by 10.50.50.204 with SMTP id e12mr6600930igo.86.1464334590572; Fri, 27 May 2016 00:36:30 -0700 (PDT) MIME-Version: 1.0 Received: by 10.36.46.201 with HTTP; Fri, 27 May 2016 00:36:11 -0700 (PDT) In-Reply-To: <5747780A.5000809@gmail.com> References: <5747780A.5000809@gmail.com> From: BlackCat Date: Fri, 27 May 2016 10:36:11 +0300 Message-ID: Subject: Re: ZFS - RAIDZ1 Recovery To: esamorokov Cc: freebsd-fs@freebsd.org Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 27 May 2016 07:36:31 -0000 Hello Evgeny, 2016-05-27 1:26 GMT+03:00 esamorokov : > I have 3 x 3TB in RAIDZ1, where one drive is gone and I accidentally > screwed the other two. The data should be fine, just need to revert > uberblock in point of time, where i started doing changes. > try the following command, it just checks whether is possible to import your pool by discarding some of the most recent writes): # zpool import -fFn 2918670121059000644 zh_vol_old Because you have already created a new pool with the same name as old, this command import pool by it ID (2918670121059000644) with new name (zh_vol_old). > History: > I was using WEB GUI of FreeNas and it reported a failed drive > I shutdown the computer and replaced the drive, but I did not noticed > that I accidentally disconnected power of another drive > I powered on the server and expanded the pool where there only one drive > of the pool was active As far as I understand attached log, zfs assumes that disk data corrupted. But this is quite stranger, since zfs normally survives if you forget to attach some disk during bad disk replacement. > Then I began to really learn ZFS and messing up with bits > At some point I created a backup bit-to-bit images of the two drives > from the pool (using R-Studio) > The question of curiosity: do you experimenting now with copies or with original disks? > > Specs: > OS: FreeBSD 9.2-RELEASE (FREENAS.amd64) #0 r+2315ea3: Fri Dec 20 > 12:48:50 PST 2013 > RAID: [root@juicy] ~# camcontrol devlist > at scbus1 target 0 lun 0 (pass1,ada1) > at scbus2 target 0 lun 0 (ada2,pass2) > at scbus3 target 0 lun 0 (pass3,ada3) > [root@juicy] ~# zdb > zh_vol: > version: 5000 > name: 'zh_vol' > state: 0 > txg: 14106447 > pool_guid: 2918670121059000644 > hostid: 1802987710 > hostname: '' > vdev_children: 1 > vdev_tree: > type: 'root' > id: 0 > guid: 2918670121059000644 > create_txg: 4 > children[0]: > type: 'raidz' > id: 0 > guid: 14123440993587991088 > nparity: 1 > metaslab_array: 34 > metaslab_shift: 36 > ashift: 12 > asize: 8995321675776 > is_log: 0 > create_txg: 4 > children[0]: > type: 'disk' > id: 0 > guid: 17624020450804741401 > path: '/dev/gptid/6e5cea27-7f52-11e3-9cd8-d43d7ed5b587' > whole_disk: 1 > DTL: 137 > create_txg: 4 > children[1]: > type: 'disk' > id: 1 > guid: 3253299067537287428 > path: '/dev/gptid/2b70d9c0-8e40-11e3-aa1c-d43d7ed5b587' > whole_disk: 1 > DTL: 133 > create_txg: 4 > children[2]: > type: 'disk' > id: 2 > guid: 17999524418015963258 > path: '/dev/gptid/1e898758-9488-11e3-a86e-d43d7ed5b587' > whole_disk: 1 > DTL: 134 > create_txg: 4 > features_for_read: -- BR BC From owner-freebsd-fs@freebsd.org Fri May 27 07:37:18 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EF72AB4C0C3 for ; Fri, 27 May 2016 07:37:18 +0000 (UTC) (envelope-from jg@internetx.com) Received: from mx1.internetx.com (mx1.internetx.com [62.116.129.39]) by mx1.freebsd.org (Postfix) with ESMTP id 7D523198A for ; Fri, 27 May 2016 07:37:18 +0000 (UTC) (envelope-from jg@internetx.com) Received: from localhost (localhost [127.0.0.1]) by mx1.internetx.com (Postfix) with ESMTP id E42F845FC0E4; Fri, 27 May 2016 09:30:35 +0200 (CEST) X-Virus-Scanned: InterNetX GmbH amavisd-new at ix-mailer.internetx.de Received: from mx1.internetx.com ([62.116.129.39]) by localhost (ix-mailer.internetx.de [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 4WY8RvJN7mtB; Fri, 27 May 2016 09:30:33 +0200 (CEST) Received: from [192.168.100.26] (pizza.internetx.de [62.116.129.3]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by mx1.internetx.com (Postfix) with ESMTPSA id 899BD45FC0DB; Fri, 27 May 2016 09:30:33 +0200 (CEST) Subject: Re: ZFS - RAIDZ1 Recovery References: <5747780A.5000809@gmail.com> To: esamorokov , freebsd-fs@freebsd.org, BlackCat Reply-To: jg@internetx.com From: InterNetX - Juergen Gotteswinter Message-ID: <3af5eba4-4e04-abc4-9fa7-d0a1ce47747e@internetx.com> Date: Fri, 27 May 2016 09:30:30 +0200 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.1.0 MIME-Version: 1.0 In-Reply-To: <5747780A.5000809@gmail.com> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 27 May 2016 07:37:19 -0000 Hi, after scrolling through the "History" i would wonder if its not completely messed up now. Less is more in such Situations.. Juergen Am 5/27/2016 um 12:26 AM schrieb esamorokov: > Hello All, > > My name is Evgeny and I have 3 x 3TB in RAIDZ1, where one drive is > gone and I accidentally > screwed the other two. The data should be fine, just need to revert > uberblock in point of time, where i started doing changes. > > I AM KINDLY ASKING FOR HELP! The pool had all of the family memories > for many years :( Thanks in advance! > > I am not a FreeBSD guru and have been using ZFS for a couple of > years, but I know Linux and do some programming/scripting. > Since I got that incident I started learning the depth of the ZFS, > but I definitely need help on it at this point. > Please don't ask me why I did not have backups, I was building > backup server in my garage, when it happened > > History: > I was using WEB GUI of FreeNas and it reported a failed drive > I shutdown the computer and replaced the drive, but I did not > noticed that I accidentally disconnected power of another drive > I powered on the server and expanded the pool where there only one > drive of the pool was active > Then I began to really learn ZFS and messing up with bits > At some point I created a backup bit-to-bit images of the two drives > from the pool (using R-Studio) > > > Specs: > OS: FreeBSD 9.2-RELEASE (FREENAS.amd64) #0 r+2315ea3: Fri Dec 20 > 12:48:50 PST 2013 > RAID: [root@juicy] ~# camcontrol devlist > at scbus1 target 0 lun 0 > (pass1,ada1) > at scbus2 target 0 lun 0 > (ada2,pass2) > at scbus3 target 0 lun 0 > (pass3,ada3) > [root@juicy] ~# zdb > zh_vol: > version: 5000 > name: 'zh_vol' > state: 0 > txg: 14106447 > pool_guid: 2918670121059000644 > hostid: 1802987710 > hostname: '' > vdev_children: 1 > vdev_tree: > type: 'root' > id: 0 > guid: 2918670121059000644 > create_txg: 4 > children[0]: > type: 'raidz' > id: 0 > guid: 14123440993587991088 > nparity: 1 > metaslab_array: 34 > metaslab_shift: 36 > ashift: 12 > asize: 8995321675776 > is_log: 0 > create_txg: 4 > children[0]: > type: 'disk' > id: 0 > guid: 17624020450804741401 > path: '/dev/gptid/6e5cea27-7f52-11e3-9cd8-d43d7ed5b587' > whole_disk: 1 > DTL: 137 > create_txg: 4 > children[1]: > type: 'disk' > id: 1 > guid: 3253299067537287428 > path: '/dev/gptid/2b70d9c0-8e40-11e3-aa1c-d43d7ed5b587' > whole_disk: 1 > DTL: 133 > create_txg: 4 > children[2]: > type: 'disk' > id: 2 > guid: 17999524418015963258 > path: '/dev/gptid/1e898758-9488-11e3-a86e-d43d7ed5b587' > whole_disk: 1 > DTL: 134 > create_txg: 4 > features_for_read: > > > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > From owner-freebsd-fs@freebsd.org Fri May 27 07:38:57 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7FB73B4C168 for ; Fri, 27 May 2016 07:38:57 +0000 (UTC) (envelope-from esamorokov@gmail.com) Received: from mail-io0-x22b.google.com (mail-io0-x22b.google.com [IPv6:2607:f8b0:4001:c06::22b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4AAB21AE1 for ; Fri, 27 May 2016 07:38:57 +0000 (UTC) (envelope-from esamorokov@gmail.com) Received: by mail-io0-x22b.google.com with SMTP id p64so26586072ioi.2 for ; Fri, 27 May 2016 00:38:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc; bh=+PTzV2Lnhx3peWFpD+DqiApjweertZBulPvQb9QBVjQ=; b=CqcvaEdfdFypmxX5AD2dJDvsHn/HcywSDpqaXmGjHDB5RgpOqVsIGLQaZcZq9DZ2ki uMwfyLUfCyPrWIo5vSShVzq18MbsgBq7R5cXFUd0ml7TPk4BdlWfAjtkTgNb+eU4CQfq vxdx1NqCIPrN//egjphOQpditDcUGbdrma24Y6Wh7Ukm5S8xuQ83q0wI+CSluv/7/r7P jeFH8gi3/MGq9lo2k6fG9Reo3nJeipPD0UuoZmRSc6yc3CQUe175PUdeK6BrBFFGn1Z+ E40XUb/jVNv6UOq/Y5zkg7Qs/sbkkR6Md0LeQ8C2C67EqQpvnaeJh6rmJ3rREDUAfcmr 1pEA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc; bh=+PTzV2Lnhx3peWFpD+DqiApjweertZBulPvQb9QBVjQ=; b=BSgBxSqV/M7PCt2PL25OPOX5aoOh+5A8DIYQ81dUCmGd48HK1HrBRK96jACSuk1Wlp Zv5zQnLQ2axbeuPK6v22HVcL4Bs99S8q5uNGOySSizrk6Tn8OZAIGuBIxWMSQsBTFCGQ AxWe3ALRTkVW7KxbvByAv6tBaKw+XzlazzvLf684p+IvQhxvyncOkb6eCQPCDTyCGY3p IY2sk2Rx2+F+lVD+JJQkHko3LVV8lmhDZsSsJ7H5+p1ULmcvXUy7niFdJDl4kJU+rAuz UX+H41E0S3CyElJikl2F7u5lnwlbgwdmL5P85Z/iQQkM8d+AglPjg2jyZxgbGIj0rnaS ZqVA== X-Gm-Message-State: ALyK8tIu1FgSSzq0ZRnCdurHjTjkk1BJTW7H6zcrKGZXMAz0qTdTs561jLGrhjOa2lTzZQUgNsNnClvQokj44A== MIME-Version: 1.0 X-Received: by 10.107.131.105 with SMTP id f102mr12274966iod.136.1464334736606; Fri, 27 May 2016 00:38:56 -0700 (PDT) Received: by 10.107.154.16 with HTTP; Fri, 27 May 2016 00:38:56 -0700 (PDT) Received: by 10.107.154.16 with HTTP; Fri, 27 May 2016 00:38:56 -0700 (PDT) In-Reply-To: <3af5eba4-4e04-abc4-9fa7-d0a1ce47747e@internetx.com> References: <5747780A.5000809@gmail.com> <3af5eba4-4e04-abc4-9fa7-d0a1ce47747e@internetx.com> Date: Fri, 27 May 2016 00:38:56 -0700 Message-ID: Subject: Re: ZFS - RAIDZ1 Recovery From: Evgeny Sam To: jg@internetx.com Cc: BlackCat , freebsd-fs@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.22 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 27 May 2016 07:38:57 -0000 Hi, I don't know if it helps, but right after I recreated the pool with absolute paths of the drives (adaX) I made a bit-to-bit image copy of the drives. Now I am restoring those images to the NEW DRIVES (similar models). Thank you, Evgeny. On May 27, 2016 12:30 AM, "InterNetX - Juergen Gotteswinter" < jg@internetx.com> wrote: > Hi, > > after scrolling through the "History" i would wonder if its not > completely messed up now. Less is more in such Situations.. > > Juergen > > Am 5/27/2016 um 12:26 AM schrieb esamorokov: > > Hello All, > > > > My name is Evgeny and I have 3 x 3TB in RAIDZ1, where one drive is > > gone and I accidentally > > screwed the other two. The data should be fine, just need to revert > > uberblock in point of time, where i started doing changes. > > > > I AM KINDLY ASKING FOR HELP! The pool had all of the family memories > > for many years :( Thanks in advance! > > > > I am not a FreeBSD guru and have been using ZFS for a couple of > > years, but I know Linux and do some programming/scripting. > > Since I got that incident I started learning the depth of the ZFS, > > but I definitely need help on it at this point. > > Please don't ask me why I did not have backups, I was building > > backup server in my garage, when it happened > > > > History: > > I was using WEB GUI of FreeNas and it reported a failed drive > > I shutdown the computer and replaced the drive, but I did not > > noticed that I accidentally disconnected power of another drive > > I powered on the server and expanded the pool where there only one > > drive of the pool was active > > Then I began to really learn ZFS and messing up with bits > > At some point I created a backup bit-to-bit images of the two drives > > from the pool (using R-Studio) > > > > > > Specs: > > OS: FreeBSD 9.2-RELEASE (FREENAS.amd64) #0 r+2315ea3: Fri Dec 20 > > 12:48:50 PST 2013 > > RAID: [root@juicy] ~# camcontrol devlist > > at scbus1 target 0 lun 0 > > (pass1,ada1) > > at scbus2 target 0 lun 0 > > (ada2,pass2) > > at scbus3 target 0 lun 0 > > (pass3,ada3) > > [root@juicy] ~# zdb > > zh_vol: > > version: 5000 > > name: 'zh_vol' > > state: 0 > > txg: 14106447 > > pool_guid: 2918670121059000644 > > hostid: 1802987710 > > hostname: '' > > vdev_children: 1 > > vdev_tree: > > type: 'root' > > id: 0 > > guid: 2918670121059000644 > > create_txg: 4 > > children[0]: > > type: 'raidz' > > id: 0 > > guid: 14123440993587991088 > > nparity: 1 > > metaslab_array: 34 > > metaslab_shift: 36 > > ashift: 12 > > asize: 8995321675776 > > is_log: 0 > > create_txg: 4 > > children[0]: > > type: 'disk' > > id: 0 > > guid: 17624020450804741401 > > path: '/dev/gptid/6e5cea27-7f52-11e3-9cd8-d43d7ed5b587' > > whole_disk: 1 > > DTL: 137 > > create_txg: 4 > > children[1]: > > type: 'disk' > > id: 1 > > guid: 3253299067537287428 > > path: '/dev/gptid/2b70d9c0-8e40-11e3-aa1c-d43d7ed5b587' > > whole_disk: 1 > > DTL: 133 > > create_txg: 4 > > children[2]: > > type: 'disk' > > id: 2 > > guid: 17999524418015963258 > > path: '/dev/gptid/1e898758-9488-11e3-a86e-d43d7ed5b587' > > whole_disk: 1 > > DTL: 134 > > create_txg: 4 > > features_for_read: > > > > > > _______________________________________________ > > freebsd-fs@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > > > From owner-freebsd-fs@freebsd.org Fri May 27 13:37:45 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B0E5BB4B8A1 for ; Fri, 27 May 2016 13:37:45 +0000 (UTC) (envelope-from lists@yamagi.org) Received: from mail1.yamagi.org (yugo.yamagi.org [212.48.122.103]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 7AEBF10EB for ; Fri, 27 May 2016 13:37:44 +0000 (UTC) (envelope-from lists@yamagi.org) Received: from [192.168.100.101] (helo=aka) by mail1.yamagi.org with esmtpsa (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256) (Exim 4.86 (FreeBSD)) (envelope-from ) id 1b6Hws-000PzM-KU; Fri, 27 May 2016 15:37:41 +0200 Date: Fri, 27 May 2016 15:37:05 +0200 From: Yamagi Burmeister To: kostikbel@gmail.com Cc: freebsd-fs@freebsd.org Subject: Re: LOR between allproc <-> ufs Message-Id: <20160527153705.ee502c0a528cedd29c65b0ca@yamagi.org> In-Reply-To: <20160526155844.GH38613@kib.kiev.ua> References: <20160526160902.bbe4c36ad340f11f69f7ba08@yamagi.org> <20160526155844.GH38613@kib.kiev.ua> X-Mailer: Sylpheed 3.5.0 (GTK+ 2.24.29; amd64-portbld-freebsd10.1) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 27 May 2016 13:37:45 -0000 On Thu, 26 May 2016 18:58:44 +0300 Konstantin Belousov wrote: > Completely untested patch is below. I do not think that this LOR > can be reproduced at will. E.g. you need to record the order > in witness by unmounting some filesystem mounted on a directory > on UFS mount. Then, the chances must be that it was the last > reference on the vmspace, or that there were deferred vnode entry. With this patch the system panics as soon there's some load on the filesystem. Maybe only when several processes accessing the same mountpoint, but I'm not sure. For example 'make -j24 buildkernel' crashes the system nearly instantly. (kgdb) bt #0 doadump (textdump=165043200) at pcpu.h:219 #1 0xffffffff80357b45 in db_fncall (dummy1=, dummy2=, dummy3=, dummy4=) at /usr/src/sys/ddb/db_command.c:568 #2 0xffffffff8035782d in db_command (cmd_table=0x0) at /usr/src/sys/ddb/db_command.c:440 #3 0xffffffff803575a4 in db_command_loop () at /usr/src/sys/ddb/db_command.c:493 #4 0xffffffff80359f80 in db_trap (type=, code=0) at /usr/src/sys/ddb/db_main.c:231 #5 0xffffffff80993279 in kdb_trap (type=3, code=0, tf=) at /usr/src/sys/kern/subr_kdb.c:656 #6 0xffffffff80d7713e in trap (frame=0xfffffe10440c2730) at /usr/src/sys/amd64/amd64/trap.c:561 #7 0xffffffff80d5af52 in calltrap () at /usr/src/sys/amd64/amd64/exception.S:236 #8 0xffffffff809929de in kdb_enter (why=0xffffffff81010020 "panic", msg=) at cpufunc.h:63 #9 0xffffffff809573b6 in vpanic (fmt=, ap=) at /usr/src/sys/kern/kern_shutdown.c:882 #10 0xffffffff80957269 in kassert_panic (fmt=) at /usr/src/sys/kern/kern_shutdown.c:777 #11 0xffffffff809b5aeb in witness_warn (flags=, lock=, fmt=) at /usr/src/sys/kern/subr_witness.c:1757 #12 0xffffffff809aa0a8 in userret (td=0xfffff800264c6960, frame=) at /usr/src/sys/kern/subr_trap.c:157 #13 0xffffffff80d78151 in amd64_syscall (td=0xfffff800264c6960, traced=) at subr_syscall.c:185 #14 0xffffffff80d5b23b in Xfast_syscall () at /usr/src/sys/amd64/amd64/exception.S:396 #15 0x0000000802ef665a in ?? () Previous frame inner to this frame (corrupt stack?) Current language: auto; currently minimal This time I've got a dump, so further information can be provided. Regards, Yamagi -- Homepage: www.yamagi.org XMPP: yamagi@yamagi.org GnuPG/GPG: 0xEFBCCBCB From owner-freebsd-fs@freebsd.org Fri May 27 14:10:23 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B5907B4BF41 for ; Fri, 27 May 2016 14:10:23 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3667A1FCD for ; Fri, 27 May 2016 14:10:23 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kib@localhost [127.0.0.1]) by kib.kiev.ua (8.15.2/8.15.2) with ESMTPS id u4REAHlK091530 (version=TLSv1 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Fri, 27 May 2016 17:10:17 +0300 (EEST) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.10.3 kib.kiev.ua u4REAHlK091530 Received: (from kostik@localhost) by tom.home (8.15.2/8.15.2/Submit) id u4REAGED091527; Fri, 27 May 2016 17:10:16 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Fri, 27 May 2016 17:10:16 +0300 From: Konstantin Belousov To: Yamagi Burmeister Cc: freebsd-fs@freebsd.org Subject: Re: LOR between allproc <-> ufs Message-ID: <20160527141016.GL38613@kib.kiev.ua> References: <20160526160902.bbe4c36ad340f11f69f7ba08@yamagi.org> <20160526155844.GH38613@kib.kiev.ua> <20160527153705.ee502c0a528cedd29c65b0ca@yamagi.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20160527153705.ee502c0a528cedd29c65b0ca@yamagi.org> User-Agent: Mutt/1.6.1 (2016-04-27) X-Spam-Status: No, score=-2.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FREEMAIL_FROM,NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on tom.home X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 27 May 2016 14:10:23 -0000 On Fri, May 27, 2016 at 03:37:05PM +0200, Yamagi Burmeister wrote: > On Thu, 26 May 2016 18:58:44 +0300 > Konstantin Belousov wrote: > > > Completely untested patch is below. I do not think that this LOR > > can be reproduced at will. E.g. you need to record the order > > in witness by unmounting some filesystem mounted on a directory > > on UFS mount. Then, the chances must be that it was the last > > reference on the vmspace, or that there were deferred vnode entry. > > With this patch the system panics as soon there's some load on the > filesystem. Maybe only when several processes accessing the same > mountpoint, but I'm not sure. For example 'make -j24 buildkernel' > crashes the system nearly instantly. > at /usr/src/sys/kern/kern_shutdown.c:777 > #11 0xffffffff809b5aeb in witness_warn (flags=, lock=, > fmt=) at /usr/src/sys/kern/subr_witness.c:1757 > #12 0xffffffff809aa0a8 in userret (td=0xfffff800264c6960, frame=) > at /usr/src/sys/kern/subr_trap.c:157 > #13 0xffffffff80d78151 in amd64_syscall (td=0xfffff800264c6960, traced=) > at subr_syscall.c:185 This is an assert about some lock leak. Most useful is verbatim panic message with all surrounding kernel printouts. I do not even need the backtrace. From owner-freebsd-fs@freebsd.org Sat May 28 23:08:01 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 41D5FB4EBB5 for ; Sat, 28 May 2016 23:08:01 +0000 (UTC) (envelope-from esamorokov@gmail.com) Received: from mail-it0-x22d.google.com (mail-it0-x22d.google.com [IPv6:2607:f8b0:4001:c0b::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 143541E50 for ; Sat, 28 May 2016 23:08:01 +0000 (UTC) (envelope-from esamorokov@gmail.com) Received: by mail-it0-x22d.google.com with SMTP id l63so15780257ita.1 for ; Sat, 28 May 2016 16:08:01 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to; bh=kt69UcFaIl01nSZoDprMPROVwfcj0oko9Qnn0oyqhJ8=; b=v3fXeNPVwQr8QuJB9ENpvavReuaprCIc7o/6Jd8QVK2cgMHm8ZedTYKIsUj2CCVOSt 5Luara/OBEDKsN8W1VYUMMSJKurrzmUBCoenEu2TQGlumlyrl3pevpKVFTbcwq/BwTMe 65TV8J3zVCsoDYI5LuYeh+524gcGEReE3j3vcAdx/Zi4T24x80iqAZ//cVYPDnfR/bSC kbQQ45b9n7g8dRS/gc8Org4oqBnXcQf0FD41+zGksVvdakaJv7gzLbI2cB2d+ZgIbpBy pWS56duroxdGqrk09NVb78i5aFZMfOviSAISHpziklkT6ebB3+5OtUz5WxglWgMSBTjk 8k2Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:date:message-id:subject:from:to; bh=kt69UcFaIl01nSZoDprMPROVwfcj0oko9Qnn0oyqhJ8=; b=dtOncQDDlRfW8Ac8+F8OVI3Gye6IMFdrYQr2F24DhTKsmzrbJqjvET2uqTQyWyfit9 pJxgXl0knzCB5mEXIuy6bVN0XaQiaRWzn+Vep0SteLTLSXoCkvWqwflSXVc8fEZNucxn i5cYyDx3MeQRntkkSuPJy5P/5LoNGRFAehJujAuqbQYihHgkqKq6g+BQd9oxvgDuNzT1 gtpwENbap7k3Cj/QopeaMayOAer/KumE8YYxYxa1SkDF6UiMtv0VQQC3zQTNrh+KACpl 7yf4mruMemVlEFrq9zaBNg2LT7jl6vIFBW0lJoNzxpcA7/9vxz3B+U6zi/OGK+1cXY1r aDTg== X-Gm-Message-State: ALyK8tJzMCu3ClHaoTuKbf9zhQGoGPmj9sf9vOpMtellAkRcz775S+upeIFEcs/e9h2JulXh5JPmJuLoZAjLRg== MIME-Version: 1.0 X-Received: by 10.36.108.76 with SMTP id w73mr3592370itb.63.1464476879872; Sat, 28 May 2016 16:07:59 -0700 (PDT) Received: by 10.107.154.16 with HTTP; Sat, 28 May 2016 16:07:59 -0700 (PDT) Date: Sat, 28 May 2016 16:07:59 -0700 Message-ID: Subject: Re: ZFS - RAIDZ1 Recovery (Evgeny Sam) From: Evgeny Sam To: freebsd-fs@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.22 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 28 May 2016 23:08:01 -0000 BlackCat, I ran the command "zpool import -fFn 2918670121059000644 zh_vol_old" amd it did not work. [root@juicy] ~# zpool import -fFn 2918670121059000644 zh_vol_old [root@juicy] ~# zpool status no pools available I think it did not work, because I am running it on the clonned drives, which have different GPID's, please correct me if I am wrong. I can switch it to the original drives, if you suggest so. Kevin, At this moment the third drive is connected and it is/was faulty. Also, the rest of the drives are the clones of the original ones. Thank you, EVGENY. On Fri, May 27, 2016 at 5:00 AM, wrote: > Send freebsd-fs mailing list submissions to > freebsd-fs@freebsd.org > > To subscribe or unsubscribe via the World Wide Web, visit > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > or, via email, send a message with subject or body 'help' to > freebsd-fs-request@freebsd.org > > You can reach the person managing the list at > freebsd-fs-owner@freebsd.org > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of freebsd-fs digest..." > > > Today's Topics: > > 1. Re: ZFS - RAIDZ1 Recovery (Kevin P. Neal) > 2. Re: ZFS - RAIDZ1 Recovery (BlackCat) > 3. Re: ZFS - RAIDZ1 Recovery (InterNetX - Juergen Gotteswinter) > 4. Re: ZFS - RAIDZ1 Recovery (Evgeny Sam) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Thu, 26 May 2016 20:47:10 -0400 > From: "Kevin P. Neal" > To: esamorokov > Cc: freebsd-fs@freebsd.org, BlackCat > Subject: Re: ZFS - RAIDZ1 Recovery > Message-ID: <20160527004710.GA47195@neutralgood.org> > Content-Type: text/plain; charset=us-ascii > > On Thu, May 26, 2016 at 03:26:18PM -0700, esamorokov wrote: > > Hello All, > > > > My name is Evgeny and I have 3 x 3TB in RAIDZ1, where one drive is > > gone and I accidentally > > screwed the other two. The data should be fine, just need to revert > > uberblock in point of time, where i started doing changes. > > You may need to ask on a ZFS or OpenZFS specific list. I'm not aware of > many deep ZFS experts who hang out on this list. > > > History: > > I was using WEB GUI of FreeNas and it reported a failed drive > > I shutdown the computer and replaced the drive, but I did not > > noticed that I accidentally disconnected power of another drive > > What happened to the third drive, the one you pulled? Did it fail > in a way that may make it viable for an attempt to revive the pool? > Or is it just a brick at this point in which case it is useless? > > If the third drive is perhaps usable then make sure all three are > connected and powered up. > -- > Kevin P. Neal http://www.pobox.com/~kpn/ > > "Nonbelievers found it difficult to defend their position in \ > the presense of a working computer." -- a DEC Jensen paper > > > ------------------------------ > > Message: 2 > Date: Fri, 27 May 2016 10:36:11 +0300 > From: BlackCat > To: esamorokov > Cc: freebsd-fs@freebsd.org > Subject: Re: ZFS - RAIDZ1 Recovery > Message-ID: > < > CAD-rSeea_7TzxREVAsn8tKxLbtth62m3j8opsb2FoA3qc_ZrsQ@mail.gmail.com> > Content-Type: text/plain; charset=UTF-8 > > Hello Evgeny, > > 2016-05-27 1:26 GMT+03:00 esamorokov : > > I have 3 x 3TB in RAIDZ1, where one drive is gone and I accidentally > > screwed the other two. The data should be fine, just need to revert > > uberblock in point of time, where i started doing changes. > > > try the following command, it just checks whether is possible to > import your pool by discarding some of the most recent writes): > > # zpool import -fFn 2918670121059000644 zh_vol_old > > Because you have already created a new pool with the same name as old, > this command import pool by it ID (2918670121059000644) with new name > (zh_vol_old). > > > History: > > I was using WEB GUI of FreeNas and it reported a failed drive > > I shutdown the computer and replaced the drive, but I did not noticed > > that I accidentally disconnected power of another drive > > I powered on the server and expanded the pool where there only one > drive > > of the pool was active > > As far as I understand attached log, zfs assumes that disk data > corrupted. But this is quite stranger, since zfs normally survives if > you forget to attach some disk during bad disk replacement. > > > Then I began to really learn ZFS and messing up with bits > > At some point I created a backup bit-to-bit images of the two drives > > from the pool (using R-Studio) > > > The question of curiosity: do you experimenting now with copies or > with original disks? > > > > > Specs: > > OS: FreeBSD 9.2-RELEASE (FREENAS.amd64) #0 r+2315ea3: Fri Dec 20 > > 12:48:50 PST 2013 > > RAID: [root@juicy] ~# camcontrol devlist > > at scbus1 target 0 lun 0 > (pass1,ada1) > > at scbus2 target 0 lun 0 > (ada2,pass2) > > at scbus3 target 0 lun 0 > (pass3,ada3) > > [root@juicy] ~# zdb > > zh_vol: > > version: 5000 > > name: 'zh_vol' > > state: 0 > > txg: 14106447 > > pool_guid: 2918670121059000644 > > hostid: 1802987710 > > hostname: '' > > vdev_children: 1 > > vdev_tree: > > type: 'root' > > id: 0 > > guid: 2918670121059000644 > > create_txg: 4 > > children[0]: > > type: 'raidz' > > id: 0 > > guid: 14123440993587991088 > > nparity: 1 > > metaslab_array: 34 > > metaslab_shift: 36 > > ashift: 12 > > asize: 8995321675776 > > is_log: 0 > > create_txg: 4 > > children[0]: > > type: 'disk' > > id: 0 > > guid: 17624020450804741401 > > path: '/dev/gptid/6e5cea27-7f52-11e3-9cd8-d43d7ed5b587' > > whole_disk: 1 > > DTL: 137 > > create_txg: 4 > > children[1]: > > type: 'disk' > > id: 1 > > guid: 3253299067537287428 > > path: '/dev/gptid/2b70d9c0-8e40-11e3-aa1c-d43d7ed5b587' > > whole_disk: 1 > > DTL: 133 > > create_txg: 4 > > children[2]: > > type: 'disk' > > id: 2 > > guid: 17999524418015963258 > > path: '/dev/gptid/1e898758-9488-11e3-a86e-d43d7ed5b587' > > whole_disk: 1 > > DTL: 134 > > create_txg: 4 > > features_for_read: > > -- > BR BC > > > ------------------------------ > > Message: 3 > Date: Fri, 27 May 2016 09:30:30 +0200 > From: InterNetX - Juergen Gotteswinter > To: esamorokov , freebsd-fs@freebsd.org, > BlackCat > Subject: Re: ZFS - RAIDZ1 Recovery > Message-ID: <3af5eba4-4e04-abc4-9fa7-d0a1ce47747e@internetx.com> > Content-Type: text/plain; charset=windows-1252 > > Hi, > > after scrolling through the "History" i would wonder if its not > completely messed up now. Less is more in such Situations.. > > Juergen > > Am 5/27/2016 um 12:26 AM schrieb esamorokov: > > Hello All, > > > > My name is Evgeny and I have 3 x 3TB in RAIDZ1, where one drive is > > gone and I accidentally > > screwed the other two. The data should be fine, just need to revert > > uberblock in point of time, where i started doing changes. > > > > I AM KINDLY ASKING FOR HELP! The pool had all of the family memories > > for many years :( Thanks in advance! > > > > I am not a FreeBSD guru and have been using ZFS for a couple of > > years, but I know Linux and do some programming/scripting. > > Since I got that incident I started learning the depth of the ZFS, > > but I definitely need help on it at this point. > > Please don't ask me why I did not have backups, I was building > > backup server in my garage, when it happened > > > > History: > > I was using WEB GUI of FreeNas and it reported a failed drive > > I shutdown the computer and replaced the drive, but I did not > > noticed that I accidentally disconnected power of another drive > > I powered on the server and expanded the pool where there only one > > drive of the pool was active > > Then I began to really learn ZFS and messing up with bits > > At some point I created a backup bit-to-bit images of the two drives > > from the pool (using R-Studio) > > > > > > Specs: > > OS: FreeBSD 9.2-RELEASE (FREENAS.amd64) #0 r+2315ea3: Fri Dec 20 > > 12:48:50 PST 2013 > > RAID: [root@juicy] ~# camcontrol devlist > > at scbus1 target 0 lun 0 > > (pass1,ada1) > > at scbus2 target 0 lun 0 > > (ada2,pass2) > > at scbus3 target 0 lun 0 > > (pass3,ada3) > > [root@juicy] ~# zdb > > zh_vol: > > version: 5000 > > name: 'zh_vol' > > state: 0 > > txg: 14106447 > > pool_guid: 2918670121059000644 > > hostid: 1802987710 > > hostname: '' > > vdev_children: 1 > > vdev_tree: > > type: 'root' > > id: 0 > > guid: 2918670121059000644 > > create_txg: 4 > > children[0]: > > type: 'raidz' > > id: 0 > > guid: 14123440993587991088 > > nparity: 1 > > metaslab_array: 34 > > metaslab_shift: 36 > > ashift: 12 > > asize: 8995321675776 > > is_log: 0 > > create_txg: 4 > > children[0]: > > type: 'disk' > > id: 0 > > guid: 17624020450804741401 > > path: '/dev/gptid/6e5cea27-7f52-11e3-9cd8-d43d7ed5b587' > > whole_disk: 1 > > DTL: 137 > > create_txg: 4 > > children[1]: > > type: 'disk' > > id: 1 > > guid: 3253299067537287428 > > path: '/dev/gptid/2b70d9c0-8e40-11e3-aa1c-d43d7ed5b587' > > whole_disk: 1 > > DTL: 133 > > create_txg: 4 > > children[2]: > > type: 'disk' > > id: 2 > > guid: 17999524418015963258 > > path: '/dev/gptid/1e898758-9488-11e3-a86e-d43d7ed5b587' > > whole_disk: 1 > > DTL: 134 > > create_txg: 4 > > features_for_read: > > > > > > _______________________________________________ > > freebsd-fs@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > > > > > ------------------------------ > > Message: 4 > Date: Fri, 27 May 2016 00:38:56 -0700 > From: Evgeny Sam > To: jg@internetx.com > Cc: BlackCat , freebsd-fs@freebsd.org > Subject: Re: ZFS - RAIDZ1 Recovery > Message-ID: > 4XKK7qiOTtYBka_gHzkVNyXh78ecvhOwqxpMZLdcsupw@mail.gmail.com> > Content-Type: text/plain; charset=UTF-8 > > Hi, > I don't know if it helps, but right after I recreated the pool with > absolute paths of the drives (adaX) I made a bit-to-bit image copy of the > drives. Now I am restoring those images to the NEW DRIVES (similar models). > > Thank you, > Evgeny. > On May 27, 2016 12:30 AM, "InterNetX - Juergen Gotteswinter" < > jg@internetx.com> wrote: > > > Hi, > > > > after scrolling through the "History" i would wonder if its not > > completely messed up now. Less is more in such Situations.. > > > > Juergen > > > > Am 5/27/2016 um 12:26 AM schrieb esamorokov: > > > Hello All, > > > > > > My name is Evgeny and I have 3 x 3TB in RAIDZ1, where one drive is > > > gone and I accidentally > > > screwed the other two. The data should be fine, just need to revert > > > uberblock in point of time, where i started doing changes. > > > > > > I AM KINDLY ASKING FOR HELP! The pool had all of the family > memories > > > for many years :( Thanks in advance! > > > > > > I am not a FreeBSD guru and have been using ZFS for a couple of > > > years, but I know Linux and do some programming/scripting. > > > Since I got that incident I started learning the depth of the ZFS, > > > but I definitely need help on it at this point. > > > Please don't ask me why I did not have backups, I was building > > > backup server in my garage, when it happened > > > > > > History: > > > I was using WEB GUI of FreeNas and it reported a failed drive > > > I shutdown the computer and replaced the drive, but I did not > > > noticed that I accidentally disconnected power of another drive > > > I powered on the server and expanded the pool where there only one > > > drive of the pool was active > > > Then I began to really learn ZFS and messing up with bits > > > At some point I created a backup bit-to-bit images of the two > drives > > > from the pool (using R-Studio) > > > > > > > > > Specs: > > > OS: FreeBSD 9.2-RELEASE (FREENAS.amd64) #0 r+2315ea3: Fri Dec 20 > > > 12:48:50 PST 2013 > > > RAID: [root@juicy] ~# camcontrol devlist > > > at scbus1 target 0 lun 0 > > > (pass1,ada1) > > > at scbus2 target 0 lun 0 > > > (ada2,pass2) > > > at scbus3 target 0 lun 0 > > > (pass3,ada3) > > > [root@juicy] ~# zdb > > > zh_vol: > > > version: 5000 > > > name: 'zh_vol' > > > state: 0 > > > txg: 14106447 > > > pool_guid: 2918670121059000644 > > > hostid: 1802987710 > > > hostname: '' > > > vdev_children: 1 > > > vdev_tree: > > > type: 'root' > > > id: 0 > > > guid: 2918670121059000644 > > > create_txg: 4 > > > children[0]: > > > type: 'raidz' > > > id: 0 > > > guid: 14123440993587991088 > > > nparity: 1 > > > metaslab_array: 34 > > > metaslab_shift: 36 > > > ashift: 12 > > > asize: 8995321675776 > > > is_log: 0 > > > create_txg: 4 > > > children[0]: > > > type: 'disk' > > > id: 0 > > > guid: 17624020450804741401 > > > path: '/dev/gptid/6e5cea27-7f52-11e3-9cd8-d43d7ed5b587' > > > whole_disk: 1 > > > DTL: 137 > > > create_txg: 4 > > > children[1]: > > > type: 'disk' > > > id: 1 > > > guid: 3253299067537287428 > > > path: '/dev/gptid/2b70d9c0-8e40-11e3-aa1c-d43d7ed5b587' > > > whole_disk: 1 > > > DTL: 133 > > > create_txg: 4 > > > children[2]: > > > type: 'disk' > > > id: 2 > > > guid: 17999524418015963258 > > > path: '/dev/gptid/1e898758-9488-11e3-a86e-d43d7ed5b587' > > > whole_disk: 1 > > > DTL: 134 > > > create_txg: 4 > > > features_for_read: > > > > > > > > > _______________________________________________ > > > freebsd-fs@freebsd.org mailing list > > > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > > > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > > > > > > > > ------------------------------ > > Subject: Digest Footer > > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > > ------------------------------ > > End of freebsd-fs Digest, Vol 672, Issue 6 > ****************************************** > From owner-freebsd-fs@freebsd.org Sat May 28 23:16:40 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4417BB4EE09 for ; Sat, 28 May 2016 23:16:40 +0000 (UTC) (envelope-from esamorokov@gmail.com) Received: from mail-io0-x233.google.com (mail-io0-x233.google.com [IPv6:2607:f8b0:4001:c06::233]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 10DBC138E for ; Sat, 28 May 2016 23:16:40 +0000 (UTC) (envelope-from esamorokov@gmail.com) Received: by mail-io0-x233.google.com with SMTP id p64so50383764ioi.2 for ; Sat, 28 May 2016 16:16:40 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to; bh=J858ViBnSDYReLFeVWqLxibpQRGcJ+g6rQ3Eo4eh5go=; b=GkUroHiAIyi1zT6hYN3f/uYNBZ22uzOj0k3GMK++J9QVPGV13g/nYeVKPx1sqPcxcb 993l38lUiIdUSsi6/BYtbWMtSPSeZhQY2OY+DJbXCSlIErYDHzV9CI+z/SlX02lsta/U nhfeFiu2ON2PN72MyaBdGE6czgeo3EYCOSmR/dGbEecDmzM54+1cE7Jhx2DE5UAVCuzK E1DfBNhXzbhq4rS6/++8ngUHfMBeXG2hV6lilKEoI3htXdq1d5ubLEDMqqqG/du2t0EU 4IoCitWYNv+NmPb9P/pxTGJsO26InfESPJs92p+DHVgdPoIbcT5zpWM1JEyMHwcSjlyL aGTw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:date:message-id:subject:from:to; bh=J858ViBnSDYReLFeVWqLxibpQRGcJ+g6rQ3Eo4eh5go=; b=GJ2bV2RaFgf57gvO045WLzm88VIvtzvYSDoBm8uc4bWOV8jLAiwfABcWULg+uZZiqX sKfyIbs8GOrnHq6VWofh+RMAk7nZMqZUWab/j9KGMnyW9E8wUtPfeoZj4oIFs4w+KSCA J2lIfPTKI8ulTbSpR/K35to3hf5y9b9k/0hQ3hhzmLhP+jzHFGG/E1u/secc+QCjpXbF nxsiFpAaRHxZ22lrcFHMNNgKIXG/R4Qx62wZ9HwxivXsKgKrqz2tVq2n9qL/WWoFopd/ l8ovntefOQoJBcKJ2CmzTGU0UANyMkrdNZOHA/M/3zb6HAYqR9aPXqjgs+EZH9UB1+vR joNw== X-Gm-Message-State: ALyK8tKqF53CyNWdcKXKZ9ZNc2Vwc/c5caCkvDtB436lbIt1OnXoMU+zINmV0vF0FM37VXX6I3mBGZ4+26H77A== MIME-Version: 1.0 X-Received: by 10.107.131.105 with SMTP id f102mr18033284iod.136.1464477399124; Sat, 28 May 2016 16:16:39 -0700 (PDT) Received: by 10.107.154.16 with HTTP; Sat, 28 May 2016 16:16:39 -0700 (PDT) Date: Sat, 28 May 2016 16:16:39 -0700 Message-ID: Subject: Re: ZFS - RAIDZ1 Recovery (Evgeny Sam) From: Evgeny Sam To: freebsd-fs@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.22 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 28 May 2016 23:16:40 -0000 Here is the current state of the drives: zh_vol: version: 5000 name: 'zh_vol' state: 0 txg: 1491 pool_guid: 10149654347507244742 hostid: 1802987710 hostname: 'juicy.zhelana.local' vdev_children: 2 vdev_tree: type: 'root' id: 0 guid: 10149654347507244742 create_txg: 4 children[0]: type: 'disk' id: 0 guid: 5892508334691495384 path: '/dev/ada0s2' whole_disk: 1 metaslab_array: 33 metaslab_shift: 23 ashift: 12 asize: 983564288 is_log: 0 create_txg: 4 children[1]: type: 'disk' id: 1 guid: 296669430778697937 path: '/dev/ada2p2' whole_disk: 1 metaslab_array: 37 metaslab_shift: 34 ashift: 12 asize: 2997366816768 is_log: 0 create_txg: 1489 features_for_read: [root@juicy] ~# camcontrol devlist at scbus0 target 0 lun 0 (ada0,pass0) at scbus1 target 0 lun 0 (ada1,pass1) at scbus2 target 0 lun 0 (ada2,pass2) at scbus3 target 0 lun 0 (ada3,pass3) [root@juicy] ~# gpart show => 63 117231345 ada0 MBR (55G) 63 1930257 1 freebsd [active] (942M) 1930320 63 - free - (31k) 1930383 1930257 2 freebsd (942M) 3860640 3024 3 freebsd (1.5M) 3863664 41328 4 freebsd (20M) 3904992 113326416 - free - (54G) => 0 1930257 ada0s1 BSD (942M) 0 16 - free - (8.0k) 16 1930241 1 !0 (942M) => 34 5860533101 ada1 GPT (2.7T) 34 94 - free - (47k) 128 6291456 1 freebsd-swap (3.0G) 6291584 5854241544 2 freebsd-zfs (2.7T) 5860533128 7 - free - (3.5k) => 34 5860533101 ada2 GPT (2.7T) 34 94 - free - (47k) 128 6291456 1 freebsd-swap (3.0G) 6291584 5854241544 2 freebsd-zfs (2.7T) 5860533128 7 - free - (3.5k) => 34 5860533101 ada3 GPT (2.7T) 34 94 - free - (47k) 128 6291456 1 freebsd-swap (3.0G) 6291584 5854241544 2 freebsd-zfs (2.7T) 5860533128 7 - free - (3.5k) Geom name: ada1 modified: false state: OK fwheads: 16 fwsectors: 63 last: 5860533134 first: 34 entries: 128 scheme: GPT Providers: 1. Name: ada1p1 Mediasize: 3221225472 (3.0G) Sectorsize: 512 Stripesize: 4096 Stripeoffset: 0 Mode: r1w1e1 rawuuid: 5d985baa-18ac-11e6-9c25-001b7859b93e rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b label: (null) length: 3221225472 offset: 65536 type: freebsd-swap index: 1 end: 6291583 start: 128 2. Name: ada1p2 Mediasize: 2997371670528 (2.7T) Sectorsize: 512 Stripesize: 4096 Stripeoffset: 0 Mode: r0w0e0 rawuuid: 5dacd737-18ac-11e6-9c25-001b7859b93e rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b label: (null) length: 2997371670528 offset: 3221291008 type: freebsd-zfs index: 2 end: 5860533127 start: 6291584 Consumers: 1. Name: ada1 Mediasize: 3000592982016 (2.7T) Sectorsize: 512 Stripesize: 4096 Stripeoffset: 0 Mode: r1w1e2 Geom name: ada2 modified: false state: OK fwheads: 16 fwsectors: 63 last: 5860533134 first: 34 entries: 128 scheme: GPT Providers: 1. Name: ada2p1 Mediasize: 3221225472 (3.0G) Sectorsize: 512 Stripesize: 4096 Stripeoffset: 0 Mode: r1w1e1 rawuuid: 5e164720-18ac-11e6-9c25-001b7859b93e rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b label: (null) length: 3221225472 offset: 65536 type: freebsd-swap index: 1 end: 6291583 start: 128 2. Name: ada2p2 Mediasize: 2997371670528 (2.7T) Sectorsize: 512 Stripesize: 4096 Stripeoffset: 0 Mode: r0w0e0 rawuuid: 5e2ab04c-18ac-11e6-9c25-001b7859b93e rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b label: (null) length: 2997371670528 offset: 3221291008 type: freebsd-zfs index: 2 end: 5860533127 start: 6291584 Consumers: 1. Name: ada2 Mediasize: 3000592982016 (2.7T) Sectorsize: 512 Stripesize: 4096 Stripeoffset: 0 Mode: r1w1e2 Geom name: ada3 modified: false state: OK fwheads: 16 fwsectors: 63 last: 5860533134 first: 34 entries: 128 scheme: GPT Providers: 1. Name: ada3p1 Mediasize: 3221225472 (3.0G) Sectorsize: 512 Stripesize: 4096 Stripeoffset: 0 Mode: r0w0e0 rawuuid: 2b570bb9-8e40-11e3-aa1c-d43d7ed5b587 rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b label: (null) length: 3221225472 offset: 65536 type: freebsd-swap index: 1 end: 6291583 start: 128 2. Name: ada3p2 Mediasize: 2997371670528 (2.7T) Sectorsize: 512 Stripesize: 4096 Stripeoffset: 0 Mode: r0w0e0 rawuuid: 2b70d9c0-8e40-11e3-aa1c-d43d7ed5b587 rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b label: (null) length: 2997371670528 offset: 3221291008 type: freebsd-zfs index: 2 end: 5860533127 start: 6291584 Consumers: 1. Name: ada3 Mediasize: 3000592982016 (2.7T) Sectorsize: 512 Stripesize: 4096 Stripeoffset: 0 Mode: r0w0e0 On Sat, May 28, 2016 at 4:07 PM, Evgeny Sam wrote: > BlackCat, > I ran the command "zpool import -fFn 2918670121059000644 zh_vol_old" > amd it did not work. > > [root@juicy] ~# zpool import -fFn 2918670121059000644 zh_vol_old > [root@juicy] ~# zpool status > no pools available > > I think it did not work, because I am running it on the clonned drives, > which have different GPID's, please correct me if I am wrong. I can switch > it to the original drives, if you suggest so. > > Kevin, > At this moment the third drive is connected and it is/was faulty. > Also, the rest of the drives are the clones of the original ones. > > Thank you, > > EVGENY. > > > On Fri, May 27, 2016 at 5:00 AM, wrote: > >> Send freebsd-fs mailing list submissions to >> freebsd-fs@freebsd.org >> >> To subscribe or unsubscribe via the World Wide Web, visit >> https://lists.freebsd.org/mailman/listinfo/freebsd-fs >> or, via email, send a message with subject or body 'help' to >> freebsd-fs-request@freebsd.org >> >> You can reach the person managing the list at >> freebsd-fs-owner@freebsd.org >> >> When replying, please edit your Subject line so it is more specific >> than "Re: Contents of freebsd-fs digest..." >> >> >> Today's Topics: >> >> 1. Re: ZFS - RAIDZ1 Recovery (Kevin P. Neal) >> 2. Re: ZFS - RAIDZ1 Recovery (BlackCat) >> 3. Re: ZFS - RAIDZ1 Recovery (InterNetX - Juergen Gotteswinter) >> 4. Re: ZFS - RAIDZ1 Recovery (Evgeny Sam) >> >> >> ---------------------------------------------------------------------- >> >> Message: 1 >> Date: Thu, 26 May 2016 20:47:10 -0400 >> From: "Kevin P. Neal" >> To: esamorokov >> Cc: freebsd-fs@freebsd.org, BlackCat >> Subject: Re: ZFS - RAIDZ1 Recovery >> Message-ID: <20160527004710.GA47195@neutralgood.org> >> Content-Type: text/plain; charset=us-ascii >> >> On Thu, May 26, 2016 at 03:26:18PM -0700, esamorokov wrote: >> > Hello All, >> > >> > My name is Evgeny and I have 3 x 3TB in RAIDZ1, where one drive is >> > gone and I accidentally >> > screwed the other two. The data should be fine, just need to revert >> > uberblock in point of time, where i started doing changes. >> >> You may need to ask on a ZFS or OpenZFS specific list. I'm not aware of >> many deep ZFS experts who hang out on this list. >> >> > History: >> > I was using WEB GUI of FreeNas and it reported a failed drive >> > I shutdown the computer and replaced the drive, but I did not >> > noticed that I accidentally disconnected power of another drive >> >> What happened to the third drive, the one you pulled? Did it fail >> in a way that may make it viable for an attempt to revive the pool? >> Or is it just a brick at this point in which case it is useless? >> >> If the third drive is perhaps usable then make sure all three are >> connected and powered up. >> -- >> Kevin P. Neal http://www.pobox.com/~kpn/ >> >> "Nonbelievers found it difficult to defend their position in \ >> the presense of a working computer." -- a DEC Jensen paper >> >> >> ------------------------------ >> >> Message: 2 >> Date: Fri, 27 May 2016 10:36:11 +0300 >> From: BlackCat >> To: esamorokov >> Cc: freebsd-fs@freebsd.org >> Subject: Re: ZFS - RAIDZ1 Recovery >> Message-ID: >> < >> CAD-rSeea_7TzxREVAsn8tKxLbtth62m3j8opsb2FoA3qc_ZrsQ@mail.gmail.com> >> Content-Type: text/plain; charset=UTF-8 >> >> Hello Evgeny, >> >> 2016-05-27 1:26 GMT+03:00 esamorokov : >> > I have 3 x 3TB in RAIDZ1, where one drive is gone and I accidentally >> > screwed the other two. The data should be fine, just need to revert >> > uberblock in point of time, where i started doing changes. >> > >> try the following command, it just checks whether is possible to >> import your pool by discarding some of the most recent writes): >> >> # zpool import -fFn 2918670121059000644 zh_vol_old >> >> Because you have already created a new pool with the same name as old, >> this command import pool by it ID (2918670121059000644) with new name >> (zh_vol_old). >> >> > History: >> > I was using WEB GUI of FreeNas and it reported a failed drive >> > I shutdown the computer and replaced the drive, but I did not >> noticed >> > that I accidentally disconnected power of another drive >> > I powered on the server and expanded the pool where there only one >> drive >> > of the pool was active >> >> As far as I understand attached log, zfs assumes that disk data >> corrupted. But this is quite stranger, since zfs normally survives if >> you forget to attach some disk during bad disk replacement. >> >> > Then I began to really learn ZFS and messing up with bits >> > At some point I created a backup bit-to-bit images of the two drives >> > from the pool (using R-Studio) >> > >> The question of curiosity: do you experimenting now with copies or >> with original disks? >> >> > >> > Specs: >> > OS: FreeBSD 9.2-RELEASE (FREENAS.amd64) #0 r+2315ea3: Fri Dec 20 >> > 12:48:50 PST 2013 >> > RAID: [root@juicy] ~# camcontrol devlist >> > at scbus1 target 0 lun 0 >> (pass1,ada1) >> > at scbus2 target 0 lun 0 >> (ada2,pass2) >> > at scbus3 target 0 lun 0 >> (pass3,ada3) >> > [root@juicy] ~# zdb >> > zh_vol: >> > version: 5000 >> > name: 'zh_vol' >> > state: 0 >> > txg: 14106447 >> > pool_guid: 2918670121059000644 >> > hostid: 1802987710 >> > hostname: '' >> > vdev_children: 1 >> > vdev_tree: >> > type: 'root' >> > id: 0 >> > guid: 2918670121059000644 >> > create_txg: 4 >> > children[0]: >> > type: 'raidz' >> > id: 0 >> > guid: 14123440993587991088 >> > nparity: 1 >> > metaslab_array: 34 >> > metaslab_shift: 36 >> > ashift: 12 >> > asize: 8995321675776 >> > is_log: 0 >> > create_txg: 4 >> > children[0]: >> > type: 'disk' >> > id: 0 >> > guid: 17624020450804741401 >> > path: '/dev/gptid/6e5cea27-7f52-11e3-9cd8-d43d7ed5b587' >> > whole_disk: 1 >> > DTL: 137 >> > create_txg: 4 >> > children[1]: >> > type: 'disk' >> > id: 1 >> > guid: 3253299067537287428 >> > path: '/dev/gptid/2b70d9c0-8e40-11e3-aa1c-d43d7ed5b587' >> > whole_disk: 1 >> > DTL: 133 >> > create_txg: 4 >> > children[2]: >> > type: 'disk' >> > id: 2 >> > guid: 17999524418015963258 >> > path: '/dev/gptid/1e898758-9488-11e3-a86e-d43d7ed5b587' >> > whole_disk: 1 >> > DTL: 134 >> > create_txg: 4 >> > features_for_read: >> >> -- >> BR BC >> >> >> ------------------------------ >> >> Message: 3 >> Date: Fri, 27 May 2016 09:30:30 +0200 >> From: InterNetX - Juergen Gotteswinter >> To: esamorokov , freebsd-fs@freebsd.org, >> BlackCat >> Subject: Re: ZFS - RAIDZ1 Recovery >> Message-ID: <3af5eba4-4e04-abc4-9fa7-d0a1ce47747e@internetx.com> >> Content-Type: text/plain; charset=windows-1252 >> >> Hi, >> >> after scrolling through the "History" i would wonder if its not >> completely messed up now. Less is more in such Situations.. >> >> Juergen >> >> Am 5/27/2016 um 12:26 AM schrieb esamorokov: >> > Hello All, >> > >> > My name is Evgeny and I have 3 x 3TB in RAIDZ1, where one drive is >> > gone and I accidentally >> > screwed the other two. The data should be fine, just need to revert >> > uberblock in point of time, where i started doing changes. >> > >> > I AM KINDLY ASKING FOR HELP! The pool had all of the family memories >> > for many years :( Thanks in advance! >> > >> > I am not a FreeBSD guru and have been using ZFS for a couple of >> > years, but I know Linux and do some programming/scripting. >> > Since I got that incident I started learning the depth of the ZFS, >> > but I definitely need help on it at this point. >> > Please don't ask me why I did not have backups, I was building >> > backup server in my garage, when it happened >> > >> > History: >> > I was using WEB GUI of FreeNas and it reported a failed drive >> > I shutdown the computer and replaced the drive, but I did not >> > noticed that I accidentally disconnected power of another drive >> > I powered on the server and expanded the pool where there only one >> > drive of the pool was active >> > Then I began to really learn ZFS and messing up with bits >> > At some point I created a backup bit-to-bit images of the two drives >> > from the pool (using R-Studio) >> > >> > >> > Specs: >> > OS: FreeBSD 9.2-RELEASE (FREENAS.amd64) #0 r+2315ea3: Fri Dec 20 >> > 12:48:50 PST 2013 >> > RAID: [root@juicy] ~# camcontrol devlist >> > at scbus1 target 0 lun 0 >> > (pass1,ada1) >> > at scbus2 target 0 lun 0 >> > (ada2,pass2) >> > at scbus3 target 0 lun 0 >> > (pass3,ada3) >> > [root@juicy] ~# zdb >> > zh_vol: >> > version: 5000 >> > name: 'zh_vol' >> > state: 0 >> > txg: 14106447 >> > pool_guid: 2918670121059000644 >> > hostid: 1802987710 >> > hostname: '' >> > vdev_children: 1 >> > vdev_tree: >> > type: 'root' >> > id: 0 >> > guid: 2918670121059000644 >> > create_txg: 4 >> > children[0]: >> > type: 'raidz' >> > id: 0 >> > guid: 14123440993587991088 >> > nparity: 1 >> > metaslab_array: 34 >> > metaslab_shift: 36 >> > ashift: 12 >> > asize: 8995321675776 >> > is_log: 0 >> > create_txg: 4 >> > children[0]: >> > type: 'disk' >> > id: 0 >> > guid: 17624020450804741401 >> > path: '/dev/gptid/6e5cea27-7f52-11e3-9cd8-d43d7ed5b587' >> > whole_disk: 1 >> > DTL: 137 >> > create_txg: 4 >> > children[1]: >> > type: 'disk' >> > id: 1 >> > guid: 3253299067537287428 >> > path: '/dev/gptid/2b70d9c0-8e40-11e3-aa1c-d43d7ed5b587' >> > whole_disk: 1 >> > DTL: 133 >> > create_txg: 4 >> > children[2]: >> > type: 'disk' >> > id: 2 >> > guid: 17999524418015963258 >> > path: '/dev/gptid/1e898758-9488-11e3-a86e-d43d7ed5b587' >> > whole_disk: 1 >> > DTL: 134 >> > create_txg: 4 >> > features_for_read: >> > >> > >> > _______________________________________________ >> > freebsd-fs@freebsd.org mailing list >> > https://lists.freebsd.org/mailman/listinfo/freebsd-fs >> > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" >> > >> >> >> ------------------------------ >> >> Message: 4 >> Date: Fri, 27 May 2016 00:38:56 -0700 >> From: Evgeny Sam >> To: jg@internetx.com >> Cc: BlackCat , freebsd-fs@freebsd.org >> Subject: Re: ZFS - RAIDZ1 Recovery >> Message-ID: >> > 4XKK7qiOTtYBka_gHzkVNyXh78ecvhOwqxpMZLdcsupw@mail.gmail.com> >> Content-Type: text/plain; charset=UTF-8 >> >> Hi, >> I don't know if it helps, but right after I recreated the pool with >> absolute paths of the drives (adaX) I made a bit-to-bit image copy of the >> drives. Now I am restoring those images to the NEW DRIVES (similar >> models). >> >> Thank you, >> Evgeny. >> On May 27, 2016 12:30 AM, "InterNetX - Juergen Gotteswinter" < >> jg@internetx.com> wrote: >> >> > Hi, >> > >> > after scrolling through the "History" i would wonder if its not >> > completely messed up now. Less is more in such Situations.. >> > >> > Juergen >> > >> > Am 5/27/2016 um 12:26 AM schrieb esamorokov: >> > > Hello All, >> > > >> > > My name is Evgeny and I have 3 x 3TB in RAIDZ1, where one drive is >> > > gone and I accidentally >> > > screwed the other two. The data should be fine, just need to >> revert >> > > uberblock in point of time, where i started doing changes. >> > > >> > > I AM KINDLY ASKING FOR HELP! The pool had all of the family >> memories >> > > for many years :( Thanks in advance! >> > > >> > > I am not a FreeBSD guru and have been using ZFS for a couple of >> > > years, but I know Linux and do some programming/scripting. >> > > Since I got that incident I started learning the depth of the ZFS, >> > > but I definitely need help on it at this point. >> > > Please don't ask me why I did not have backups, I was building >> > > backup server in my garage, when it happened >> > > >> > > History: >> > > I was using WEB GUI of FreeNas and it reported a failed drive >> > > I shutdown the computer and replaced the drive, but I did not >> > > noticed that I accidentally disconnected power of another drive >> > > I powered on the server and expanded the pool where there only one >> > > drive of the pool was active >> > > Then I began to really learn ZFS and messing up with bits >> > > At some point I created a backup bit-to-bit images of the two >> drives >> > > from the pool (using R-Studio) >> > > >> > > >> > > Specs: >> > > OS: FreeBSD 9.2-RELEASE (FREENAS.amd64) #0 r+2315ea3: Fri Dec 20 >> > > 12:48:50 PST 2013 >> > > RAID: [root@juicy] ~# camcontrol devlist >> > > at scbus1 target 0 lun 0 >> > > (pass1,ada1) >> > > at scbus2 target 0 lun 0 >> > > (ada2,pass2) >> > > at scbus3 target 0 lun 0 >> > > (pass3,ada3) >> > > [root@juicy] ~# zdb >> > > zh_vol: >> > > version: 5000 >> > > name: 'zh_vol' >> > > state: 0 >> > > txg: 14106447 >> > > pool_guid: 2918670121059000644 >> > > hostid: 1802987710 >> > > hostname: '' >> > > vdev_children: 1 >> > > vdev_tree: >> > > type: 'root' >> > > id: 0 >> > > guid: 2918670121059000644 >> > > create_txg: 4 >> > > children[0]: >> > > type: 'raidz' >> > > id: 0 >> > > guid: 14123440993587991088 >> > > nparity: 1 >> > > metaslab_array: 34 >> > > metaslab_shift: 36 >> > > ashift: 12 >> > > asize: 8995321675776 >> > > is_log: 0 >> > > create_txg: 4 >> > > children[0]: >> > > type: 'disk' >> > > id: 0 >> > > guid: 17624020450804741401 >> > > path: >> '/dev/gptid/6e5cea27-7f52-11e3-9cd8-d43d7ed5b587' >> > > whole_disk: 1 >> > > DTL: 137 >> > > create_txg: 4 >> > > children[1]: >> > > type: 'disk' >> > > id: 1 >> > > guid: 3253299067537287428 >> > > path: >> '/dev/gptid/2b70d9c0-8e40-11e3-aa1c-d43d7ed5b587' >> > > whole_disk: 1 >> > > DTL: 133 >> > > create_txg: 4 >> > > children[2]: >> > > type: 'disk' >> > > id: 2 >> > > guid: 17999524418015963258 >> > > path: >> '/dev/gptid/1e898758-9488-11e3-a86e-d43d7ed5b587' >> > > whole_disk: 1 >> > > DTL: 134 >> > > create_txg: 4 >> > > features_for_read: >> > > >> > > >> > > _______________________________________________ >> > > freebsd-fs@freebsd.org mailing list >> > > https://lists.freebsd.org/mailman/listinfo/freebsd-fs >> > > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" >> > > >> > >> >> >> ------------------------------ >> >> Subject: Digest Footer >> >> _______________________________________________ >> freebsd-fs@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-fs >> To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" >> >> ------------------------------ >> >> End of freebsd-fs Digest, Vol 672, Issue 6 >> ****************************************** >> > >