Skip site navigation (1)Skip section navigation (2)
Date:      Tue, 8 Sep 2009 20:55:04 -0400
From:      Jeff Blank <jfb@mr-happy.com>
To:        Pawel Jakub Dawidek <pjd@FreeBSD.org>
Cc:        freebsd-current@freebsd.org
Subject:   Re: 8.0-BETA4 panic: ffs_sync: rofs mod
Message-ID:  <20090909005504.GA12660@mr-happy.com>
In-Reply-To: <20090908235731.GG1539@garage.freebsd.pl>
References:  <20090908202553.GA1368@mr-happy.com> <20090908235731.GG1539@garage.freebsd.pl>

next in thread | previous in thread | raw e-mail | index | archive | help

--qDbXVdCdHGoSgWSk
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline

On Wed, Sep 09, 2009 at 01:57:31AM +0200, Pawel Jakub Dawidek wrote:
> On Tue, Sep 08, 2009 at 04:25:53PM -0400, Jeff Blank wrote:
> > Please let me know if I need to provide more details.
> [...]
> > fs = /old
> > panic: ffs_sync: rofs mod
> 
> I have no idea why UFS thinks file system is read-only.

hmm, I do have it marked as read-only in /etc/fstab, but I'd been
mounting it with '-o rw'.  I just now commented out the fstab entry
and mounted it 'mount /dev/oldbender /old' and created files, and that
worked fine.

> I'm not able to reproduce your problem. Doing some stress tests on UFS
> on top of ZVOL seems to work for me.
> Is there anything unusual in your setup?

I don't think so.  maybe swapping to gmirror, but that's probably it.

> Maybe you could mail:
> 
> 	# zpool status
> 	# zpool list
> 	# zfs get -r all

attached.

Jeff

--qDbXVdCdHGoSgWSk
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline; filename="zfs_output.txt"

# zpool status
  pool: z0
 state: ONLINE
 scrub: none requested
config:

        NAME        STATE     READ WRITE CKSUM
        z0          ONLINE       0     0     0
          mirror    ONLINE       0     0     0
            ad4p3   ONLINE       0     0     0
            ad6p3   ONLINE       0     0     0

errors: No known data errors
# zpool list
NAME   SIZE   USED  AVAIL    CAP  HEALTH  ALTROOT
z0     141G  27.6G   113G    19%  ONLINE  -
# zfs get -r all
NAME          PROPERTY              VALUE                  SOURCE
z0            type                  filesystem             -
z0            creation              Thu Sep  3 23:16 2009  -
z0            used                  45.8G                  -
z0            available             93.0G                  -
z0            referenced            1.68G                  -
z0            compressratio         1.02x                  -
z0            mounted               yes                    -
z0            quota                 none                   default
z0            reservation           none                   default
z0            recordsize            128K                   default
z0            mountpoint            legacy                 local
z0            sharenfs              off                    default
z0            checksum              on                     default
z0            compression           off                    default
z0            atime                 on                     default
z0            devices               on                     default
z0            exec                  on                     default
z0            setuid                on                     default
z0            readonly              off                    local
z0            jailed                off                    default
z0            snapdir               hidden                 default
z0            aclmode               groupmask              default
z0            aclinherit            restricted             default
z0            canmount              on                     default
z0            shareiscsi            off                    default
z0            xattr                 off                    temporary
z0            copies                1                      default
z0            version               3                      -
z0            utf8only              off                    -
z0            normalization         none                   -
z0            casesensitivity       sensitive              -
z0            vscan                 off                    default
z0            nbmand                off                    default
z0            sharesmb              off                    default
z0            refquota              none                   default
z0            refreservation        none                   default
z0            primarycache          all                    default
z0            secondarycache        all                    default
z0            usedbysnapshots       0                      -
z0            usedbydataset         1.68G                  -
z0            usedbychildren        44.2G                  -
z0            usedbyrefreservation  0                      -
z0/crash      type                  filesystem             -
z0/crash      creation              Thu Sep  3 23:18 2009  -
z0/crash      used                  342M                   -
z0/crash      available             9.67G                  -
z0/crash      referenced            342M                   -
z0/crash      compressratio         2.88x                  -
z0/crash      mounted               yes                    -
z0/crash      quota                 10G                    local
z0/crash      reservation           none                   default
z0/crash      recordsize            128K                   default
z0/crash      mountpoint            /var/crash             local
z0/crash      sharenfs              off                    default
z0/crash      checksum              on                     default
z0/crash      compression           on                     local
z0/crash      atime                 on                     default
z0/crash      devices               on                     default
z0/crash      exec                  off                    local
z0/crash      setuid                off                    local
z0/crash      readonly              off                    inherited from z0
z0/crash      jailed                off                    default
z0/crash      snapdir               hidden                 default
z0/crash      aclmode               groupmask              default
z0/crash      aclinherit            restricted             default
z0/crash      canmount              on                     default
z0/crash      shareiscsi            off                    default
z0/crash      xattr                 off                    temporary
z0/crash      copies                1                      default
z0/crash      version               3                      -
z0/crash      utf8only              off                    -
z0/crash      normalization         none                   -
z0/crash      casesensitivity       sensitive              -
z0/crash      vscan                 off                    default
z0/crash      nbmand                off                    default
z0/crash      sharesmb              off                    default
z0/crash      refquota              none                   default
z0/crash      refreservation        none                   default
z0/crash      primarycache          all                    default
z0/crash      secondarycache        all                    default
z0/crash      usedbysnapshots       0                      -
z0/crash      usedbydataset         342M                   -
z0/crash      usedbychildren        0                      -
z0/crash      usedbyrefreservation  0                      -
z0/distfiles  type                  filesystem             -
z0/distfiles  creation              Thu Sep  3 23:19 2009  -
z0/distfiles  used                  4.93G                  -
z0/distfiles  available             93.0G                  -
z0/distfiles  referenced            4.93G                  -
z0/distfiles  compressratio         1.00x                  -
z0/distfiles  mounted               yes                    -
z0/distfiles  quota                 none                   default
z0/distfiles  reservation           none                   default
z0/distfiles  recordsize            128K                   default
z0/distfiles  mountpoint            /usr/local/distfiles   local
z0/distfiles  sharenfs              off                    default
z0/distfiles  checksum              on                     default
z0/distfiles  compression           off                    default
z0/distfiles  atime                 on                     default
z0/distfiles  devices               on                     default
z0/distfiles  exec                  on                     default
z0/distfiles  setuid                on                     default
z0/distfiles  readonly              off                    inherited from z0
z0/distfiles  jailed                off                    default
z0/distfiles  snapdir               hidden                 default
z0/distfiles  aclmode               groupmask              default
z0/distfiles  aclinherit            restricted             default
z0/distfiles  canmount              on                     default
z0/distfiles  shareiscsi            off                    default
z0/distfiles  xattr                 off                    temporary
z0/distfiles  copies                1                      default
z0/distfiles  version               3                      -
z0/distfiles  utf8only              off                    -
z0/distfiles  normalization         none                   -
z0/distfiles  casesensitivity       sensitive              -
z0/distfiles  vscan                 off                    default
z0/distfiles  nbmand                off                    default
z0/distfiles  sharesmb              off                    default
z0/distfiles  refquota              none                   default
z0/distfiles  refreservation        none                   default
z0/distfiles  primarycache          all                    default
z0/distfiles  secondarycache        all                    default
z0/distfiles  usedbysnapshots       0                      -
z0/distfiles  usedbydataset         4.93G                  -
z0/distfiles  usedbychildren        0                      -
z0/distfiles  usedbyrefreservation  0                      -
z0/homes      type                  filesystem             -
z0/homes      creation              Thu Sep  3 23:19 2009  -
z0/homes      used                  7.24G                  -
z0/homes      available             93.0G                  -
z0/homes      referenced            7.24G                  -
z0/homes      compressratio         1.00x                  -
z0/homes      mounted               yes                    -
z0/homes      quota                 none                   default
z0/homes      reservation           none                   default
z0/homes      recordsize            128K                   default
z0/homes      mountpoint            /usr/local/homes       local
z0/homes      sharenfs              off                    default
z0/homes      checksum              on                     default
z0/homes      compression           off                    default
z0/homes      atime                 on                     default
z0/homes      devices               on                     default
z0/homes      exec                  on                     default
z0/homes      setuid                on                     default
z0/homes      readonly              off                    inherited from z0
z0/homes      jailed                off                    default
z0/homes      snapdir               hidden                 default
z0/homes      aclmode               groupmask              default
z0/homes      aclinherit            restricted             default
z0/homes      canmount              on                     default
z0/homes      shareiscsi            off                    default
z0/homes      xattr                 off                    temporary
z0/homes      copies                1                      default
z0/homes      version               3                      -
z0/homes      utf8only              off                    -
z0/homes      normalization         none                   -
z0/homes      casesensitivity       sensitive              -
z0/homes      vscan                 off                    default
z0/homes      nbmand                off                    default
z0/homes      sharesmb              off                    default
z0/homes      refquota              none                   default
z0/homes      refreservation        none                   default
z0/homes      primarycache          all                    default
z0/homes      secondarycache        all                    default
z0/homes      usedbysnapshots       0                      -
z0/homes      usedbydataset         7.24G                  -
z0/homes      usedbychildren        0                      -
z0/homes      usedbyrefreservation  0                      -
z0/mp3        type                  filesystem             -
z0/mp3        creation              Thu Sep  3 23:19 2009  -
z0/mp3        used                  6.49G                  -
z0/mp3        available             93.0G                  -
z0/mp3        referenced            6.49G                  -
z0/mp3        compressratio         1.00x                  -
z0/mp3        mounted               yes                    -
z0/mp3        quota                 none                   default
z0/mp3        reservation           none                   default
z0/mp3        recordsize            128K                   default
z0/mp3        mountpoint            /usr/local/mp3         local
z0/mp3        sharenfs              off                    default
z0/mp3        checksum              on                     default
z0/mp3        compression           off                    default
z0/mp3        atime                 on                     default
z0/mp3        devices               on                     default
z0/mp3        exec                  on                     default
z0/mp3        setuid                on                     default
z0/mp3        readonly              off                    inherited from z0
z0/mp3        jailed                off                    default
z0/mp3        snapdir               hidden                 default
z0/mp3        aclmode               groupmask              default
z0/mp3        aclinherit            restricted             default
z0/mp3        canmount              on                     default
z0/mp3        shareiscsi            off                    default
z0/mp3        xattr                 off                    temporary
z0/mp3        copies                1                      default
z0/mp3        version               3                      -
z0/mp3        utf8only              off                    -
z0/mp3        normalization         none                   -
z0/mp3        casesensitivity       sensitive              -
z0/mp3        vscan                 off                    default
z0/mp3        nbmand                off                    default
z0/mp3        sharesmb              off                    default
z0/mp3        refquota              none                   default
z0/mp3        refreservation        none                   default
z0/mp3        primarycache          all                    default
z0/mp3        secondarycache        all                    default
z0/mp3        usedbysnapshots       0                      -
z0/mp3        usedbydataset         6.49G                  -
z0/mp3        usedbychildren        0                      -
z0/mp3        usedbyrefreservation  0                      -
z0/obj        type                  filesystem             -
z0/obj        creation              Thu Sep  3 23:20 2009  -
z0/obj        used                  3.15G                  -
z0/obj        available             93.0G                  -
z0/obj        referenced            3.15G                  -
z0/obj        compressratio         1.00x                  -
z0/obj        mounted               yes                    -
z0/obj        quota                 none                   default
z0/obj        reservation           none                   default
z0/obj        recordsize            128K                   default
z0/obj        mountpoint            /usr/obj               local
z0/obj        sharenfs              off                    default
z0/obj        checksum              on                     default
z0/obj        compression           off                    default
z0/obj        atime                 on                     default
z0/obj        devices               on                     default
z0/obj        exec                  on                     default
z0/obj        setuid                on                     default
z0/obj        readonly              off                    inherited from z0
z0/obj        jailed                off                    default
z0/obj        snapdir               hidden                 default
z0/obj        aclmode               groupmask              default
z0/obj        aclinherit            restricted             default
z0/obj        canmount              on                     default
z0/obj        shareiscsi            off                    default
z0/obj        xattr                 off                    temporary
z0/obj        copies                1                      default
z0/obj        version               3                      -
z0/obj        utf8only              off                    -
z0/obj        normalization         none                   -
z0/obj        casesensitivity       sensitive              -
z0/obj        vscan                 off                    default
z0/obj        nbmand                off                    default
z0/obj        sharesmb              off                    default
z0/obj        refquota              none                   default
z0/obj        refreservation        none                   default
z0/obj        primarycache          all                    default
z0/obj        secondarycache        all                    default
z0/obj        usedbysnapshots       0                      -
z0/obj        usedbydataset         3.15G                  -
z0/obj        usedbychildren        0                      -
z0/obj        usedbyrefreservation  0                      -
z0/ports      type                  filesystem             -
z0/ports      creation              Thu Sep  3 23:20 2009  -
z0/ports      used                  325M                   -
z0/ports      available             93.0G                  -
z0/ports      referenced            325M                   -
z0/ports      compressratio         1.20x                  -
z0/ports      mounted               yes                    -
z0/ports      quota                 none                   default
z0/ports      reservation           none                   default
z0/ports      recordsize            128K                   default
z0/ports      mountpoint            /usr/ports             local
z0/ports      sharenfs              off                    default
z0/ports      checksum              on                     default
z0/ports      compression           on                     local
z0/ports      atime                 on                     default
z0/ports      devices               on                     default
z0/ports      exec                  off                    local
z0/ports      setuid                off                    local
z0/ports      readonly              off                    inherited from z0
z0/ports      jailed                off                    default
z0/ports      snapdir               hidden                 default
z0/ports      aclmode               groupmask              default
z0/ports      aclinherit            restricted             default
z0/ports      canmount              on                     default
z0/ports      shareiscsi            off                    default
z0/ports      xattr                 off                    temporary
z0/ports      copies                1                      default
z0/ports      version               3                      -
z0/ports      utf8only              off                    -
z0/ports      normalization         none                   -
z0/ports      casesensitivity       sensitive              -
z0/ports      vscan                 off                    default
z0/ports      nbmand                off                    default
z0/ports      sharesmb              off                    default
z0/ports      refquota              none                   default
z0/ports      refreservation        none                   default
z0/ports      primarycache          all                    default
z0/ports      secondarycache        all                    default
z0/ports      usedbysnapshots       0                      -
z0/ports      usedbydataset         325M                   -
z0/ports      usedbychildren        0                      -
z0/ports      usedbyrefreservation  0                      -
z0/tmp        type                  filesystem             -
z0/tmp        creation              Thu Sep  3 23:17 2009  -
z0/tmp        used                  7.56M                  -
z0/tmp        available             5.99G                  -
z0/tmp        referenced            7.56M                  -
z0/tmp        compressratio         3.33x                  -
z0/tmp        mounted               yes                    -
z0/tmp        quota                 6G                     local
z0/tmp        reservation           none                   default
z0/tmp        recordsize            128K                   default
z0/tmp        mountpoint            /tmp                   local
z0/tmp        sharenfs              off                    default
z0/tmp        checksum              on                     default
z0/tmp        compression           on                     local
z0/tmp        atime                 on                     default
z0/tmp        devices               on                     default
z0/tmp        exec                  on                     default
z0/tmp        setuid                off                    local
z0/tmp        readonly              off                    inherited from z0
z0/tmp        jailed                off                    default
z0/tmp        snapdir               hidden                 default
z0/tmp        aclmode               groupmask              default
z0/tmp        aclinherit            restricted             default
z0/tmp        canmount              on                     default
z0/tmp        shareiscsi            off                    default
z0/tmp        xattr                 off                    temporary
z0/tmp        copies                1                      default
z0/tmp        version               3                      -
z0/tmp        utf8only              off                    -
z0/tmp        normalization         none                   -
z0/tmp        casesensitivity       sensitive              -
z0/tmp        vscan                 off                    default
z0/tmp        nbmand                off                    default
z0/tmp        sharesmb              off                    default
z0/tmp        refquota              none                   default
z0/tmp        refreservation        none                   default
z0/tmp        primarycache          all                    default
z0/tmp        secondarycache        all                    default
z0/tmp        usedbysnapshots       0                      -
z0/tmp        usedbydataset         7.56M                  -
z0/tmp        usedbychildren        0                      -
z0/tmp        usedbyrefreservation  0                      -
z0/ufs0       type                  volume                 -
z0/ufs0       creation              Tue Sep  8 20:47 2009  -
z0/ufs0       used                  18G                    -
z0/ufs0       available             111G                   -
z0/ufs0       referenced            6.79M                  -
z0/ufs0       compressratio         1.00x                  -
z0/ufs0       reservation           none                   default
z0/ufs0       volsize               18G                    -
z0/ufs0       volblocksize          8K                     -
z0/ufs0       checksum              on                     default
z0/ufs0       compression           off                    default
z0/ufs0       readonly              off                    inherited from z0
z0/ufs0       shareiscsi            off                    default
z0/ufs0       copies                1                      default
z0/ufs0       refreservation        18G                    local
z0/ufs0       primarycache          all                    default
z0/ufs0       secondarycache        all                    default
z0/ufs0       usedbysnapshots       0                      -
z0/ufs0       usedbydataset         6.79M                  -
z0/ufs0       usedbychildren        0                      -
z0/ufs0       usedbyrefreservation  18.0G                  -
z0/usr        type                  filesystem             -
z0/usr        creation              Thu Sep  3 23:17 2009  -
z0/usr        used                  259M                   -
z0/usr        available             93.0G                  -
z0/usr        referenced            259M                   -
z0/usr        compressratio         1.00x                  -
z0/usr        mounted               yes                    -
z0/usr        quota                 none                   default
z0/usr        reservation           none                   default
z0/usr        recordsize            128K                   default
z0/usr        mountpoint            /usr                   local
z0/usr        sharenfs              off                    default
z0/usr        checksum              on                     default
z0/usr        compression           off                    default
z0/usr        atime                 on                     default
z0/usr        devices               on                     default
z0/usr        exec                  on                     default
z0/usr        setuid                on                     default
z0/usr        readonly              off                    inherited from z0
z0/usr        jailed                off                    default
z0/usr        snapdir               hidden                 default
z0/usr        aclmode               groupmask              default
z0/usr        aclinherit            restricted             default
z0/usr        canmount              on                     default
z0/usr        shareiscsi            off                    default
z0/usr        xattr                 off                    temporary
z0/usr        copies                1                      default
z0/usr        version               3                      -
z0/usr        utf8only              off                    -
z0/usr        normalization         none                   -
z0/usr        casesensitivity       sensitive              -
z0/usr        vscan                 off                    default
z0/usr        nbmand                off                    default
z0/usr        sharesmb              off                    default
z0/usr        refquota              none                   default
z0/usr        refreservation        none                   default
z0/usr        primarycache          all                    default
z0/usr        secondarycache        all                    default
z0/usr        usedbysnapshots       0                      -
z0/usr        usedbydataset         259M                   -
z0/usr        usedbychildren        0                      -
z0/usr        usedbyrefreservation  0                      -
z0/usrlocal   type                  filesystem             -
z0/usrlocal   creation              Thu Sep  3 23:19 2009  -
z0/usrlocal   used                  3.08G                  -
z0/usrlocal   available             93.0G                  -
z0/usrlocal   referenced            3.08G                  -
z0/usrlocal   compressratio         1.00x                  -
z0/usrlocal   mounted               yes                    -
z0/usrlocal   quota                 none                   default
z0/usrlocal   reservation           none                   default
z0/usrlocal   recordsize            128K                   default
z0/usrlocal   mountpoint            /usr/local             local
z0/usrlocal   sharenfs              off                    default
z0/usrlocal   checksum              on                     default
z0/usrlocal   compression           off                    default
z0/usrlocal   atime                 on                     default
z0/usrlocal   devices               on                     default
z0/usrlocal   exec                  on                     default
z0/usrlocal   setuid                on                     default
z0/usrlocal   readonly              off                    inherited from z0
z0/usrlocal   jailed                off                    default
z0/usrlocal   snapdir               hidden                 default
z0/usrlocal   aclmode               groupmask              default
z0/usrlocal   aclinherit            restricted             default
z0/usrlocal   canmount              on                     default
z0/usrlocal   shareiscsi            off                    default
z0/usrlocal   xattr                 off                    temporary
z0/usrlocal   copies                1                      default
z0/usrlocal   version               3                      -
z0/usrlocal   utf8only              off                    -
z0/usrlocal   normalization         none                   -
z0/usrlocal   casesensitivity       sensitive              -
z0/usrlocal   vscan                 off                    default
z0/usrlocal   nbmand                off                    default
z0/usrlocal   sharesmb              off                    default
z0/usrlocal   refquota              none                   default
z0/usrlocal   refreservation        none                   default
z0/usrlocal   primarycache          all                    default
z0/usrlocal   secondarycache        all                    default
z0/usrlocal   usedbysnapshots       0                      -
z0/usrlocal   usedbydataset         3.08G                  -
z0/usrlocal   usedbychildren        0                      -
z0/usrlocal   usedbyrefreservation  0                      -
z0/var        type                  filesystem             -
z0/var        creation              Thu Sep  3 23:18 2009  -
z0/var        used                  110M                   -
z0/var        available             93.0G                  -
z0/var        referenced            110M                   -
z0/var        compressratio         1.00x                  -
z0/var        mounted               yes                    -
z0/var        quota                 none                   default
z0/var        reservation           none                   default
z0/var        recordsize            128K                   default
z0/var        mountpoint            /var                   local
z0/var        sharenfs              off                    default
z0/var        checksum              on                     default
z0/var        compression           off                    default
z0/var        atime                 on                     default
z0/var        devices               on                     default
z0/var        exec                  on                     default
z0/var        setuid                on                     default
z0/var        readonly              off                    inherited from z0
z0/var        jailed                off                    default
z0/var        snapdir               hidden                 default
z0/var        aclmode               groupmask              default
z0/var        aclinherit            restricted             default
z0/var        canmount              on                     default
z0/var        shareiscsi            off                    default
z0/var        xattr                 off                    temporary
z0/var        copies                1                      default
z0/var        version               3                      -
z0/var        utf8only              off                    -
z0/var        normalization         none                   -
z0/var        casesensitivity       sensitive              -
z0/var        vscan                 off                    default
z0/var        nbmand                off                    default
z0/var        sharesmb              off                    default
z0/var        refquota              none                   default
z0/var        refreservation        none                   default
z0/var        primarycache          all                    default
z0/var        secondarycache        all                    default
z0/var        usedbysnapshots       0                      -
z0/var        usedbydataset         110M                   -
z0/var        usedbychildren        0                      -
z0/var        usedbyrefreservation  0                      -
z0/vartmp     type                  filesystem             -
z0/vartmp     creation              Thu Sep  3 23:20 2009  -
z0/vartmp     used                  77K                    -
z0/vartmp     available             6.00G                  -
z0/vartmp     referenced            77K                    -
z0/vartmp     compressratio         1.33x                  -
z0/vartmp     mounted               yes                    -
z0/vartmp     quota                 6G                     local
z0/vartmp     reservation           256M                   local
z0/vartmp     recordsize            128K                   default
z0/vartmp     mountpoint            /var/tmp               local
z0/vartmp     sharenfs              off                    default
z0/vartmp     checksum              on                     default
z0/vartmp     compression           on                     local
z0/vartmp     atime                 on                     default
z0/vartmp     devices               on                     default
z0/vartmp     exec                  on                     default
z0/vartmp     setuid                off                    local
z0/vartmp     readonly              off                    inherited from z0
z0/vartmp     jailed                off                    default
z0/vartmp     snapdir               hidden                 default
z0/vartmp     aclmode               groupmask              default
z0/vartmp     aclinherit            restricted             default
z0/vartmp     canmount              on                     default
z0/vartmp     shareiscsi            off                    default
z0/vartmp     xattr                 off                    temporary
z0/vartmp     copies                1                      default
z0/vartmp     version               3                      -
z0/vartmp     utf8only              off                    -
z0/vartmp     normalization         none                   -
z0/vartmp     casesensitivity       sensitive              -
z0/vartmp     vscan                 off                    default
z0/vartmp     nbmand                off                    default
z0/vartmp     sharesmb              off                    default
z0/vartmp     refquota              none                   default
z0/vartmp     refreservation        none                   default
z0/vartmp     primarycache          all                    default
z0/vartmp     secondarycache        all                    default
z0/vartmp     usedbysnapshots       0                      -
z0/vartmp     usedbydataset         77K                    -
z0/vartmp     usedbychildren        0                      -
z0/vartmp     usedbyrefreservation  0                      -

--qDbXVdCdHGoSgWSk--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20090909005504.GA12660>