vardomskiy (vardomskiy) wrote,
vardomskiy
vardomskiy

  • Music:

ZFS - fragmentation between Oracle Solaris and OpenZFS implementation

Once Oracle bought Sun, and SXCE builds stopped, since I had no Solaris support, I switched to using OpenIndiana, and OpenIndiana worked well for the purpose of a fileserver.

Over the last 3 or 4 years, I pretty much stopped dealing with Solaris: Solaris is no-longer used at work, and being constantly busy, I pretty much left my OpenIndiana appliance to itself.

Yesterday I have tried to give Solaris 11.3 a go, primarily, because I am considering USB 3.0 support, that is not present in OpenIndiana, and, allegedly, present in Oracle Solaris 11.3.

What I found, is that Solaris 11.3 implementation of ZFS, with zpool version 37 and zfs version 6, is not compatible with OpenZFS implementation, that is present in OpenIndiana and that was ported to a handful of OSes. So ZFS have fragmented.

Of course, OpenZFS supports zpool version 28, and zfs version 5, however OpenZFS implemented the features capability, that is not present in Solaris ZFS, and presents Solaris 11.3 from mounting the pool.



oikaze:~ user$ ssh user@192.168.1.133
The authenticity of host '192.168.1.133 (192.168.1.133)' can't be established.
RSA key fingerprint is f2:17:ad:77:a8:b6:f2:a9:c7:a6:1c:15:45:7f:63:ad.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added '192.168.1.133' (RSA) to the list of known hosts.
Password: 
Warning: 1 failed authentication attempt at Tue Dec 30 19:00 1969 since last successful authentication.

Last login: Sun Jan 31 16:25:35 2016 from lowram
Oracle Corporation      SunOS 5.11      11.3    September 2015
user@lowram:~$ uname -a
SunOS lowram 5.11 11.3 i86pc i386 i86pc
user@lowram:~$ pkg list entire
NAME (PUBLISHER)                                  VERSION                    IFO
entire                                            0.5.11-0.175.3.1.0.5.0     i--
user@lowram:~$ zpool upgrade -v 
This system is currently running ZFS pool version 37.

The following versions are supported:

VER  DESCRIPTION
---  --------------------------------------------------------
 1   Initial ZFS version
 2   Ditto blocks (replicated metadata)
 3   Hot spares and double parity RAID-Z
 4   zpool history
 5   Compression using the gzip algorithm
 6   bootfs pool property
 7   Separate intent log devices
 8   Delegated administration
 9   refquota and refreservation properties
 10  Cache devices
 11  Improved scrub performance
 12  Snapshot properties
 13  snapused property
 14  passthrough-x aclinherit
 15  user/group space accounting
 16  stmf property support
 17  Triple-parity RAID-Z
 18  Snapshot user holds
 19  Log device removal
 20  Compression using zle (zero-length encoding)
 21  Deduplication
 22  Received properties
 23  Slim ZIL
 24  System attributes
 25  Improved scrub stats
 26  Improved snapshot deletion performance
 27  Improved snapshot creation performance
 28  Multiple vdev replacements
 29  RAID-Z/mirror hybrid allocator
 30  Encryption
 31  Improved 'zfs list' performance
 32  One MB blocksize
 33  Improved share support
 34  Sharing with inheritance
 35  Sequential resilver
 36  Efficient log block allocation
 37  lz4 compression
For more information on a particular version, including supported releases,
see the ZFS Administration Guide.

user@lowram:~$ 
user@lowram:~$ zfs upgrade -v 
The following filesystem versions are supported:

VER  DESCRIPTION
---  --------------------------------------------------------
 1   Initial ZFS filesystem version
 2   Enhanced directory entries
 3   Case insensitive and SMB credentials support
 4   userquota, groupquota properties
 5   System attributes
 6   Multilevel file system support

For more information on a particular version, including supported releases,
see the ZFS Administration Guide. 

user@lowram:~$ zpool get all rpool
NAME   PROPERTY       VALUE                 SOURCE
rpool  allocated      15.2G                 -
rpool  altroot        -                     default
rpool  autoexpand     off                   default
rpool  autoreplace    off                   default
rpool  bootfs         rpool/ROOT/solaris    local
rpool  cachefile      -                     default
rpool  capacity       20%                   -
rpool  dedupditto     0                     default
rpool  dedupratio     1.00x                 -
rpool  delegation     on                    default
rpool  failmode       wait                  default
rpool  free           58.8G                 -
rpool  guid           14887643662198180863  -
rpool  health         ONLINE                -
rpool  listshares     off                   default
rpool  listsnapshots  off                   default
rpool  readonly       off                   -
rpool  size           74G                   -
rpool  version        37                    default
user@lowram:~$ 


root@lowram:~# zpool import
  pool: braid
    id: 15034220794564382665
 state: UNAVAIL
status: The pool is formatted using an incompatible version.
action: The pool cannot be imported.  Access the pool on a system running newer
        software, or recreate the pool from backup.
   see: http://support.oracle.com/msg/ZFS-8000-A5
config:

        braid       UNAVAIL  newer version
          raidz1-0  ONLINE
            c4t0d0  ONLINE
            c4t0d1  ONLINE
            c4t0d2  ONLINE
            c4t0d3  ONLINE

device details:


  pool: brow
    id: 4216305602539210323
 state: UNAVAIL
status: The pool is formatted using an incompatible version.
action: The pool cannot be imported.  Access the pool on a system running newer
        software, or recreate the pool from backup.
   see: http://support.oracle.com/msg/ZFS-8000-A5
config:

        brow        UNAVAIL  newer version
          raidz1-0  ONLINE
            c3t0d0  ONLINE
            c3t0d1  ONLINE
            c3t0d2  ONLINE
            c3t0d3  ONLINE

device details:


  pool: test
    id: 6602978468318297097
 state: UNAVAIL
status: One or more devices are unavailable.
action: The pool cannot be imported due to unavailable devices or data.
config:

        test      UNAVAIL  insufficient replicas
          c2t0d0  UNAVAIL  corrupted data

device details:

        c2t0d0  UNAVAIL           corrupted data
        status: ZFS detected errors on this device.
                The device has invalid label.


user@lowram:~$ 


and here is comparison with OpenIndiana (not the latest, but still a good indicator):

oikaze:download user$ ssh user@192.168.1.209
Password: 
Last login: Mon Feb  1 05:09:25 2016
OpenIndiana (powered by illumos)    SunOS 5.11    oi_151a9    November 2013
user@smalldisk:~$ uname -a
SunOS smalldisk 5.11 oi_151a9 i86pc i386 i86pc Solaris
user@smalldisk:~$ pkg list entire
NAME (PUBLISHER)                                  VERSION                    IFO
entire                                            0.5.11-0.151.1.9           i--
user@smalldisk:~$ zpool upgrade -v
This system supports ZFS pool feature flags.

The following features are supported:

FEAT DESCRIPTION
-------------------------------------------------------------
async_destroy                         (read-only compatible)
     Destroy filesystems asynchronously.
empty_bpobj                           (read-only compatible)
     Snapshots use less space.
lz4_compress                         
     LZ4 compression algorithm support.
multi_vdev_crash_dump                
     Crash dumps to multiple vdev pools.

The following legacy versions are also supported:

VER  DESCRIPTION
---  --------------------------------------------------------
 1   Initial ZFS version
 2   Ditto blocks (replicated metadata)
 3   Hot spares and double parity RAID-Z
 4   zpool history
 5   Compression using the gzip algorithm
 6   bootfs pool property
 7   Separate intent log devices
 8   Delegated administration
 9   refquota and refreservation properties
 10  Cache devices
 11  Improved scrub performance
 12  Snapshot properties
 13  snapused property
 14  passthrough-x aclinherit
 15  user/group space accounting
 16  stmf property support
 17  Triple-parity RAID-Z
 18  Snapshot user holds
 19  Log device removal
 20  Compression using zle (zero-length encoding)
 21  Deduplication
 22  Received properties
 23  Slim ZIL
 24  System attributes
 25  Improved scrub stats
 26  Improved snapshot deletion performance
 27  Improved snapshot creation performance
 28  Multiple vdev replacements

For more information on a particular version, including supported releases,
see the ZFS Administration Guide.

user@smalldisk:~$ zfs upgrade -v
The following filesystem versions are supported:

VER  DESCRIPTION
---  --------------------------------------------------------
 1   Initial ZFS filesystem version
 2   Enhanced directory entries
 3   Case insensitive and filesystem user identifier (FUID)
 4   userquota, groupquota properties
 5   System attributes

For more information on a particular version, including supported releases,
see the ZFS Administration Guide.

user@smalldisk:~$ zpool list
NAME    SIZE  ALLOC   FREE  EXPANDSZ    CAP  DEDUP  HEALTH  ALTROOT
braid  10.9T  10.2T   648G         -    94%  1.00x  ONLINE  -
brow   10.9T  7.19T  3.68T         -    66%  1.00x  ONLINE  -
rpool   464G  8.11G   456G         -     1%  1.00x  ONLINE  -
user@smalldisk:~$ zpool get all rpool
NAME   PROPERTY                       VALUE                          SOURCE
rpool  size                           464G                           -
rpool  capacity                       1%                             -
rpool  altroot                        -                              default
rpool  health                         ONLINE                         -
rpool  guid                           3801163999201930205            default
rpool  version                        -                              default
rpool  bootfs                         rpool/ROOT/openindiana-2       local
rpool  delegation                     on                             default
rpool  autoreplace                    off                            default
rpool  cachefile                      -                              default
rpool  failmode                       wait                           default
rpool  listsnapshots                  off                            default
rpool  autoexpand                     off                            default
rpool  dedupditto                     0                              default
rpool  dedupratio                     1.00x                          -
rpool  free                           456G                           -
rpool  allocated                      8.11G                          -
rpool  readonly                       off                            -
rpool  comment                        -                              default
rpool  expandsize                     0                              -
rpool  freeing                        0                              default
rpool  feature@async_destroy          enabled                        local
rpool  feature@empty_bpobj            active                         local
rpool  feature@lz4_compress           enabled                        local
rpool  feature@multi_vdev_crash_dump  disabled                       local
user@smalldisk:~$ sudo /bin/bash
root@smalldisk:/home/user# zpool status 
  pool: braid
 state: ONLINE
status: Some supported features are not enabled on the pool. The pool can
        still be used, but some features are unavailable.
action: Enable all features using 'zpool upgrade'. Once this is done,
        the pool may no longer be accessible by software that does not support
        the features. See zpool-features(5) for details.
  scan: scrub repaired 0 in 111h12m with 0 errors on Fri Jan 24 18:19:38 2014
config:

        NAME        STATE     READ WRITE CKSUM
        braid       ONLINE       0     0     0
          raidz1-0  ONLINE       0     0     0
            c5t0d0  ONLINE       0     0     0
            c5t0d1  ONLINE       0     0     0
            c5t0d2  ONLINE       0     0     0
            c5t0d3  ONLINE       0     0     0

errors: No known data errors

  pool: brow
 state: ONLINE
  scan: scrub canceled on Wed Feb  5 09:23:18 2014
config:

        NAME        STATE     READ WRITE CKSUM
        brow        ONLINE       0     0     0
          raidz1-0  ONLINE       0     0     0
            c4t0d0  ONLINE       0     0     0
            c4t0d1  ONLINE       0     0     0
            c4t0d2  ONLINE       0     0     0
            c4t0d3  ONLINE       0     0     0

errors: No known data errors

  pool: rpool
 state: ONLINE
status: Some supported features are not enabled on the pool. The pool can
        still be used, but some features are unavailable.
action: Enable all features using 'zpool upgrade'. Once this is done,
        the pool may no longer be accessible by software that does not support
        the features. See zpool-features(5) for details.
  scan: none requested
config:

        NAME        STATE     READ WRITE CKSUM
        rpool       ONLINE       0     0     0
          c0d1s0    ONLINE       0     0     0

errors: No known data errors
root@smalldisk:/home/user# zpool get all brow
NAME  PROPERTY                       VALUE                          SOURCE
brow  size                           10.9T                          -
brow  capacity                       66%                            -
brow  altroot                        -                              default
brow  health                         ONLINE                         -
brow  guid                           4216305602539210323            default
brow  version                        -                              default
brow  bootfs                         -                              default
brow  delegation                     on                             default
brow  autoreplace                    off                            default
brow  cachefile                      -                              default
brow  failmode                       wait                           default
brow  listsnapshots                  off                            default
brow  autoexpand                     off                            default
brow  dedupditto                     0                              default
brow  dedupratio                     1.00x                          -
brow  free                           3.68T                          -
brow  allocated                      7.19T                          -
brow  readonly                       off                            -
brow  comment                        -                              default
brow  expandsize                     0                              -
brow  freeing                        0                              default
brow  feature@async_destroy          enabled                        local
brow  feature@empty_bpobj            active                         local
brow  feature@lz4_compress           enabled                        local
brow  feature@multi_vdev_crash_dump  enabled                        local
You have new mail in /var/mail/root
root@smalldisk:/home/user# 
Subscribe

  • Post a new comment

    Error

    default userpic

    Your reply will be screened

    When you submit the form an invisible reCAPTCHA check will be performed.
    You must follow the Privacy Policy and Google Terms of use.
  • 0 comments