* BUG: >16TB Btrfs volumes are mountable on 32 bit kernels @ 2014-02-27 21:05 Chris Murphy 2014-02-27 21:07 ` Josef Bacik 0 siblings, 1 reply; 5+ messages in thread From: Chris Murphy @ 2014-02-27 21:05 UTC (permalink / raw) To: Btrfs BTRFS User reports successfully formatting and using an ~18TB Btrfs volume on hardware raid5 using i686 kernel for over a year, and then suddenly the file system starts behaving weirdly: http://www.mail-archive.com/linux-btrfs@vger.kernel.org/msg31856.html I think this is due to the kernel page cache address space being 16TB limited on 32-bit kernels, as mentioned by Dave Chinner in this thread: http://oss.sgi.com/pipermail/xfs/2014-February/034588.html So it sounds like it shouldn't be possible to mount a Btrfs volume larger than 16TB on 32-bit kernels. This is consistent with ext4 and XFS which refuse to mount large file systems. Chris Murphy ^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: BUG: >16TB Btrfs volumes are mountable on 32 bit kernels 2014-02-27 21:05 BUG: >16TB Btrfs volumes are mountable on 32 bit kernels Chris Murphy @ 2014-02-27 21:07 ` Josef Bacik 2014-02-27 21:13 ` Chris Murphy 2014-02-28 4:38 ` Dave Chinner 0 siblings, 2 replies; 5+ messages in thread From: Josef Bacik @ 2014-02-27 21:07 UTC (permalink / raw) To: Chris Murphy, Btrfs BTRFS -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 02/27/2014 04:05 PM, Chris Murphy wrote: > User reports successfully formatting and using an ~18TB Btrfs > volume on hardware raid5 using i686 kernel for over a year, and > then suddenly the file system starts behaving weirdly: > > https://urldefense.proofpoint.com/v1/url?u=http://www.mail-archive.com/linux-btrfs%40vger.kernel.org/msg31856.html&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=cKCbChRKsMpTX8ybrSkonQ%3D%3D%0A&m=6eUt5RgBggFh930oFrH19iR4z%2BFVzT%2F0%2F4dYPt3g48U%3D%0A&s=5ac126734d7fa1d3238ab09a2ddc021a8dcc8fff7b022560a4d068be2de37c00 > > > > I think this is due to the kernel page cache address space being > 16TB limited on 32-bit kernels, as mentioned by Dave Chinner in > this thread: > > https://urldefense.proofpoint.com/v1/url?u=http://oss.sgi.com/pipermail/xfs/2014-February/034588.html&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=cKCbChRKsMpTX8ybrSkonQ%3D%3D%0A&m=6eUt5RgBggFh930oFrH19iR4z%2BFVzT%2F0%2F4dYPt3g48U%3D%0A&s=3e45f9288e6a77bc1a24dded368802c2ab46b812bf59953f74d4ee1d4141f7d2 > > So it sounds like it shouldn't be possible to mount a Btrfs volume > larger than 16TB on 32-bit kernels. This is consistent with ext4 > and XFS which refuse to mount large file systems. > > Well that's not good, I'll fix this up. Thanks, Josef -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQIcBAEBAgAGBQJTD6j6AAoJEANb+wAKly3BhIEQAJheOf/NMEurHSlxnLWYuRog thRJMk+je1Ae9Sz93B5/0OztrmzYhK+OoQhWuF79OxVPoMeZ2Ta5qqmeNw3U+dRn T44SjlYRnerq0ksVt9xR9j2zMXWatgO5+20doZpeESco/IRWYkakQTyrWj9WUATN 7YQsxZB57nijrOvig0GPmMtH9PriscsPQhMVDuTDIHkvfWgk0M2oqu/0TZl9f5xA Es1uK0rv6KsExVQix+4GjWc/RBpl2QzxGEq/Ct+vcL+HaiKIERXuEw5liP9dSamj Wqbkkli+FDftBx/GXGTA38VYSxLExrlF891R4fOXWUcqDvlLwhdBpZExeYCV9MUz lEtaZaKUa3eeRBwzuxeLT8mEvY3BqvePQg8Io7auuIHG4fuRlOWWRiDG7bpTTPlD NFZACEDlGGdXNli7TqQ82La9kxFDvXCISnfxNbbu2vlXqL/HqQom1HiPwgMNIDQ7 0UIOLW5X+gg++kH7ArhOv19B7FR2i50wxuJSwj2/XSLELAPFAd9/BMI+3DXWfkE4 qZwnHEt8bVKR/yJ+srnRC2mZP41eHWHA6c9IXEGU/STy2uOdnwnXoS+KAdNWEt1d QRlr79S8Mhf7U8Acx/LhgwkbB1npmm0xssZmK2WycSyU7A66rdk0Cc+gfVyZOW5C k68LvCitzpU1W7MSMmPt =9S2b -----END PGP SIGNATURE----- ^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: BUG: >16TB Btrfs volumes are mountable on 32 bit kernels 2014-02-27 21:07 ` Josef Bacik @ 2014-02-27 21:13 ` Chris Murphy 2014-02-28 4:38 ` Dave Chinner 1 sibling, 0 replies; 5+ messages in thread From: Chris Murphy @ 2014-02-27 21:13 UTC (permalink / raw) To: Josef Bacik; +Cc: Btrfs BTRFS On Feb 27, 2014, at 2:07 PM, Josef Bacik <jbacik@fb.com> wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On 02/27/2014 04:05 PM, Chris Murphy wrote: >> User reports successfully formatting and using an ~18TB Btrfs >> volume on hardware raid5 using i686 kernel for over a year, and >> then suddenly the file system starts behaving weirdly: >> >> https://urldefense.proofpoint.com/v1/url?u=http://www.mail-archive.com/linux-btrfs%40vger.kernel.org/msg31856.html&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=cKCbChRKsMpTX8ybrSkonQ%3D%3D%0A&m=6eUt5RgBggFh930oFrH19iR4z%2BFVzT%2F0%2F4dYPt3g48U%3D%0A&s=5ac126734d7fa1d3238ab09a2ddc021a8dcc8fff7b022560a4d068be2de37c00 >> >> >> >> I think this is due to the kernel page cache address space being >> 16TB limited on 32-bit kernels, as mentioned by Dave Chinner in >> this thread: >> >> https://urldefense.proofpoint.com/v1/url?u=http://oss.sgi.com/pipermail/xfs/2014-February/034588.html&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=cKCbChRKsMpTX8ybrSkonQ%3D%3D%0A&m=6eUt5RgBggFh930oFrH19iR4z%2BFVzT%2F0%2F4dYPt3g48U%3D%0A&s=3e45f9288e6a77bc1a24dded368802c2ab46b812bf59953f74d4ee1d4141f7d2 >> >> So it sounds like it shouldn't be possible to mount a Btrfs volume >> larger than 16TB on 32-bit kernels. This is consistent with ext4 >> and XFS which refuse to mount large file systems. >> >> > > Well that's not good, I'll fix this up. Thanks, Is it a valid or goofy work around to partition this 21TB volume into two equal portions, and then: mkfs.btrfs -d single -m raid1 /dev/sdb[12] Maybe it's too much of an edge case to permit it even if it worked? Chris Murphy ^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: BUG: >16TB Btrfs volumes are mountable on 32 bit kernels 2014-02-27 21:07 ` Josef Bacik 2014-02-27 21:13 ` Chris Murphy @ 2014-02-28 4:38 ` Dave Chinner 2014-02-28 13:05 ` Josef Bacik 1 sibling, 1 reply; 5+ messages in thread From: Dave Chinner @ 2014-02-28 4:38 UTC (permalink / raw) To: Josef Bacik; +Cc: Chris Murphy, Btrfs BTRFS On Thu, Feb 27, 2014 at 04:07:06PM -0500, Josef Bacik wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On 02/27/2014 04:05 PM, Chris Murphy wrote: > > User reports successfully formatting and using an ~18TB Btrfs > > volume on hardware raid5 using i686 kernel for over a year, and > > then suddenly the file system starts behaving weirdly: > > > > https://urldefense.proofpoint.com/v1/url?u=http://www.mail-archive.com/linux-btrfs%40vger.kernel.org/msg31856.html&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=cKCbChRKsMpTX8ybrSkonQ%3D%3D%0A&m=6eUt5RgBggFh930oFrH19iR4z%2BFVzT%2F0%2F4dYPt3g48U%3D%0A&s=5ac126734d7fa1d3238ab09a2ddc021a8dcc8fff7b022560a4d068be2de37c00 > > > > > > > > I think this is due to the kernel page cache address space being > > 16TB limited on 32-bit kernels, as mentioned by Dave Chinner in > > this thread: > > > > https://urldefense.proofpoint.com/v1/url?u=http://oss.sgi.com/pipermail/xfs/2014-February/034588.html&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=cKCbChRKsMpTX8ybrSkonQ%3D%3D%0A&m=6eUt5RgBggFh930oFrH19iR4z%2BFVzT%2F0%2F4dYPt3g48U%3D%0A&s=3e45f9288e6a77bc1a24dded368802c2ab46b812bf59953f74d4ee1d4141f7d2 > > > > So it sounds like it shouldn't be possible to mount a Btrfs volume > > larger than 16TB on 32-bit kernels. This is consistent with ext4 > > and XFS which refuse to mount large file systems. > > > > > > Well that's not good, I'll fix this up. Thanks, Well, don't go assuming there's a problem just because I made an off-hand comment. i.e my comment was simply "maybe it hasn't been tested", and not an assertion that there is a bug or a problem.... Cheers, Dave. -- Dave Chinner david@fromorbit.com ^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: BUG: >16TB Btrfs volumes are mountable on 32 bit kernels 2014-02-28 4:38 ` Dave Chinner @ 2014-02-28 13:05 ` Josef Bacik 0 siblings, 0 replies; 5+ messages in thread From: Josef Bacik @ 2014-02-28 13:05 UTC (permalink / raw) To: Dave Chinner; +Cc: Chris Murphy, Btrfs BTRFS -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 02/27/2014 11:38 PM, Dave Chinner wrote: > On Thu, Feb 27, 2014 at 04:07:06PM -0500, Josef Bacik wrote: >> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 >> >> On 02/27/2014 04:05 PM, Chris Murphy wrote: >>> User reports successfully formatting and using an ~18TB Btrfs >>> volume on hardware raid5 using i686 kernel for over a year, >>> and then suddenly the file system starts behaving weirdly: >>> >>> https://urldefense.proofpoint.com/v1/url?u=http://www.mail-archive.com/linux-btrfs%40vger.kernel.org/msg31856.html&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=cKCbChRKsMpTX8ybrSkonQ%3D%3D%0A&m=6eUt5RgBggFh930oFrH19iR4z%2BFVzT%2F0%2F4dYPt3g48U%3D%0A&s=5ac126734d7fa1d3238ab09a2ddc021a8dcc8fff7b022560a4d068be2de37c00 >>> >>> >>> >>> >>> I think this is due to the kernel page cache address space being >>> 16TB limited on 32-bit kernels, as mentioned by Dave Chinner >>> in this thread: >>> >>> https://urldefense.proofpoint.com/v1/url?u=http://oss.sgi.com/pipermail/xfs/2014-February/034588.html&k=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0A&r=cKCbChRKsMpTX8ybrSkonQ%3D%3D%0A&m=6eUt5RgBggFh930oFrH19iR4z%2BFVzT%2F0%2F4dYPt3g48U%3D%0A&s=3e45f9288e6a77bc1a24dded368802c2ab46b812bf59953f74d4ee1d4141f7d2 >>> >>> >>> So it sounds like it shouldn't be possible to mount a Btrfs volume >>> larger than 16TB on 32-bit kernels. This is consistent with >>> ext4 and XFS which refuse to mount large file systems. >>> >>> >> >> Well that's not good, I'll fix this up. Thanks, > > Well, don't go assuming there's a problem just because I made an > off-hand comment. i.e my comment was simply "maybe it hasn't been > tested", and not an assertion that there is a bug or a problem.... > If I can't take your word as gospel then my whole life has been a lie! I'll look into it some more then but I seem to remember this being a real problem, like we'd wrap around in pagecache once we went above 16tb, which would cause problems for metadata since our btree inode is mapped logically to the entire fs. Thanks, Josef -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQIcBAEBAgAGBQJTEImAAAoJEANb+wAKly3BtrwP/jChKmHL74UNkeKytwRtbKn9 MxudB5MxzaAzYcXpwVXOxhDAYy870htbzyePddhEjMCubY5Hnb10klGx3QztxV1z G7qnoJp0FchpLSMSAhQE0B8steRTPbawKBIYqb1Kj7p39j+HmQ4K6fafcajtA929 rgFcNIa61rTjurknI9N9Lf2palReycl1Ee3psiH+mXN+RvPBAZ13sFp1sVJWJvoE qHDB0g1vC47MbsvrADMeI/W6MUS8hXaZ31xS5PVOBTQiabH2ycw2853fAJsVdSsZ 0oh4E8AwnWf5+/V0wqFXFE0zMoEpWOc5JScbWMB1kZYQbBLCWUue5olLoPyOv2M6 WUS89IpTrspQ80KvWIGN1Bg4p7BAJ2h74zWWrEyGLtt3ujoKffcycGI19i7ln9cq glLf8ofCiOCGs5VSTQMdSl6Eu0XYPQQViq0autpcBhkit0DV7A/caK+b351+t3c7 SI+Xx8LsvUVVATo11nSI/Z9lRol/XEX08G2XrDI+YiSOaW1qjDueNDBrpai/8gRt dN8qbooDPArf82maNfCXsuEkKQIvkICxhRc3BWFvKeS/UTw5T9Y20UWAwanJfRfD bLE357shUKimRtunr0MplQU9GVyCD/0tTtm3BPzOcWlG5QX7fugAobJPRqpQTD6b d6PAQswquwuEfcqr38nk =+lP6 -----END PGP SIGNATURE----- ^ permalink raw reply [flat|nested] 5+ messages in thread
end of thread, other threads:[~2014-02-28 13:05 UTC | newest] Thread overview: 5+ messages (download: mbox.gz follow: Atom feed -- links below jump to the message on this page -- 2014-02-27 21:05 BUG: >16TB Btrfs volumes are mountable on 32 bit kernels Chris Murphy 2014-02-27 21:07 ` Josef Bacik 2014-02-27 21:13 ` Chris Murphy 2014-02-28 4:38 ` Dave Chinner 2014-02-28 13:05 ` Josef Bacik
This is an external index of several public inboxes, see mirroring instructions on how to clone and mirror all data and code used by this external index.