From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-pg1-f171.google.com ([209.85.215.171]:42730 "EHLO mail-pg1-f171.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727176AbeIRAvu (ORCPT ); Mon, 17 Sep 2018 20:51:50 -0400 Received: by mail-pg1-f171.google.com with SMTP id y4-v6so8123743pgp.9 for ; Mon, 17 Sep 2018 12:23:07 -0700 (PDT) Received: from lenny (c-24-21-129-198.hsd1.or.comcast.net. [24.21.129.198]) by smtp.gmail.com with ESMTPSA id f75-v6sm28363962pfk.85.2018.09.17.12.23.05 for (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Mon, 17 Sep 2018 12:23:05 -0700 (PDT) Date: Mon, 17 Sep 2018 12:23:03 -0700 From: Zach Brown To: linux-fsdevel Subject: ANNOUNCE: ScoutFS archival filesystem code published Message-ID: <20180917192303.GA26394@lenny> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Sender: linux-fsdevel-owner@vger.kernel.org List-ID: Greetings -fsdevel, Today we at Versity are opening the code to ScoutFS, the clustered file system that we've been developing as part of our larger software stack that supports large scale archives. The motivation for the project and the architectural decisions that we've made can be found in the white paper that is linked off of https://www.scoutfs.org/ . We've also set up a scoutfs-devel@scoutfs.org development mailing list and have an open Slack channel, both are linked off of the scoutfs.org site. The README.md in the kernel module github repo at https://github.com/versity/scoutfs-kmod-dev/ describes the quick steps needed to get a system up and running. For the expert audience, here's the overview of the project: - Clustered file system using a shared block device. - Shared LSM indexing of metadata to encourage concurrent updates. - Integrated archival interfaces (indexing, "offline" extent tracking). - Batch locking to reduce the cost of enforcing full POSIX. - Initial development targets RHEL/CentOS kernels. - What you'd expect: atomic transactions, metadata checksums, extents. This code can be considered a rough beta. The large architectural structures are there for review, and what is implemented has been well exercised, but a lot remains to be implemented before we declare the format fixed and submit the code upstream. We're opening the project early to give the community the opportunity to contribute to the design and implementation. In the coming weeks I'll personally be focusing on some big ticket functional items (deleted inode cleanup in particular), hardening a few recovery cases after crashes, and in general spending all of my will power focusing on that responsible nonsense instead of getting lost in satisfying performance tuning. Ask me anything :), - z