From mboxrd@z Thu Jan 1 00:00:00 1970 From: Jaegeuk Kim Subject: Re: [f2fs-dev] [RFC 0/5] Enable f2fs support inline data Date: Wed, 05 Jun 2013 16:13:34 +0900 Message-ID: <1370416414.3600.36.camel@kjgkr> References: <1370253854-15084-1-git-send-email-huajun.li@intel.com> <1370312366.3600.3.camel@kjgkr> <20130604060119.GA3265@hli22-desktop> Reply-To: jaegeuk.kim@samsung.com Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="===============6565503114481591926==" Return-path: Received: from sog-mx-4.v43.ch3.sourceforge.com ([172.29.43.194] helo=mx.sourceforge.net) by sfs-ml-2.v29.ch3.sourceforge.com with esmtp (Exim 4.76) (envelope-from ) id 1Uk7vv-0000zK-Sn for linux-f2fs-devel@lists.sourceforge.net; Wed, 05 Jun 2013 07:14:59 +0000 Received: from mailout4.samsung.com ([203.254.224.34]) by sog-mx-4.v43.ch3.sourceforge.com with esmtp (Exim 4.76) id 1Uk7vr-0000QN-VC for linux-f2fs-devel@lists.sourceforge.net; Wed, 05 Jun 2013 07:14:59 +0000 Received: from epcpsbgr3.samsung.com (u143.gpu120.samsung.co.kr [203.254.230.143]) by mailout4.samsung.com (Oracle Communications Messaging Server 7u4-24.01 (7.0.4.24.0) 64bit (built Nov 17 2011)) with ESMTP id <0MNW008O5S4GXJI0@mailout4.samsung.com> for linux-f2fs-devel@lists.sourceforge.net; Wed, 05 Jun 2013 16:14:49 +0900 (KST) In-reply-to: <20130604060119.GA3265@hli22-desktop> List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: linux-f2fs-devel-bounces@lists.sourceforge.net To: Haicheng Li Cc: Namjae Jeon , Huajun Li , linux-kernel@vger.kernel.org, namjae.jeon@samsung.com, linux-fsdevel@vger.kernel.org, linux-f2fs-devel@lists.sourceforge.net --===============6565503114481591926== Content-type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="=-pgFXLHbwhUk4xr7kVXWL" --=-pgFXLHbwhUk4xr7kVXWL Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi Haicheng, 2013-06-04 (=ED=99=94), 14:01 +0800, Haicheng Li: > Hi Jaegeuk & Namjae, >=20 > Sure, we'll address your comments. And this version is RFC, just wanna to > make sure this feature is meaningful for f2fs project, and there is no ob= vious > mistake, e.g. missing some critical path. IMO, it is worth to design and implement the inline feature though, I'd like to review the total design before looking at trivial mistakes. Since if the initial design is changed frequently, we need to review again and again. So, we need to decide the overall inline design. Currently we have to consider three data structures at a same time for the on-disk *inline* inode block structure, which are data, dentry, and xattr as well. IMO, we can give three inode flags: F2FS_INLINE_DATA, F2FS_INLINE_DENT, and F2FS_INLINE_XATTR. < on-disk inode block > - metadata - if F2FS_INLINE_XATTR is set, : use fixed 2*255 bytes to *cache* two xattrs for simplicity `- if F2FS_INLINE_DATA is set, : use the remained space varied by F2FS_INLINE_XATTR. `- if F2FS_INLINE_DENT is set, : use variable number of dentries determined by F2FS_INLINE_XATTR. `- Otherwise, use as pointers And then, we need to define how to deal with their combinations. Operational conditions ---------------------- - use inline xattr or not, by checking other inline flags and inline data size. - calculate inline data size and its offset according to the use of inline xattrs. - the places of inline operaions wrt the lock consistency and coverage - Power-off-recovery routine should care about the on-disk inode structure. - unset F2FS_INLINE_DATA if i_size =3D 0 - unset F2FS_INLINE_XATTR if xattr entries =3D 0 - unset F2FS_INLINE_DENT if dentries =3D 0 - what else? Once we design the whole thing, we can make general functions to deal with them gracefully. > And if you team has some special opensource test suites used in your dail= y > f2fs test cycle, pls. kindly share the info with us, then we can make sur= e our > patchset can pass these cases before we send out next version. 1. xfstests for functionality 2. fsstress for deadlock/consistency check 3. power-off with fsstress Thanks, > BTW, test the kernel source tree or kernel build is a good suggestion. th= anks. >=20 > On Tue, Jun 04, 2013 at 01:23:57PM +0900, Namjae Jeon wrote: > > Hi. Huajun. > >=20 > > I agree jaegeuk's opinion. > > Additionally, It is better that you describe the effect in change-log > > when this feature is added to f2fs. > > e.g. > > 1. how much space is saved when storing kernel-tree(small files) ? > > 2. small files creation performance test. > > 3. file look-up performance test. > > 4. other performance tools 's result. > >=20 > > Thanks. > >=20 > > 2013/6/4 Jaegeuk Kim : > > > Hi, > > > > > > This feature is one of my todo items. ;) > > > Thank you for the contribution. > > > > > > Before reviewing the below code intensively, we need to check the > > > following issues. > > > > > > - deadlock conditions > > > - FS consistency > > > - recovery routine > > > > > > Could you check one more time? > > > Thanks again, > > > > > > 2013-06-03 (=EC=9B=94), 18:04 +0800, Huajun Li: > > >> f2fs inode is so large, small files can be stored directly in the in= ode, > > >> rather than just storing a single block address and storing the data= elsewhere. > > >> > > >> This RFC patch set is just to enable f2fs support inline data: files= less than > > >> about 3.6K can be stored directly in inode block. > > >> > > >> TODO: make small dirs inline too. > > >> > > >> > > >> Haicheng Li (3): > > >> f2fs: Add helper functions and flag to support inline data > > >> f2fs: Add interface for inline data support > > >> f2fs: add tracepoints to debug inline data operations > > >> > > >> Huajun Li (2): > > >> f2fs: Handle inline data read and write > > >> f2fs: Key functions to handle inline data > > >> > > >> fs/f2fs/Kconfig | 10 +++ > > >> fs/f2fs/Makefile | 1 + > > >> fs/f2fs/data.c | 78 +++++++++++++++++++++- > > >> fs/f2fs/f2fs.h | 70 +++++++++++++++++++ > > >> fs/f2fs/file.c | 9 ++- > > >> fs/f2fs/inline.c | 156 ++++++++++++++++++++++++++++++++= +++++++++++ > > >> fs/f2fs/inode.c | 8 +++ > > >> include/linux/f2fs_fs.h | 5 ++ > > >> include/trace/events/f2fs.h | 69 +++++++++++++++++++ > > >> 9 files changed, 402 insertions(+), 4 deletions(-) > > >> create mode 100644 fs/f2fs/inline.c > > >> > > > > > > -- > > > Jaegeuk Kim > > > Samsung > > -- > > To unsubscribe from this list: send the line "unsubscribe linux-fsdevel= " in > > the body of a message to majordomo@vger.kernel.org > > More majordomo info at http://vger.kernel.org/majordomo-info.html --=20 Jaegeuk Kim Samsung --=-pgFXLHbwhUk4xr7kVXWL Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part Content-Transfer-Encoding: 7bit -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQIcBAABAgAGBQJRruUeAAoJEEAUqH6CSFDS6PMP/ih3KAKfvnSNuoHdux33XQyl eJYQnFulENarOOeHeOkyqnSUVKC5BL/9INY5vQduKKCODiDDlA5bzqCVPEmKvD4A Ec1SudKd4HYgAwKn9MAw/UMwDuoZifSapjQACGIaaXUFK5/QnjWNiLiWcr7xoO14 LAB0GNs1bt3CGR5JrFuWv9QHvn/u+eR8HUUt955aYiyFOg2m3nJvhzkSFmgzdKz2 q3POj2E8KQOeej4rdXBvrXtxl4X9EPh2Tt1ZThK8BojUxixgEQw3eWC1RVjbQ4wq +nXvEmP7P6cvTAAyzj1dNXeUYyX0t1Xo6Bbz9AbEiQHl4MVTfT2O0HUFqS2CdkRD 90VnbkRHwjIpguXkYQ0yUHbvvvF6IxZsSroQhFzQS4i5Q802HtQYKP4mGndAXIwg 3I33ckwXB/wozXXCAmwDxvWgOfnaIfYZd8Ab3ASI6l0TovSESFwXkLNP2YnEwmB9 4q9OjATp0DUvRRGd1fzX1N52fKEpXm64DoFJNw5ee4Qzz7dp9GvCi9tbHl4SK/7i NAve6s8J0qXTETcb3ZlYeu2Td5RN7oSmTNvzH1E9Kt3QC6fep5VA/mLJKEoHyCYW F8UfPd8kFgaS/0a9YZjqvEWQ0tVKf0kr3k3XJRaIH4PRtKPPTNCs1nMcI1F2h4Yt F7r2Jylm7Kj5d2dzNhu8 =f46L -----END PGP SIGNATURE----- --=-pgFXLHbwhUk4xr7kVXWL-- --===============6565503114481591926== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline ------------------------------------------------------------------------------ How ServiceNow helps IT people transform IT departments: 1. A cloud service to automate IT design, transition and operations 2. Dashboards that offer high-level views of enterprise services 3. A single system of record for all IT processes http://p.sf.net/sfu/servicenow-d2d-j --===============6565503114481591926== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Linux-f2fs-devel mailing list Linux-f2fs-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/linux-f2fs-devel --===============6565503114481591926==--