* [PATCH 1/2] btrfs: fix null pointer dereference in clone_fs_devices when name is null @ 2014-06-30 9:12 Anand Jain 2014-06-30 9:12 ` [PATCH 2/2] btrfs: fix null pointer dereference in btrfs_show_devname " Anand Jain 2014-06-30 10:02 ` [PATCH 1/2] btrfs: fix null pointer dereference in clone_fs_devices " Miao Xie 0 siblings, 2 replies; 10+ messages in thread From: Anand Jain @ 2014-06-30 9:12 UTC (permalink / raw) To: linux-btrfs when one of the device path is missing btrfs_device name is null. So this patch will check for that. stack: BUG: unable to handle kernel NULL pointer dereference at 0000000000000010 IP: [<ffffffff812e18c0>] strlen+0x0/0x30 [<ffffffffa01cd92a>] ? clone_fs_devices+0xaa/0x160 [btrfs] [<ffffffffa01cdcf7>] btrfs_init_new_device+0x317/0xca0 [btrfs] [<ffffffff81155bca>] ? __kmalloc_track_caller+0x15a/0x1a0 [<ffffffffa01d6473>] btrfs_ioctl+0xaa3/0x2860 [btrfs] [<ffffffff81132a6c>] ? handle_mm_fault+0x48c/0x9c0 [<ffffffff81192a61>] ? __blkdev_put+0x171/0x180 [<ffffffff817a784c>] ? __do_page_fault+0x4ac/0x590 [<ffffffff81193426>] ? blkdev_put+0x106/0x110 [<ffffffff81179175>] ? mntput+0x35/0x40 [<ffffffff8116d4b0>] do_vfs_ioctl+0x460/0x4a0 [<ffffffff8115c72e>] ? ____fput+0xe/0x10 [<ffffffff81068033>] ? task_work_run+0xb3/0xd0 [<ffffffff8116d547>] SyS_ioctl+0x57/0x90 [<ffffffff817a793e>] ? do_page_fault+0xe/0x10 [<ffffffff817abe52>] system_call_fastpath+0x16/0x1b reproducer: mkfs.btrfs -draid1 -mraid1 /dev/sdg1 /dev/sdg2 btrfstune -S 1 /dev/sdg1 modprobe -r btrfs && modprobe btrfs mount -o degraded /dev/sdg1 /btrfs btrfs dev add /dev/sdg3 /btrfs Signed-off-by: Anand Jain <Anand.Jain@oracle.com> --- fs/btrfs/volumes.c | 12 +++++++----- 1 file changed, 7 insertions(+), 5 deletions(-) diff --git a/fs/btrfs/volumes.c b/fs/btrfs/volumes.c index 24477a4..66991c6 100644 --- a/fs/btrfs/volumes.c +++ b/fs/btrfs/volumes.c @@ -739,12 +739,14 @@ static struct btrfs_fs_devices *clone_fs_devices(struct btrfs_fs_devices *orig) * This is ok to do without rcu read locked because we hold the * uuid mutex so nothing we touch in here is going to disappear. */ - name = rcu_string_strdup(orig_dev->name->str, GFP_NOFS); - if (!name) { - kfree(device); - goto error; + if (orig_dev->name) { + name = rcu_string_strdup(orig_dev->name->str, GFP_NOFS); + if (!name) { + kfree(device); + goto error; + } + rcu_assign_pointer(device->name, name); } - rcu_assign_pointer(device->name, name); list_add(&device->dev_list, &fs_devices->devices); device->fs_devices = fs_devices; -- 2.0.0.257.g75cc6c6 ^ permalink raw reply related [flat|nested] 10+ messages in thread
* [PATCH 2/2] btrfs: fix null pointer dereference in btrfs_show_devname when name is null 2014-06-30 9:12 [PATCH 1/2] btrfs: fix null pointer dereference in clone_fs_devices when name is null Anand Jain @ 2014-06-30 9:12 ` Anand Jain 2014-06-30 10:02 ` [PATCH 1/2] btrfs: fix null pointer dereference in clone_fs_devices " Miao Xie 1 sibling, 0 replies; 10+ messages in thread From: Anand Jain @ 2014-06-30 9:12 UTC (permalink / raw) To: linux-btrfs dev->name is null but missing flag is not set. Strictly speaking the missing flag should have been set, but there are more places where code just checks if name is null. For now this patch does the same. stack: BUG: unable to handle kernel NULL pointer dereference at 0000000000000064 IP: [<ffffffffa0228908>] btrfs_show_devname+0x58/0xf0 [btrfs] [<ffffffff81198879>] show_vfsmnt+0x39/0x130 [<ffffffff81178056>] m_show+0x16/0x20 [<ffffffff8117d706>] seq_read+0x296/0x390 [<ffffffff8115aa7d>] vfs_read+0x9d/0x160 [<ffffffff8115b549>] SyS_read+0x49/0x90 [<ffffffff817abe52>] system_call_fastpath+0x16/0x1b reproducer: mkfs.btrfs -draid1 -mraid1 /dev/sdg1 /dev/sdg2 btrfstune -S 1 /dev/sdg1 modprobe -r btrfs && modprobe btrfs mount -o degraded /dev/sdg1 /btrfs btrfs dev add /dev/sdg3 /btrfs Signed-off-by: Anand Jain <Anand.Jain@oracle.com> --- fs/btrfs/super.c | 2 ++ 1 file changed, 2 insertions(+) diff --git a/fs/btrfs/super.c b/fs/btrfs/super.c index 74ef9bf..cac015f 100644 --- a/fs/btrfs/super.c +++ b/fs/btrfs/super.c @@ -1940,6 +1940,8 @@ static int btrfs_show_devname(struct seq_file *m, struct dentry *root) list_for_each_entry(dev, head, dev_list) { if (dev->missing) continue; + if (!dev->name) + continue; if (!first_dev || dev->devid < first_dev->devid) first_dev = dev; } -- 2.0.0.257.g75cc6c6 ^ permalink raw reply related [flat|nested] 10+ messages in thread
* Re: [PATCH 1/2] btrfs: fix null pointer dereference in clone_fs_devices when name is null 2014-06-30 9:12 [PATCH 1/2] btrfs: fix null pointer dereference in clone_fs_devices when name is null Anand Jain 2014-06-30 9:12 ` [PATCH 2/2] btrfs: fix null pointer dereference in btrfs_show_devname " Anand Jain @ 2014-06-30 10:02 ` Miao Xie 2014-06-30 15:06 ` Anand Jain 1 sibling, 1 reply; 10+ messages in thread From: Miao Xie @ 2014-06-30 10:02 UTC (permalink / raw) To: Anand Jain, linux-btrfs On Mon, 30 Jun 2014 17:12:47 +0800, Anand Jain wrote: > when one of the device path is missing btrfs_device name is null. So this > patch will check for that. > > stack: > BUG: unable to handle kernel NULL pointer dereference at 0000000000000010 > IP: [<ffffffff812e18c0>] strlen+0x0/0x30 > [<ffffffffa01cd92a>] ? clone_fs_devices+0xaa/0x160 [btrfs] > [<ffffffffa01cdcf7>] btrfs_init_new_device+0x317/0xca0 [btrfs] > [<ffffffff81155bca>] ? __kmalloc_track_caller+0x15a/0x1a0 > [<ffffffffa01d6473>] btrfs_ioctl+0xaa3/0x2860 [btrfs] > [<ffffffff81132a6c>] ? handle_mm_fault+0x48c/0x9c0 > [<ffffffff81192a61>] ? __blkdev_put+0x171/0x180 > [<ffffffff817a784c>] ? __do_page_fault+0x4ac/0x590 > [<ffffffff81193426>] ? blkdev_put+0x106/0x110 > [<ffffffff81179175>] ? mntput+0x35/0x40 > [<ffffffff8116d4b0>] do_vfs_ioctl+0x460/0x4a0 > [<ffffffff8115c72e>] ? ____fput+0xe/0x10 > [<ffffffff81068033>] ? task_work_run+0xb3/0xd0 > [<ffffffff8116d547>] SyS_ioctl+0x57/0x90 > [<ffffffff817a793e>] ? do_page_fault+0xe/0x10 > [<ffffffff817abe52>] system_call_fastpath+0x16/0x1b > > reproducer: > mkfs.btrfs -draid1 -mraid1 /dev/sdg1 /dev/sdg2 > btrfstune -S 1 /dev/sdg1 > modprobe -r btrfs && modprobe btrfs > mount -o degraded /dev/sdg1 /btrfs > btrfs dev add /dev/sdg3 /btrfs The primary reason of this problem is that we didn't scan the system and find all the devices in the filesystem, if we scan the system, we can mount the filesystem successfully, needn't mount it with degraded option. so I think the right way to fix is to scan the system and find the device that is not registered into the fs device list. Thanks Miao > > Signed-off-by: Anand Jain <Anand.Jain@oracle.com> > --- > fs/btrfs/volumes.c | 12 +++++++----- > 1 file changed, 7 insertions(+), 5 deletions(-) > > diff --git a/fs/btrfs/volumes.c b/fs/btrfs/volumes.c > index 24477a4..66991c6 100644 > --- a/fs/btrfs/volumes.c > +++ b/fs/btrfs/volumes.c > @@ -739,12 +739,14 @@ static struct btrfs_fs_devices *clone_fs_devices(struct btrfs_fs_devices *orig) > * This is ok to do without rcu read locked because we hold the > * uuid mutex so nothing we touch in here is going to disappear. > */ > - name = rcu_string_strdup(orig_dev->name->str, GFP_NOFS); > - if (!name) { > - kfree(device); > - goto error; > + if (orig_dev->name) { > + name = rcu_string_strdup(orig_dev->name->str, GFP_NOFS); > + if (!name) { > + kfree(device); > + goto error; > + } > + rcu_assign_pointer(device->name, name); > } > - rcu_assign_pointer(device->name, name); > > list_add(&device->dev_list, &fs_devices->devices); > device->fs_devices = fs_devices; > ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [PATCH 1/2] btrfs: fix null pointer dereference in clone_fs_devices when name is null 2014-06-30 10:02 ` [PATCH 1/2] btrfs: fix null pointer dereference in clone_fs_devices " Miao Xie @ 2014-06-30 15:06 ` Anand Jain 2014-07-02 2:38 ` Miao Xie 0 siblings, 1 reply; 10+ messages in thread From: Anand Jain @ 2014-06-30 15:06 UTC (permalink / raw) To: miaox; +Cc: linux-btrfs > The primary reason of this problem is that we didn't scan the system and > find all the devices in the filesystem, if we scan the system, we can > mount the filesystem successfully, needn't mount it with degraded option. > so I think the right way to fix is to scan the system and find the device > that is not registered into the fs device list. Thanks for commenting. Right. But I am testing the error scenario. that is, when one of the disk is missing in the system. Thanks, Anand ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [PATCH 1/2] btrfs: fix null pointer dereference in clone_fs_devices when name is null 2014-06-30 15:06 ` Anand Jain @ 2014-07-02 2:38 ` Miao Xie 2014-07-04 11:21 ` Anand Jain 0 siblings, 1 reply; 10+ messages in thread From: Miao Xie @ 2014-07-02 2:38 UTC (permalink / raw) To: Anand Jain; +Cc: linux-btrfs On Mon, 30 Jun 2014 23:06:54 +0800, Anand Jain wrote: > >> The primary reason of this problem is that we didn't scan the system and >> find all the devices in the filesystem, if we scan the system, we can >> mount the filesystem successfully, needn't mount it with degraded option. >> so I think the right way to fix is to scan the system and find the device >> that is not registered into the fs device list. > > Thanks for commenting. Right. But I am testing the error > scenario. that is, when one of the disk is missing in the system. In fact, the disk is still in the system, but is not added into btrfs device list (we can add it by "btrfs device scan" command), and after you mount the fs with degraded option, the fs adds that disk as a missing device, so it doesn't has its name. Though avoiding access a null pointer is right, you didn't consider the missing device and forgot to set the missing device counter. I think the following code is better. if (orig_dev->missing) { device->missing = 1; fs_devices->missing_devices++; } else { ASSERT(orig_dev->name); ...... } Thanks Miao ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [PATCH 1/2] btrfs: fix null pointer dereference in clone_fs_devices when name is null 2014-07-02 2:38 ` Miao Xie @ 2014-07-04 11:21 ` Anand Jain 2014-07-04 11:24 ` Anand Jain 0 siblings, 1 reply; 10+ messages in thread From: Anand Jain @ 2014-07-04 11:21 UTC (permalink / raw) To: miaox; +Cc: linux-btrfs, Chris Mason Miao, Chris, I appreciate your review comments, Miao. I am sorry for the delay, was stuck on this issue for a long time. more below. On 02/07/2014 10:38, Miao Xie wrote: > On Mon, 30 Jun 2014 23:06:54 +0800, Anand Jain wrote: >> >>> The primary reason of this problem is that we didn't scan the system and >>> find all the devices in the filesystem, if we scan the system, we can >>> mount the filesystem successfully, needn't mount it with degraded option. >>> so I think the right way to fix is to scan the system and find the device >>> that is not registered into the fs device list. >> >> Thanks for commenting. Right. But I am testing the error >> scenario. that is, when one of the disk is missing in the system. > > In fact, the disk is still in the system, but is not added into btrfs device list > (we can add it by "btrfs device scan" command), and after you mount the fs with > degraded option, the fs adds that disk as a missing device, so it doesn't has its > name. Correct. > Though avoiding access a null pointer is right, yes. that would tightly plug the problem demonstrated in the reproducer with minimal changes. > you didn't consider the missing > device and forgot to set the missing device counter. I think the following code > is better. > > if (orig_dev->missing) { > device->missing = 1; > fs_devices->missing_devices++; > } else { > ASSERT(orig_dev->name); > ...... > } Yes we need to associate the device->missing flag and device->name==NULL together, not just here but at quite a number of functions. As such there is no code which would mark device missing after its being mounted (there were some patch but those are yet to be reviewed). So for now this patch will address problem as in the reproducer. BUT BUT it would enable sections of code (with new parameters) which was _never_ run before due to this bug. That is in the following scenario.. - A mounted (missing) degraded seed btrfs FS. - Add a seed disk. - For seeding purpose we would "clone a degraded seed FS". (before this patch - the code will panic here so rest of the code was never run). I have very intermittent null pointer deference issue as the code runs further, (with or without Miao suggested), more precisely at btrfs_run_dev_stats() :: list_for_each_entry(device, &fs_devices->devices, dev_list) the list device is NULL. looks like its time to comprehensively handle the missing device. So as of now NACK for this patch. Very Sorry. Thanks, Anand > Thanks > Miao > -- > To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in > the body of a message to majordomo@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html > ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [PATCH 1/2] btrfs: fix null pointer dereference in clone_fs_devices when name is null 2014-07-04 11:21 ` Anand Jain @ 2014-07-04 11:24 ` Anand Jain 2014-07-07 3:05 ` Miao Xie 0 siblings, 1 reply; 10+ messages in thread From: Anand Jain @ 2014-07-04 11:24 UTC (permalink / raw) To: miaox, Chris Mason; +Cc: linux-btrfs (now used correct email id for Chris) On 04/07/2014 19:21, Anand Jain wrote: > > Miao, Chris, > > I appreciate your review comments, Miao. I am sorry for the delay, > was stuck on this issue for a long time. more below. > > On 02/07/2014 10:38, Miao Xie wrote: >> On Mon, 30 Jun 2014 23:06:54 +0800, Anand Jain wrote: >>> >>>> The primary reason of this problem is that we didn't scan the system >>>> and >>>> find all the devices in the filesystem, if we scan the system, we can >>>> mount the filesystem successfully, needn't mount it with degraded >>>> option. >>>> so I think the right way to fix is to scan the system and find the >>>> device >>>> that is not registered into the fs device list. >>> >>> Thanks for commenting. Right. But I am testing the error >>> scenario. that is, when one of the disk is missing in the system. >> >> In fact, the disk is still in the system, but is not added into btrfs >> device list >> (we can add it by "btrfs device scan" command), and after you mount >> the fs with >> degraded option, the fs adds that disk as a missing device, so it >> doesn't has its >> name. > > Correct. > >> Though avoiding access a null pointer is right, > > yes. that would tightly plug the problem demonstrated in the reproducer > with minimal changes. > >> you didn't consider the missing >> device and forgot to set the missing device counter. I think the >> following code >> is better. >> >> if (orig_dev->missing) { >> device->missing = 1; >> fs_devices->missing_devices++; >> } else { >> ASSERT(orig_dev->name); >> ...... >> } > > Yes we need to associate the device->missing flag and > device->name==NULL together, not just here but at quite a number of > functions. As such there is no code which would mark > device missing after its being mounted (there were some patch > but those are yet to be reviewed). > > So for now this patch will address problem as in the reproducer. > BUT BUT it would enable sections of code (with new parameters) which > was _never_ run before due to this bug. That is in the following > scenario.. > - A mounted (missing) degraded seed btrfs FS. > - Add a seed disk. > - For seeding purpose we would "clone a degraded seed FS". > (before this patch - the code will panic here so rest of the > code was never run). > > I have very intermittent null pointer deference issue as the code > runs further, (with or without Miao suggested), more precisely at > > btrfs_run_dev_stats() > :: > list_for_each_entry(device, &fs_devices->devices, dev_list) the list > > device is NULL. > > looks like its time to comprehensively handle the missing device. > > So as of now NACK for this patch. Very Sorry. > > Thanks, Anand > >> Thanks >> Miao >> -- >> To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in >> the body of a message to majordomo@vger.kernel.org >> More majordomo info at http://vger.kernel.org/majordomo-info.html >> ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [PATCH 1/2] btrfs: fix null pointer dereference in clone_fs_devices when name is null 2014-07-04 11:24 ` Anand Jain @ 2014-07-07 3:05 ` Miao Xie 2014-07-07 9:20 ` Anand Jain 2014-07-07 9:21 ` Anand Jain 0 siblings, 2 replies; 10+ messages in thread From: Miao Xie @ 2014-07-07 3:05 UTC (permalink / raw) To: Anand Jain, Chris Mason; +Cc: linux-btrfs On Fri, 4 Jul 2014 19:24:44 +0800, Anand Jain wrote: > (now used correct email id for Chris) > > On 04/07/2014 19:21, Anand Jain wrote: >> >> Miao, Chris, >> >> I appreciate your review comments, Miao. I am sorry for the delay, >> was stuck on this issue for a long time. more below. >> >> On 02/07/2014 10:38, Miao Xie wrote: >>> On Mon, 30 Jun 2014 23:06:54 +0800, Anand Jain wrote: >>>> >>>>> The primary reason of this problem is that we didn't scan the system >>>>> and >>>>> find all the devices in the filesystem, if we scan the system, we can >>>>> mount the filesystem successfully, needn't mount it with degraded >>>>> option. >>>>> so I think the right way to fix is to scan the system and find the >>>>> device >>>>> that is not registered into the fs device list. >>>> >>>> Thanks for commenting. Right. But I am testing the error >>>> scenario. that is, when one of the disk is missing in the system. >>> >>> In fact, the disk is still in the system, but is not added into btrfs >>> device list >>> (we can add it by "btrfs device scan" command), and after you mount >>> the fs with >>> degraded option, the fs adds that disk as a missing device, so it >>> doesn't has its >>> name. >> >> Correct. >> >>> Though avoiding access a null pointer is right, >> >> yes. that would tightly plug the problem demonstrated in the reproducer >> with minimal changes. >> >>> you didn't consider the missing >>> device and forgot to set the missing device counter. I think the >>> following code >>> is better. >>> >>> if (orig_dev->missing) { >>> device->missing = 1; >>> fs_devices->missing_devices++; >>> } else { >>> ASSERT(orig_dev->name); >>> ...... >>> } >> >> Yes we need to associate the device->missing flag and >> device->name==NULL together, not just here but at quite a number of >> functions. As such there is no code which would mark >> device missing after its being mounted (there were some patch >> but those are yet to be reviewed). >> >> So for now this patch will address problem as in the reproducer. >> BUT BUT it would enable sections of code (with new parameters) which >> was _never_ run before due to this bug. That is in the following >> scenario.. >> - A mounted (missing) degraded seed btrfs FS. >> - Add a seed disk. >> - For seeding purpose we would "clone a degraded seed FS". >> (before this patch - the code will panic here so rest of the >> code was never run). >> >> I have very intermittent null pointer deference issue as the code >> runs further, (with or without Miao suggested), more precisely at >> >> btrfs_run_dev_stats() >> :: >> list_for_each_entry(device, &fs_devices->devices, dev_list) the list >> >> device is NULL. >> >> looks like its time to comprehensively handle the missing device. >> >> So as of now NACK for this patch. Very Sorry. It's a pity that the patch has been merged into the upstream kernel. Let's correct our miss before the next merge. BTW, I sent some patches to fix the problems about seed device(including the updated patch of this one), could you try them and confirm that they can fix the problems you said above or not? [PATCH V2 7/9] btrfs: fix null pointer dereference in clone_fs_devices when name is null [PATCH 8/9] Btrfs: fix unzeroed members in fs_devices when creating a fs from seed fs [PATCH 9/9] Btrfs: fix writing data into the seed filesystem This first one is the updated patch of this one. Thanks Miao ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [PATCH 1/2] btrfs: fix null pointer dereference in clone_fs_devices when name is null 2014-07-07 3:05 ` Miao Xie @ 2014-07-07 9:20 ` Anand Jain 2014-07-07 9:21 ` Anand Jain 1 sibling, 0 replies; 10+ messages in thread From: Anand Jain @ 2014-07-07 9:20 UTC (permalink / raw) To: miaox; +Cc: Chris Mason, linux-btrfs > It's a pity that the patch has been merged into the upstream kernel. > Let's correct our miss before the next merge. What I found were new-bugs, those are not related to this patch. > BTW, I sent some patches to fix the problems about seed device(including > the updated patch of this one), could you try them and confirm that they > can fix the problems you said above or not? > > [PATCH V2 7/9] btrfs: fix null pointer dereference in clone_fs_devices when name is null > [PATCH 8/9] Btrfs: fix unzeroed members in fs_devices when creating a fs from seed fs > [PATCH 9/9] Btrfs: fix writing data into the seed filesystem > > This first one is the updated patch of this one. With 8,9/9 it fixes the new-bugs as well. Thanks. Anand ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [PATCH 1/2] btrfs: fix null pointer dereference in clone_fs_devices when name is null 2014-07-07 3:05 ` Miao Xie 2014-07-07 9:20 ` Anand Jain @ 2014-07-07 9:21 ` Anand Jain 1 sibling, 0 replies; 10+ messages in thread From: Anand Jain @ 2014-07-07 9:21 UTC (permalink / raw) To: miaox; +Cc: Chris Mason, linux-btrfs > It's a pity that the patch has been merged into the upstream kernel. > Let's correct our miss before the next merge. What I found were new-bugs, those are not related to this patch. > BTW, I sent some patches to fix the problems about seed device(including > the updated patch of this one), could you try them and confirm that they > can fix the problems you said above or not? > > [PATCH V2 7/9] btrfs: fix null pointer dereference in clone_fs_devices when name is null > [PATCH 8/9] Btrfs: fix unzeroed members in fs_devices when creating a fs from seed fs > [PATCH 9/9] Btrfs: fix writing data into the seed filesystem > > This first one is the updated patch of this one. With 8,9/9 it fixes the new-bugs as well. Thanks. Anand ^ permalink raw reply [flat|nested] 10+ messages in thread
end of thread, other threads:[~2014-07-07 9:21 UTC | newest] Thread overview: 10+ messages (download: mbox.gz follow: Atom feed -- links below jump to the message on this page -- 2014-06-30 9:12 [PATCH 1/2] btrfs: fix null pointer dereference in clone_fs_devices when name is null Anand Jain 2014-06-30 9:12 ` [PATCH 2/2] btrfs: fix null pointer dereference in btrfs_show_devname " Anand Jain 2014-06-30 10:02 ` [PATCH 1/2] btrfs: fix null pointer dereference in clone_fs_devices " Miao Xie 2014-06-30 15:06 ` Anand Jain 2014-07-02 2:38 ` Miao Xie 2014-07-04 11:21 ` Anand Jain 2014-07-04 11:24 ` Anand Jain 2014-07-07 3:05 ` Miao Xie 2014-07-07 9:20 ` Anand Jain 2014-07-07 9:21 ` Anand Jain
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).