* [KORG] Master / hera upgrade & downtime announcement
@ 2010-10-29 20:40 J.H.
2010-10-29 21:04 ` [kernel.org users] " Steven Rostedt
` (2 more replies)
0 siblings, 3 replies; 8+ messages in thread
From: J.H. @ 2010-10-29 20:40 UTC (permalink / raw)
To: users, linux-kernel
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Afternoon Everyone,
Thought I'd give everyone a quick heads up, that since Kernel Summit
starts on the 1st of November, which means I've got my one chance to do
system maintenance on master / hera for the year.
I'm expecting to do the upgrade on the 1st itself, likely start time
will be around Mon Nov 1 19:00:00 UTC 2010, and I'm hoping for the
entire downtime to take no longer than 2 hours.
Things that are going to happen during the upgrade:
- OS getting upgraded to Fedora 13
w/ custom kernel to solve XFS and disable IMA
- Hardware change
Google and HP have been very generous enough to
get us a new machine for the master / hera machine.
The new machine is a dual, quad core Xeon X5550 box
with 32G of ram. Beyond that it nearly identical to the
current machine.
The current machine will become a 'live' backup machine
that will sync semi-continuously, and be available
should catastrophic failure of master / hera occur.
Think that's the main big changes. I'm already working on the upgrade
since I have multiple boxes to do this with, and things are looking good
so far.
As a note the start time is estimated, if there is a major change to the
start time I will let everyone know.
As always, if you have questions, comments or concerns please e-mail me
or ftpadmin@kernel.org
- - John 'Warthog9' Hawley
Chief Kernel.org Administrator
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (GNU/Linux)
Comment: Using GnuPG with Fedora - http://enigmail.mozdev.org/
iEYEARECAAYFAkzLMVgACgkQ/E3kyWU9did9wACeO0nlEtiX52u6pD3slKtqZ61M
ZTgAn3TLwks7sT5ovpf9X6/WSbK7+hcz
=gIkm
-----END PGP SIGNATURE-----
^ permalink raw reply [flat|nested] 8+ messages in thread* Re: [kernel.org users] [KORG] Master / hera upgrade & downtime announcement 2010-10-29 20:40 [KORG] Master / hera upgrade & downtime announcement J.H. @ 2010-10-29 21:04 ` Steven Rostedt 2010-10-30 4:35 ` "Singapore Citizen Mr. Teo En Ming (Zhang Enming) 张恩鸣 " 2010-11-01 20:37 ` [kernel.org users] " J.H. 2 siblings, 0 replies; 8+ messages in thread From: Steven Rostedt @ 2010-10-29 21:04 UTC (permalink / raw) To: J.H.; +Cc: users, linux-kernel On Fri, 2010-10-29 at 13:40 -0700, J.H. wrote: > I'm expecting to do the upgrade on the 1st itself, likely start time > will be around Mon Nov 1 19:00:00 UTC 2010, and I'm hoping for the > entire downtime to take no longer than 2 hours. And watch Linus release -rc1 on the 31st. We better all sync up quickly! -- Steve ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: [KORG] Master / hera upgrade & downtime announcement 2010-10-29 20:40 [KORG] Master / hera upgrade & downtime announcement J.H. 2010-10-29 21:04 ` [kernel.org users] " Steven Rostedt @ 2010-10-30 4:35 ` "Singapore Citizen Mr. Teo En Ming (Zhang Enming) 张恩鸣 " 2010-11-01 20:37 ` [kernel.org users] " J.H. 2 siblings, 0 replies; 8+ messages in thread From: "Singapore Citizen Mr. Teo En Ming (Zhang Enming) 张恩鸣 " @ 2010-10-30 4:35 UTC (permalink / raw) To: linux-kernel Cc: space.time.universe@gmail.com, teoenming@hotmail.com, zhang_enming On 10/30/2010 04:40 AM, J.H. wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > Afternoon Everyone, > > Thought I'd give everyone a quick heads up, that since Kernel Summit > starts on the 1st of November, which means I've got my one chance to do > system maintenance on master / hera for the year. > > I'm expecting to do the upgrade on the 1st itself, likely start time > will be around Mon Nov 1 19:00:00 UTC 2010, and I'm hoping for the > entire downtime to take no longer than 2 hours. > > Things that are going to happen during the upgrade: > > - OS getting upgraded to Fedora 13 > w/ custom kernel to solve XFS and disable IMA > - Hardware change > Google and HP have been very generous enough to > get us a new machine for the master / hera machine. > The new machine is a dual, quad core Xeon X5550 box > with 32G of ram. Beyond that it nearly identical to the > current machine. > > The current machine will become a 'live' backup machine > that will sync semi-continuously, and be available > should catastrophic failure of master / hera occur. > > Think that's the main big changes. I'm already working on the upgrade > since I have multiple boxes to do this with, and things are looking good > so far. > > As a note the start time is estimated, if there is a major change to the > start time I will let everyone know. > > As always, if you have questions, comments or concerns please e-mail me > or ftpadmin@kernel.org > > - - John 'Warthog9' Hawley > Chief Kernel.org Administrator > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.10 (GNU/Linux) > Comment: Using GnuPG with Fedora - http://enigmail.mozdev.org/ > > iEYEARECAAYFAkzLMVgACgkQ/E3kyWU9did9wACeO0nlEtiX52u6pD3slKtqZ61M > ZTgAn3TLwks7sT5ovpf9X6/WSbK7+hcz > =gIkm > -----END PGP SIGNATURE----- > -- > To unsubscribe from this list: send the line "unsubscribe linux-kernel" in > the body of a message to majordomo@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html > Please read the FAQ at http://www.tux.org/lkml/ > > Noted with thanks. -- Yours sincerely, Singapore Citizen Mr. Teo En Ming (Zhang Enming) 张恩鸣 Dip(Mechatronics) BEng(Hons)(Mechanical Engineering) Singapore Identity Card No.: S78*6*2*H Location: Bedok Reservoir Road, Singapore ZIP: 470103 Mobile Phone (Starhub Pre-paid): +65-8369-2618 Windows Live Messenger: teoenming-at-hotmail.com My Youtube videos: http://www.youtube.com/user/enmingteo Alma Maters: [1] Singapore Polytechnic (Graduated 1998) [2] National University of Singapore (Graduated 2006) My Open Letter (Plea for Medical Help/Assistance) to World Leaders (Updated 28 August 2010):- http://lists.mcs.anl.gov/pipermail/mpich-discuss/2010-August/007811.html http://mythtv.org/pipermail/mythtv-users/2010-August/295952.html http://archives.gentoo.org/gentoo-user/msg_f6a341d9623fda17880159b137c07335.xml Photograph of Singapore Citizen Mr. Teo En Ming (Zhang Enming) 张恩鸣 #1: http://i.imgur.com/M1FNX.jpg Photograph of Singapore Citizen Mr. Teo En Ming (Zhang Enming) 张恩鸣 #2: http://i51.tinypic.com/11u9irm.jpg Photograph of Singapore Citizen Mr. Teo En Ming (Zhang Enming) 张恩鸣 #3: http://www.imagevimage.com/images/Singapore_Citizen_Mr._Teo_En_Ming_%28Zhang_Enming%29.jpg Photograph of Singapore Citizen Mr. Teo En Ming (Zhang Enming) 张恩鸣 #4: http://www.merrypic.com/files/o397beqo7qw8wky5rjno.jpg Photograph of Singapore Citizen Mr. Teo En Ming (Zhang Enming) 张恩鸣 #5: http://piczasso.com/i/yicuz.jpg Photograph of Singapore Citizen Mr. Teo En Ming (Zhang Enming) 张恩鸣 #6: http://www.freeimagehosting.net/uploads/1b553b21ae.jpg ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: [kernel.org users] [KORG] Master / hera upgrade & downtime announcement 2010-10-29 20:40 [KORG] Master / hera upgrade & downtime announcement J.H. 2010-10-29 21:04 ` [kernel.org users] " Steven Rostedt 2010-10-30 4:35 ` "Singapore Citizen Mr. Teo En Ming (Zhang Enming) 张恩鸣 " @ 2010-11-01 20:37 ` J.H. 2010-11-01 22:09 ` J.H. 2 siblings, 1 reply; 8+ messages in thread From: J.H. @ 2010-11-01 20:37 UTC (permalink / raw) To: users, linux-kernel -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hey All, Just a heads up I'm running a little behind but should be starting shortly. - - John 'Warthog9' Hawley Chief Kernel.org Administrator On 10/29/2010 01:40 PM, J.H. wrote: > Afternoon Everyone, > > Thought I'd give everyone a quick heads up, that since Kernel Summit > starts on the 1st of November, which means I've got my one chance to do > system maintenance on master / hera for the year. > > I'm expecting to do the upgrade on the 1st itself, likely start time > will be around Mon Nov 1 19:00:00 UTC 2010, and I'm hoping for the > entire downtime to take no longer than 2 hours. > > Things that are going to happen during the upgrade: > > - OS getting upgraded to Fedora 13 > w/ custom kernel to solve XFS and disable IMA > - Hardware change > Google and HP have been very generous enough to > get us a new machine for the master / hera machine. > The new machine is a dual, quad core Xeon X5550 box > with 32G of ram. Beyond that it nearly identical to the > current machine. > > The current machine will become a 'live' backup machine > that will sync semi-continuously, and be available > should catastrophic failure of master / hera occur. > > Think that's the main big changes. I'm already working on the upgrade > since I have multiple boxes to do this with, and things are looking good > so far. > > As a note the start time is estimated, if there is a major change to the > start time I will let everyone know. > > As always, if you have questions, comments or concerns please e-mail me > or ftpadmin@kernel.org > > - John 'Warthog9' Hawley > Chief Kernel.org Administrator _______________________________________________ Users mailing list Users@linux.kernel.org http://linux.kernel.org/mailman/listinfo/users -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Fedora - http://enigmail.mozdev.org/ iEYEARECAAYFAkzPJPAACgkQ/E3kyWU9dic+zgCdHf0zF7EXIn6BwmqboBE25Nqr AJQAoINWVSNuF9lyUFPhkSsdN89DtYpF =AkT+ -----END PGP SIGNATURE----- ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: [kernel.org users] [KORG] Master / hera upgrade & downtime announcement 2010-11-01 20:37 ` [kernel.org users] " J.H. @ 2010-11-01 22:09 ` J.H. 2010-11-01 23:18 ` J.H. 0 siblings, 1 reply; 8+ messages in thread From: J.H. @ 2010-11-01 22:09 UTC (permalink / raw) To: users, linux-kernel -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hey All, Just a heads up the box is back up. There's a few sundry items that still need to be dealt with and there might still be another reboot in the next couple of days but I'll send a separate e-mail if/when that has to occur. All in all things look good, and for the most part it went smoothly (well other than the typical disaster that grub throws at me). If you see anything amiss, please give me a holler or e-mail ftpadmin@kernel.org with details. Again thanks to Google and HP, specifically Chris DiBona and Bdale Garbee, for the new box. It is very nice. If you get a chance cat /proc/meminfo or cat /proc/cpuinfo - you won't be disappointed. - - John 'Warthog9' Hawley On 11/01/2010 01:37 PM, J.H. wrote: > Hey All, > > Just a heads up I'm running a little behind but should be starting shortly. > > - John 'Warthog9' Hawley > Chief Kernel.org Administrator > > On 10/29/2010 01:40 PM, J.H. wrote: >> Afternoon Everyone, > >> Thought I'd give everyone a quick heads up, that since Kernel Summit >> starts on the 1st of November, which means I've got my one chance to do >> system maintenance on master / hera for the year. > >> I'm expecting to do the upgrade on the 1st itself, likely start time >> will be around Mon Nov 1 19:00:00 UTC 2010, and I'm hoping for the >> entire downtime to take no longer than 2 hours. > >> Things that are going to happen during the upgrade: > >> - OS getting upgraded to Fedora 13 >> w/ custom kernel to solve XFS and disable IMA >> - Hardware change >> Google and HP have been very generous enough to >> get us a new machine for the master / hera machine. >> The new machine is a dual, quad core Xeon X5550 box >> with 32G of ram. Beyond that it nearly identical to the >> current machine. > >> The current machine will become a 'live' backup machine >> that will sync semi-continuously, and be available >> should catastrophic failure of master / hera occur. > >> Think that's the main big changes. I'm already working on the upgrade >> since I have multiple boxes to do this with, and things are looking good >> so far. > >> As a note the start time is estimated, if there is a major change to the >> start time I will let everyone know. > >> As always, if you have questions, comments or concerns please e-mail me >> or ftpadmin@kernel.org > >> - John 'Warthog9' Hawley >> Chief Kernel.org Administrator > > _______________________________________________ > Users mailing list > Users@linux.kernel.org > http://linux.kernel.org/mailman/listinfo/users _______________________________________________ Users mailing list Users@linux.kernel.org http://linux.kernel.org/mailman/listinfo/users -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Fedora - http://enigmail.mozdev.org/ iEYEARECAAYFAkzPOqEACgkQ/E3kyWU9dicAzQCfdEeFOo5hUUQ5ZSIXePAGR47U YEgAn3sdNcSfeDo2gc6aOta8zcBlOzDA =o0kl -----END PGP SIGNATURE----- ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: [kernel.org users] [KORG] Master / hera upgrade & downtime announcement 2010-11-01 22:09 ` J.H. @ 2010-11-01 23:18 ` J.H. 2010-11-02 18:18 ` J.H. 0 siblings, 1 reply; 8+ messages in thread From: J.H. @ 2010-11-01 23:18 UTC (permalink / raw) To: users, linux-kernel -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Ergh, Heads up apparently the server lied to me and claimed the drives were fully in sync, when they were not. A couple of people have caught that the last sync that occurred apparently was the 29th. I'm going to do a full resync of /pub - this will squash anything that was there with what was present around 1900 UTC on Nov 1st. Home dirs, mail, etc are going to have to get dealt with on a per-case basis. I might just setup an NFS mount across the two machines and let people snag what they need on their own with respect to that. Right now I'm working on bringing the old box back up so we can get at the data. Just a heads up, stop by #korg on LinuxNet or #kernel.org on Freenode if you need to corner me on something *NOWish* Sorry about that, I did double check that stuff was in sync, so I'm not sure what happened there. - - John 'Warthog9' Hawley On 11/01/2010 03:09 PM, J.H. wrote: > Hey All, > > Just a heads up the box is back up. There's a few sundry items that > still need to be dealt with and there might still be another reboot in > the next couple of days but I'll send a separate e-mail if/when that has > to occur. > > All in all things look good, and for the most part it went smoothly > (well other than the typical disaster that grub throws at me). > > If you see anything amiss, please give me a holler or e-mail > ftpadmin@kernel.org with details. > > Again thanks to Google and HP, specifically Chris DiBona and Bdale > Garbee, for the new box. It is very nice. If you get a chance cat > /proc/meminfo or cat /proc/cpuinfo - you won't be disappointed. > > - John 'Warthog9' Hawley > > On 11/01/2010 01:37 PM, J.H. wrote: >> Hey All, > >> Just a heads up I'm running a little behind but should be starting shortly. > >> - John 'Warthog9' Hawley >> Chief Kernel.org Administrator > >> On 10/29/2010 01:40 PM, J.H. wrote: >>> Afternoon Everyone, > >>> Thought I'd give everyone a quick heads up, that since Kernel Summit >>> starts on the 1st of November, which means I've got my one chance to do >>> system maintenance on master / hera for the year. > >>> I'm expecting to do the upgrade on the 1st itself, likely start time >>> will be around Mon Nov 1 19:00:00 UTC 2010, and I'm hoping for the >>> entire downtime to take no longer than 2 hours. > >>> Things that are going to happen during the upgrade: > >>> - OS getting upgraded to Fedora 13 >>> w/ custom kernel to solve XFS and disable IMA >>> - Hardware change >>> Google and HP have been very generous enough to >>> get us a new machine for the master / hera machine. >>> The new machine is a dual, quad core Xeon X5550 box >>> with 32G of ram. Beyond that it nearly identical to the >>> current machine. > >>> The current machine will become a 'live' backup machine >>> that will sync semi-continuously, and be available >>> should catastrophic failure of master / hera occur. > >>> Think that's the main big changes. I'm already working on the upgrade >>> since I have multiple boxes to do this with, and things are looking good >>> so far. > >>> As a note the start time is estimated, if there is a major change to the >>> start time I will let everyone know. > >>> As always, if you have questions, comments or concerns please e-mail me >>> or ftpadmin@kernel.org > >>> - John 'Warthog9' Hawley >>> Chief Kernel.org Administrator > >> _______________________________________________ >> Users mailing list >> Users@linux.kernel.org >> http://linux.kernel.org/mailman/listinfo/users > > _______________________________________________ > Users mailing list > Users@linux.kernel.org > http://linux.kernel.org/mailman/listinfo/users _______________________________________________ Users mailing list Users@linux.kernel.org http://linux.kernel.org/mailman/listinfo/users -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Fedora - http://enigmail.mozdev.org/ iEYEARECAAYFAkzPSrMACgkQ/E3kyWU9dicreQCghOiKTEnmeAE0iVQKrYX1FRHJ +3AAn0G1XAIl+eefZ2il7wPvyeNxzmz0 =Z//P -----END PGP SIGNATURE----- ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: [kernel.org users] [KORG] Master / hera upgrade & downtime announcement 2010-11-01 23:18 ` J.H. @ 2010-11-02 18:18 ` J.H. 2011-01-12 19:04 ` J.H. 0 siblings, 1 reply; 8+ messages in thread From: J.H. @ 2010-11-02 18:18 UTC (permalink / raw) To: users, linux-kernel -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Latest update > I'm going to do a full resync of /pub - this will squash anything that > was there with what was present around 1900 UTC on Nov 1st. Home dirs, > mail, etc are going to have to get dealt with on a per-case basis. /pub was reset last night, which basically means anything that may have been pushed from about 19:00 Nov 1 UTC to 02:56 Nov 2 UTC could be squashed and will need to be re-pushed, but this should clean up the vast majority of the issues there were present there. This will likely mean a few more extra tip e-mails for those of you on that mailing list (again sorry about that), and possibly some other e-mails from various cron scripts that individual users are running and maintaining. > I might just setup an NFS mount across the two machines and let people > snag what they need on their own with respect to that. I've gone ahead and created /home/restore - it has have a copy of the home directory as it existed around 19:00 Nov 1 UTC. I will garauntee it being around until Nov 30th. I will need to delete it sometime after that, mainly because of the backup bloat it will cause. If you made changes to your home directory between Sept. 29th and Nov 1, you will need to deal with the merging of the data manually. With respect to those users who use IMAP against the machine I've copied your INBOX mail spools to /home/restore/MAILSPOOL. The easiest way to deal with merging this in with your current inbox is toe copy your spool to your ~/mail directory, load up thunderbird and copy all the mail from the old inbox to your current inbox and then use something like "Remove Duplicate Messages (alternate)" to eliminate the duplicates. That should be everything. I'm going to keep poking around trying to find anything else that's off kilter, but I haven't seen any new reports of anything else amiss yet and things seem to be working otherwise. So if you see something amiss, please let me know ASAP. - - John 'Warthog9' Hawley -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Fedora - http://enigmail.mozdev.org/ iEYEARECAAYFAkzQVhAACgkQ/E3kyWU9dic1ZwCeL0IdwITS2lYcmQhmOK/kevk5 l2wAnAzfynrADpgv+I7KL0rvQQU8Fmxe =6g1w -----END PGP SIGNATURE----- ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: [kernel.org users] [KORG] Master / hera upgrade & downtime announcement 2010-11-02 18:18 ` J.H. @ 2011-01-12 19:04 ` J.H. 0 siblings, 0 replies; 8+ messages in thread From: J.H. @ 2011-01-12 19:04 UTC (permalink / raw) To: users, linux-kernel -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 >> I might just setup an NFS mount across the two machines and let people >> snag what they need on their own with respect to that. > > I've gone ahead and created /home/restore - it has have a copy of the > home directory as it existed around 19:00 Nov 1 UTC. I will garauntee > it being around until Nov 30th. I will need to delete it sometime after > that, mainly because of the backup bloat it will cause. If you made > changes to your home directory between Sept. 29th and Nov 1, you will > need to deal with the merging of the data manually. > > With respect to those users who use IMAP against the machine I've copied > your INBOX mail spools to /home/restore/MAILSPOOL. The easiest way to > deal with merging this in with your current inbox is toe copy your spool > to your ~/mail directory, load up thunderbird and copy all the mail from > the old inbox to your current inbox and then use something like "Remove > Duplicate Messages (alternate)" to eliminate the duplicates. > > That should be everything. I'm going to keep poking around trying to > find anything else that's off kilter, but I haven't seen any new reports > of anything else amiss yet and things seem to be working otherwise. So > if you see something amiss, please let me know ASAP. Just a quick heads up since we are now two+ months down the road from this. I'm going to wipe out /home/restore on Friday of this week. If, for whatever reason, you have not dealt with this yet please do so now as the data will be removed from the system. This is mainly to help deal with a backup system that is happening and to eliminate the extra overhead that the data is taking up. Thanks! - - John 'Warthog9' Hawley -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Fedora - http://enigmail.mozdev.org/ iEYEARECAAYFAk0t+0sACgkQ/E3kyWU9dieO4ACdGU31QR0UG4f52cqWq8FBBXlC eyIAnRXHQWf5Z5uPp9GPmFcTOD/6VJWL =Qhux -----END PGP SIGNATURE----- ^ permalink raw reply [flat|nested] 8+ messages in thread
end of thread, other threads:[~2011-01-12 19:04 UTC | newest] Thread overview: 8+ messages (download: mbox.gz follow: Atom feed -- links below jump to the message on this page -- 2010-10-29 20:40 [KORG] Master / hera upgrade & downtime announcement J.H. 2010-10-29 21:04 ` [kernel.org users] " Steven Rostedt 2010-10-30 4:35 ` "Singapore Citizen Mr. Teo En Ming (Zhang Enming) 张恩鸣 " 2010-11-01 20:37 ` [kernel.org users] " J.H. 2010-11-01 22:09 ` J.H. 2010-11-01 23:18 ` J.H. 2010-11-02 18:18 ` J.H. 2011-01-12 19:04 ` J.H.
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox
