Nova Resource:Deployment-prep/SAL/Archive 1: Revision history

14 January 2019

• curprev 10:4210:42, 14 January 2019‎ Nhatminh01 talk contribs‎ m 107,222 bytes 0‎ Nhatminh01 moved page Nova Resource:Deployment-prep/SAL/Archive1 to Nova Resource:Deployment-prep/SAL/Archive 1: minor

11 December 2013

• curprev 12:2812:28, 11 December 2013‎ Hashar talk contribs‎ m 107,222 bytes 0‎ Hashar moved page Nova Resource:Deployment-prep/SAL to Nova Resource:Deployment-prep/SAL/Archive1: archiving
• curprev 10:4410:44, 11 December 2013‎ Labslogbot talk contribs‎ 107,222 bytes +159‎ deleted deployment-search01 and deployment-searchidx01 , Beta cluster has been migrated to ElasticSearch over the summer. (hashar)

10 December 2013

• curprev 23:1923:19, 10 December 2013‎ Labslogbot talk contribs‎ 107,063 bytes +91‎ Freed 4.2G on deployment-jobrunner08.pmtpa.wmflab by deleting files in /tmp (bd808)
• curprev 23:1723:17, 10 December 2013‎ Labslogbot talk contribs‎ 106,972 bytes +72‎ deployment-jobrunner08.pmtpa.wmflabs is out of disk on / (bd808)
• curprev 21:1121:11, 10 December 2013‎ Labslogbot talk contribs‎ 106,900 bytes +108‎ used git fetch && git reset --hard on Flow extension. Just to be sure (hashar)

9 December 2013

• curprev 09:5209:52, 9 December 2013‎ Labslogbot talk contribs‎ 106,792 bytes +97‎ added dan-nl so he can look at MediaWiki log files when playing with glamtoolset (hashar)
• curprev 09:4409:44, 9 December 2013‎ Labslogbot talk contribs‎ 106,695 bytes +113‎ deleted old jobs from commonswiki job queue (up to timestamp 20130315031930) (hashar)

8 December 2013

• curprev 20:5520:55, 8 December 2013‎ Labslogbot talk contribs‎ 106,582 bytes +107‎ chmod -R a+w deployment-bastion:/data/project/upload7/private/gwtoolset (bd808)

6 December 2013

• curprev 22:2222:22, 6 December 2013‎ Labslogbot talk contribs‎ 106,475 bytes +68‎ rebooting deployment-cache-text1 (aka text varnish) (hashar)
• curprev 22:1122:11, 6 December 2013‎ Labslogbot talk contribs‎ 106,407 bytes +84‎ upgrading packages on text cache / running puppet and rebooting it. (hashar)
• curprev 21:1521:15, 6 December 2013‎ Labslogbot talk contribs‎ 106,323 bytes +71‎ Debugging apache on deployment-apache33, may look hung (MaxSem)
• curprev 11:2411:24, 6 December 2013‎ Labslogbot talk contribs‎ 106,252 bytes +61‎ upgrading varnish on deployment-parsoidcache (hashar)
• curprev 11:1811:18, 6 December 2013‎ Labslogbot talk contribs‎ 106,191 bytes +90‎ made sure puppet agent is enabled on varnish caches and reran it manually (hashar)
• curprev 11:1311:13, 6 December 2013‎ Labslogbot talk contribs‎ 106,101 bytes +134‎ shut downing deployment-search01 and deployment-searchidx01. They were for Lucene search. We use Elastic search now. (hashar)
• curprev 11:1211:12, 6 December 2013‎ Labslogbot talk contribs‎ 105,967 bytes +63‎ upgrading varnish on deployment-cache-mobile01 (hashar)
• curprev 11:1211:12, 6 December 2013‎ Labslogbot talk contribs‎ 105,904 bytes +61‎ upgrading varnish on deployment-cache-bits03 (hashar)
• curprev 11:0911:09, 6 December 2013‎ Labslogbot talk contribs‎ 105,843 bytes +80‎ upgrading varnish on deployment-cache-text1 (hashar)

3 December 2013

• curprev 22:4222:42, 3 December 2013‎ Labslogbot talk contribs‎ 105,763 bytes +75‎ upgrading packages on deployment-cache-bits03 && rebooting (hashar)
• curprev 22:3622:36, 3 December 2013‎ Labslogbot talk contribs‎ 105,688 bytes +53‎ rebooting deployment-cache-mobile01 (hashar)
• curprev 22:3622:36, 3 December 2013‎ Labslogbot talk contribs‎ 105,635 bytes +103‎ Parsoid got broken since last Friday (serving pages from production …) {{bug|57926}} (hashar)
• curprev 22:3422:34, 3 December 2013‎ Labslogbot talk contribs‎ 105,532 bytes +124‎ rerunning puppet continuously on deployment-cache-mobile01 + apt-get upgrade of varnish (hashar)

22 November 2013

• curprev 19:4819:48, 22 November 2013‎ Labslogbot talk contribs‎ 105,408 bytes +90‎ mwscript update.php --wiki=labswiki --quick (for OAuth database updates (hashar)
• curprev 19:4719:47, 22 November 2013‎ Labslogbot talk contribs‎ 105,318 bytes +179‎ manually fixed some permissions rights that prevented automatic deployed of mediawiki-config.it Been broken since rougly Nov 21st at 7pm UTC. (hashar)

19 November 2013

• curprev 16:1716:17, 19 November 2013‎ Labslogbot talk contribs‎ 105,139 bytes +84‎ applying role::ci::slave::labs::common class on deployment-parsoid2 (hashar)
• curprev 16:0716:07, 19 November 2013‎ Labslogbot talk contribs‎ 105,055 bytes +87‎ rebuilding elasticsearch indexes to suck up configuration changes (manybubbles)
• curprev 16:0316:03, 19 November 2013‎ Labslogbot talk contribs‎ 104,968 bytes +141‎ running puppet on elasticsearch machines and restarting elasticsearch to suck up new configuration (manybubbles)

18 November 2013

• curprev 11:2011:20, 18 November 2013‎ Labslogbot talk contribs‎ 104,827 bytes +233‎ Cleaned out Parsoid submodule: sudo su - mwdeploy then cd /home/wikipedia/common/php-master/extensions/Parsoid && git reset --hard origin/master && cd .. && git submodule update --init Parsoid (hashar)

15 November 2013

• curprev 18:4118:41, 15 November 2013‎ Labslogbot talk contribs‎ 104,594 bytes +93‎ rebuilding Cirrus search indexes to have the 2 replicas like production (manybubbles)
• curprev 14:5114:51, 15 November 2013‎ Labslogbot talk contribs‎ 104,501 bytes +70‎ rebuilding search indexes using jobs for testing (manybubbles)
• curprev 14:0914:09, 15 November 2013‎ Labslogbot talk contribs‎ 104,431 bytes +39‎ rebooting both apaches (hashar)
• curprev 14:0814:08, 15 November 2013‎ Labslogbot talk contribs‎ 104,392 bytes +40‎ rebooting sql and sql02 (hashar)
• curprev 14:0514:05, 15 November 2013‎ Labslogbot talk contribs‎ 104,352 bytes +61‎ upgrading mysql on -sql (hashar)

14 November 2013

• curprev 22:5422:54, 14 November 2013‎ Labslogbot talk contribs‎ 104,291 bytes +51‎ upgrading packages on -jobrunner08 (hashar)
• curprev 20:3820:38, 14 November 2013‎ Labslogbot talk contribs‎ 104,240 bytes +53‎ updating search indexes in labs (manybubbles)
• curprev 00:4400:44, 14 November 2013‎ Labslogbot talk contribs‎ 104,187 bytes +90‎ Rebooting deployment-solr, jetty (or java?) is FUBAR (MaxSem)

11 November 2013

• curprev 14:1814:18, 11 November 2013‎ Labslogbot talk contribs‎ 104,097 bytes +248‎ Flow was no more functional due to some backtrace in Parsoid daemon ({{bug|56781}}). Solved by upgrading Parsoid, reinstalling its dependencies and restarting it. Test page is http://en.wikipedia.beta.wmflabs.org/wiki/Talk:Flow_QA (hashar)
• curprev 14:1414:14, 11 November 2013‎ Labslogbot talk contribs‎ 103,849 bytes +76‎ deleting and reinstalling Parsoid node modules dependencies (hashar)
• curprev 14:1314:13, 11 November 2013‎ Labslogbot talk contribs‎ 103,773 bytes +70‎ changing Parsoid from 4 months old cdbfdbb to 986c1e7 (hashar)
• curprev 13:4713:47, 11 November 2013‎ Labslogbot talk contribs‎ 103,703 bytes +70‎ upgrading varnish on all caches. (hashar)

7 November 2013

• curprev 09:3909:39, 7 November 2013‎ Labslogbot talk contribs‎ 103,633 bytes +54‎ rebooting apache33 for kernel upgrade (hashar)
• curprev 09:3809:38, 7 November 2013‎ Labslogbot talk contribs‎ 103,579 bytes +54‎ rebooting apache32 for kernel upgrade (hashar)
• curprev 09:1909:19, 7 November 2013‎ Labslogbot talk contribs‎ 103,525 bytes +57‎ reenabling puppet on deployment-apache33 (hashar)
• curprev 09:1509:15, 7 November 2013‎ Labslogbot talk contribs‎ 103,468 bytes +94‎ deleted sudo policy 'webadmins' only had petrb in it with no specific access. (hashar)
• curprev 09:1409:14, 7 November 2013‎ Labslogbot talk contribs‎ 103,374 bytes +85‎ removed sudo group 'admin', removing root access from any volunteers (hashar)
• curprev 09:0809:08, 7 November 2013‎ Labslogbot talk contribs‎ 103,289 bytes +83‎ Restarted bits varnish to clear out the cache. (hashar)

6 November 2013

• curprev 12:0912:09, 6 November 2013‎ Labslogbot talk contribs‎ 103,206 bytes +64‎ apt-get dist-upgrade on deployment-eventlogging (hashar)
• curprev 11:3811:38, 6 November 2013‎ Labslogbot talk contribs‎ 103,142 bytes +78‎ upgrading packages on deployment-parsoid2 (hashar)

5 November 2013

• curprev 21:3921:39, 5 November 2013‎ Labslogbot talk contribs‎ 103,064 bytes +158‎ applying role::logging::mediawiki::errors on deployment-fluoride. Should get a listener of some sort on port 8423 to receive fatal/exceptions (hashar)
• curprev 16:1616:16, 5 November 2013‎ Labslogbot talk contribs‎ 102,906 bytes +178‎ fixed up mediawiki/extensions.git which still add the deleted extension WikibaseDatabase . That has been blocking code update since Oct 30th. (hashar)

28 October 2013

• curprev 13:1613:16, 28 October 2013‎ Labslogbot talk contribs‎ 102,728 bytes +93‎ restarted elasticsearch nodes to pick up new config (manybubbles)

19 October 2013

• curprev 20:2920:29, 19 October 2013‎ Labslogbot talk contribs‎ 102,635 bytes +123‎ petrb: did mwscript changePassword.php --wiki enwiki --user PiRSquared --password mooh (wm-bot)

15 October 2013

• curprev 21:0421:04, 15 October 2013‎ Labslogbot talk contribs‎ 102,512 bytes +110‎ -bastion rebooted, restarted udp2log : /etc/init.d/udp2log stop; /etc/init.d/udp2log-mw start (hashar)
• curprev 21:0321:03, 15 October 2013‎ Labslogbot talk contribs‎ 102,402 bytes +85‎ rebooting deployment-bastion for NFS config fix. (hashar)

14 October 2013

• curprev 22:0022:00, 14 October 2013‎ Labslogbot talk contribs‎ 102,317 bytes +89‎ hashar: made /data/project/logs group writable, it belongs to nemobis :/ (wm-bot)
• curprev 10:1210:12, 14 October 2013‎ Labslogbot talk contribs‎ 102,228 bytes +83‎ purged varnishhtcpd on deployment-upload04 to make it start again. (hashar)
• curprev 09:5309:53, 14 October 2013‎ Labslogbot talk contribs‎ 102,145 bytes +148‎ rebooting all varnish caches ( deployment-cache-text1 deployment-cache-upload04 deployment-cache-bits03 deployment-cache-mobile01 ) (hashar)
• curprev 09:4809:48, 14 October 2013‎ Labslogbot talk contribs‎ 101,997 bytes +227‎ mobile varnish frontend cache is not starting anymore : /usr/lib/x86_64-linux-gnu/varnish/vmods/libvmod_netmapper.so: cannot open shared object file: No such file or directory {{bug|55662}} (hashar)

11 October 2013

• curprev 10:4810:48, 11 October 2013‎ Labslogbot talk contribs‎ 101,770 bytes +37‎ beta is back up :-] (hashar_)
• curprev 10:3010:30, 11 October 2013‎ Labslogbot talk contribs‎ 101,733 bytes +68‎ resyncronizing mediawiki/extensions.git submodules. (hashar)
• curprev 10:1610:16, 11 October 2013‎ Labslogbot talk contribs‎ 101,665 bytes +118‎ git directory of mediawiki/extensions was borked following the NFS migration. Ffixing it up manually (hashar)
• curprev 10:0510:05, 11 October 2013‎ Labslogbot talk contribs‎ 101,547 bytes +52‎ stopped udp2log, started udp2log-mw (hashar)
• curprev 10:0410:04, 11 October 2013‎ Labslogbot talk contribs‎ 101,495 bytes +45‎ rebooting deployment-bastion (hashar)
• curprev 10:0410:04, 11 October 2013‎ Labslogbot talk contribs‎ 101,450 bytes +148‎ Jenkins jobs failing, jenkins-deploy user apparently can't write to its home dir /home/jenkins-deploy/workspace (hashar)

7 October 2013

• curprev 10:4810:48, 7 October 2013‎ Labslogbot talk contribs‎ 101,302 bytes +101‎ applied iptables rules for {{bug|45868}} on deployment-apache{32,33} and jobrunner08 (hashar)
• curprev 10:0510:05, 7 October 2013‎ Labslogbot talk contribs‎ 101,201 bytes +98‎ applied iptables NAT rules on deployment-bastion {{bug|45868}} (hashar)

4 October 2013

• curprev 19:3219:32, 4 October 2013‎ Labslogbot talk contribs‎ 101,103 bytes +88‎ Created table bug_54847_password_resets on all wikis (MaxSem)

3 October 2013

• curprev 13:2213:22, 3 October 2013‎ Labslogbot talk contribs‎ 101,015 bytes +82‎ finished rebuilding search indexes after cirrussearch update (manybubbles)
• curprev 00:3800:38, 3 October 2013‎ Labslogbot talk contribs‎ 100,933 bytes +93‎ rebuilding search indecies after cirrussearch update (manybubbles)

30 September 2013

• curprev 08:1608:16, 30 September 2013‎ Labslogbot talk contribs‎ 100,840 bytes +160‎ upgrading and restarting memcached on memc0 and memc1 to let them limit their memory at 15GB instead of 89G {{bug|52378}} (hashar)

24 September 2013

• curprev 13:3813:38, 24 September 2013‎ Labslogbot talk contribs‎ 100,680 bytes +94‎ indecies finished rebuilding some time last night. (manybubbles)

23 September 2013

• curprev 16:2616:26, 23 September 2013‎ Labslogbot talk contribs‎ 100,586 bytes +104‎ rebuilding search indecies after new index config deployment (manybubbles)

20 September 2013

• curprev 13:3913:39, 20 September 2013‎ Labslogbot talk contribs‎ 100,482 bytes +156‎ rebuilt most search indecies in beta but commonswiki crashed late last night so it is half rebuilt. filing bug. (manybubbles)

19 September 2013

• curprev 19:2619:26, 19 September 2013‎ Labslogbot talk contribs‎ 100,326 bytes +117‎ elasticseach filled up the system disk on its hosts so I moved its data to /mnt with a symlink. (manybubbles)
• curprev 18:3718:37, 19 September 2013‎ Labslogbot talk contribs‎ 100,209 bytes +105‎ rebuilding search indecies after a few merges in cirrussearch (manybubbles)

17 September 2013

• curprev 20:0520:05, 17 September 2013‎ Labslogbot talk contribs‎ 100,104 bytes +121‎ upgrading PHP on bastion, jobrunner and apaches to from 5.3.10-1ubuntu3.7+wmf1 to 5.3.10-1ubuntu3.8+wmf1 (hashar)
• curprev 19:0019:00, 17 September 2013‎ Labslogbot talk contribs‎ 99,983 bytes +62‎ upgraded elasticsearch in beta to 0.90.4 (manybubbles)
• curprev 18:0818:08, 17 September 2013‎ Labslogbot talk contribs‎ 99,921 bytes +152‎ upgrading elasticsearch in beta to 0.90.4 so we can make sure it works so we can use some new features in it (manybubbles)

10 September 2013

• curprev 16:2916:29, 10 September 2013‎ Labslogbot talk contribs‎ 99,769 bytes +115‎ rebooted bastion after some nfs outage. Stopped udp2log, started udp2log-mw (hashar)

7 September 2013

• curprev 01:0701:07, 7 September 2013‎ Labslogbot talk contribs‎ 99,654 bytes +99‎ rebuilding search indecies on beta after lots of updates (manybubbles)

3 September 2013

• curprev 14:5914:59, 3 September 2013‎ Labslogbot talk contribs‎ 99,555 bytes +129‎ upgrading PHP5 ( 5.3.10-1ubuntu3.7+wmf1 ) on deployment-apache32, deployment-apache33 and deployment-jobrunner08 (hashar)
• curprev 14:5514:55, 3 September 2013‎ Labslogbot talk contribs‎ 99,426 bytes +82‎ upgrading PHP5 package on deployment-bastion (hashar)

26 August 2013

• curprev 17:4717:47, 26 August 2013‎ Labslogbot talk contribs‎ 99,344 bytes +95‎ rebuilding search indecies to unbreak CirrusSearch.... (manybubbles)

20 August 2013

• curprev 18:4718:47, 20 August 2013‎ Labslogbot talk contribs‎ 99,249 bytes +101‎ rebuild search indecies after some changes to indexing code. (manybubbles)

19 August 2013

• curprev 19:0519:05, 19 August 2013‎ Labslogbot talk contribs‎ 99,148 bytes +102‎ rebuilding the search indecies to pick up some recent changes (manybubbles)

12 August 2013

• curprev 19:1019:10, 12 August 2013‎ Labslogbot talk contribs‎ 99,046 bytes +57‎ rebuild search indecies for updates (manybubbles)
• curprev 18:4518:45, 12 August 2013‎ Labslogbot talk contribs‎ 98,989 bytes +66‎ rebuilding all search indecies using updates (manybubbles)
• curprev 18:4518:45, 12 August 2013‎ Labslogbot talk contribs‎ 98,923 bytes +77‎ unstuck CirrusSearch so it'd update. (manybubbles)

8 August 2013

• curprev 17:4117:41, 8 August 2013‎ Labslogbot talk contribs‎ 98,846 bytes +118‎ simplewiki's search index has completed building. All search indecies should now be up to date. (manybubbles)
• curprev 15:5315:53, 8 August 2013‎ Labslogbot talk contribs‎ 98,728 bytes +197‎ reindexed all wikis to add accent squashing. simplewiki is still rebuilding but I reindexed what was complete and starting the rebuild again so it'd pick up accent squashing. (manybubbles)
• curprev 11:5511:55, 8 August 2013‎ Labslogbot talk contribs‎ 98,531 bytes +100‎ all search indecies have finished building except simplewiki (manybubbles)

7 August 2013

• curprev 20:3120:31, 7 August 2013‎ Labslogbot talk contribs‎ 98,431 bytes +123‎ rebuild all the small search indecies. waiting on enwiki, enwikivoyage, simplewiki, and commonswiki. (manybubbles)
• curprev 20:0820:08, 7 August 2013‎ Labslogbot talk contribs‎ 98,308 bytes +89‎ rebuild search indecies after large-ish code change to CirrusSearch (manybubbles)
• curprev 07:2707:27, 7 August 2013‎ Labslogbot talk contribs‎ 98,219 bytes +150‎ rebooted deployment-memc1 and deployment-memc0 (not at the same time) while freeing up space on virt servers. (andrewbogott)

4 August 2013

• curprev 22:5722:57, 4 August 2013‎ Labslogbot talk contribs‎ 98,069 bytes +33‎ platonides: test (wm-bot)
• curprev 22:5622:56, 4 August 2013‎ Labslogbot talk contribs‎ 98,036 bytes +167‎ platonides: git reset --hard to restore /data/project/apache/common-local/php-master/extensions/Translate/specials/SpecialManageGroups.php (bug 52534) (wm-bot)
• curprev 22:5422:54, 4 August 2013‎ Labslogbot talk contribs‎ 97,869 bytes +53‎ platonides: --help (wm-bot)

3 August 2013

• curprev 17:5917:59, 3 August 2013‎ Labslogbot talk contribs‎ 97,816 bytes +107‎ looks like simplewiki's search index finally finished. party time. (manybubbles)

1 August 2013

• curprev 16:2716:27, 1 August 2013‎ Labslogbot talk contribs‎ 97,709 bytes +183‎ building search index for commonswiki and the other wikis that aren't in the main section of http://deployment.wikimedia.beta.wmflabs.org/wiki/Special:SiteMatrix (manybubbles)
• curprev 12:4612:46, 1 August 2013‎ Labslogbot talk contribs‎ 97,526 bytes +228‎ enwikivoyage's search index finished building over night. dewikivoyage seems to have stalled out. I'm going to profile it. simplewiki is still running and will need some love to finish more quickly. (manybubbles|away)