Main Page: Difference between revisions

From Wikitech
Content deleted Content added
remove reference to obsolete article
Boldly replacing landing page with contents of User:BryanDavis/NewPortals&oldid=277450
Line 1: Line 1:
Welcome to '''Wikitech'''. This wiki hosts documentation related to the [[Portal:Wikitech|technical infrastructure]] maintained by the [[:foundation:Home|Wikimedia Foundation]] as well as the [[Portal:Wikimedia Labs|Wikimedia Labs]] cloud computing infrastructure, the [[Portal:Tool Labs|Tool Labs]] hosting environment, and many other technical projects such as the [[Nova_Resource:Deployment-prep|Beta cluster]] project used to validate new software before [[Deployments|deployment to the production cluster]].
{| id="mp-upper" style="width: 100%; margin:4px 0 0 0; background:none; border-spacing: 0px;"
| class="MainPageBG" style="width: 50%; border: 1px solid #cef2e0; background: #f5fffa; vertical-align: top; color: #000;" |
{| id="mp-left" style="width: 100%; vertical-align: top; background: #f5fffa;"
! style="padding: 2px;" | <h2 id="mf-preserve-h2" style="margin: 3px; background: #cef2e0; font-size: 120%; font-weight: bold; border: 1px solid #a3bfb1; text-align: left; color: #000; padding: 0.2em 0.4em;">Production</h2>
|-
| style="color: #000;" | <div id="mf-preserve" style="padding: 2px 5px">
The production part of this wiki, also known as '''Wikitech''', is for internal technical documentation for the Wikimedia Foundation. For technical documentation of MediaWiki software, see [[mw:|MediaWiki.org]].


<!-- TODO: links to Portal namespace rather than subpages -->
{| style="width: 100%" class="leftalign-table messagebox"
{| style="border-top:1px solid #a7d7f9;border-collapse:collapse"
!style="width:100px" | Guides
|+ style="font-weight:bold;" | Portals
| [[Operations_requests|Getting help from Operations]] '''&middot;''' [[Get involved]] '''&middot;''' [[Infrastructure naming conventions]] '''&middot;''' [[How-To|How-Tos]] '''&middot;''' [[Profiling]] '''&middot;''' [[Puppet coding]]
|-
|-
! scope="row" style="border-bottom:1px solid #a7d7f9;padding:1em;vertical-align:top;width:25%;font-size:160%;" | [[File:Tool_labs_logo.svg|center|80px|alt=Wikimedia Tool Labs logo|link=Portal:Tool Labs]] [[Portal:Tool Labs|Tool Labs]]
! Servers
| style="border-bottom:1px solid #a7d7f9;padding:1em;vertical-align:top;" | '''Tool Labs''' (or '''Tools''') is a hosting environment for community developers working on tools and bots that help users maintain and use Wikimedia wikis. Tool Labs provides access to [[Help:Tool_Labs/Database|replicas of Wikimedia databases]] and other services that allow developers to easily compute analytics, do bot work, and create tools to help editors and other volunteers in their work. The infrastructure is supported by a dedicated [[Nova_Resource:Tools|group of Wikimedia Foundation staff and volunteers]].
| [[Clusters]] '''&middot;''' [[Server Lifecycle]] '''&middot;''' [[Server Spares]] '''&middot;''' [[Apaches]] '''&middot;''' [[Media storage]] '''&middot;''' [[DNS]] '''&middot;''' [[Memcached]] '''&middot;''' [[MariaDB]] '''&middot;''' [[LDAP]] '''&middot;''' [[Multicast HTCP purging]] '''&middot;''' [[Virtualization]] '''&middot;''' [[HTTPS]] '''&middot;''' [[PartMan]]
|-
! Backups
| [[Bacula|Current status]] '''&middot;''' [[Disaster Recovery]] '''&middot;''' [[Dumps|XML database dumps]] '''&middot;''' [[Offsite Backups|Offsite]]<br />
|-
! OSs
| [http://www.ubuntu.com/ Ubuntu] ([[:Category:Ubuntu|Ubuntu]]) '''&middot;''' [[Distribution upgrades]] '''&middot;''' [[Puppet]] '''&middot;''' [[Reprepro|APT repository]] '''&middot;''' [[Package management|Debian packaging]]
|-
! Datacenter
| [[Datacenter operations]] '''&middot;''' [[Common Datacenter Specifications]] '''&middot;''' [[Platform-specific_documentation/Opengear_Serial_Consoles|Opengear Serial Consoles]] '''&middot;''' [[Platform-specific documentation]]
|-
! War
| [[Security]]
|-
! Maps
| [[Batch jobs]] '''&middot;''' [[Locations]] <small>of backups, mirrors, etc.</small> '''&middot;''' [[Scripts]]
|-
! Email
| [[Mail]] '''&middot;''' [[Mailing lists]] '''&middot;''' [[OTRS]] '''&middot;''' [[PGP Keys]]
|-
! Network
| [[Network design|Design]] '''&middot;''' [[IP addresses|IPs]] '''&middot;''' [[Network utils|Utils]] '''&middot;''' [[802.1Q]] '''&middot;''' [[RANCID]] '''&middot;''' [http://puck.nether.net/netops/ NOC Phones] '''&middot;''' [[LVS]] '''&middot;''' [[Link aggregation]] ''&middot;'' [[Network cheat sheet]] ''&middot;'' [[Proxy access to cluster]]
|-
! Other
| [[Status monitors]] '''&middot;''' [[Phabricator]] '''&middot;''' [[Renaming users]] '''&middot;''' [[Admin Logs]] '''&middot;''' [[Password reset]] '''&middot;''' [[Fundraising]]
|-
! Wiki
| [[:Category:Main|Browse root category]] '''&middot;''' [[:Category:Wiki]] '''&middot;''' [[:Category:Templates]]
|}
* [[:Category:Bot and monitoring]]
* [[:Category:Clusters]]
* [[Presentations]]
* [[Software deployments]]


All Tool Labs web applications are served through [https://tools.wmflabs.org/ tools.wmflabs.org]. A [{{Tool Labs tools list}} list of all tools] is available.
* Please add general MediaWiki documentation to [[mw:|the MediaWiki.org wiki]]


The Tool Labs platform is hosted by [[Portal:Wikimedia_Labs|Wikimedia Labs]], but this aspect is not relevant to its users. Tool Labs supersedes the "Toolserver" previously run by [[:wmde:Hauptseite|Wikimedia Deutschland]].
== See also ==
<div class="plainlinks">
* Torrus Stats: [http://torrus.wikimedia.org/torrus/CDN?path=%2FTotals%2F Totals]
* Ganglia [https://ganglia.wikimedia.org graphs]
* [[m:Wikimedia servers|Wikimedia servers]]
* [[m:System administrators|System administrators]]
</div>
</div>
|}
| style="border: 1px solid transparent;" |
<!-- USAGE -->
| class="MainPageBG" style="width: 50%; border: 1px solid #cedff2; background: #f5faff; vertical-align: top;"|
{| id="mp-right" style="width: 100%; vertical-align: top; background: #f5faff;"
! style="padding: 2px;" | <h2 id="mp-itn-h2" style="margin: 3px; background: #cedff2; font-size: 120%; font-weight: bold; border: 1px solid #a3b0bf; text-align: left; color: #000; padding: 0.2em 0.4em;">Labs</h2>
|-
|-
! scope="row" style="border-bottom:1px solid #a7d7f9;padding:1em;vertical-align:top;width:25%;font-size:160%;" | [[File:Wikimedia_labs_logo.svg|center|80px|alt=Wikimedia Labs logo|link=Portal:Wikimedia Labs]] [[Portal:Wikimedia Labs|Wikimedia Labs]]
| style="color: #000;" | <div id="mf-preserve" style="padding: 2px 5px">
| style="border-bottom:1px solid #a7d7f9;padding:1em;vertical-align:top;" | '''Wikimedia Labs''' (or '''Labs''') provides a cloud computing infrastructure powered by [[:en:OpenStack|OpenStack]] for projects related to the [[:meta:Wikimedia movement|Wikimedia movement]]. Much of the configuration for Labs projects is managed using [[:mw:Extension:OpenStackManager|OpenStackManager]] provided special pages on this wiki. The environment also provides auxiliary services, such as shared NFS storage, and access to live replica databases of Wikimedia Foundation wikis.
[[Help:FAQ|Wikimedia Labs]] is meant to make it easier for developers and system administrators to try out improvements to Wikimedia infrastructure, including MediaWiki, and to do analytics and bot work.
|-
! scope="row" style="border-bottom:1px solid #a7d7f9;padding:1em;vertical-align:top;width:25%;font-size:160%;" | [[File:Wikitech_logo.svg|center|80px|alt=Wikitech logo|link=Portal:Wikitech]] [[Portal:Wikitech|Wikitech]]
| style="border-bottom:1px solid #a7d7f9;padding:1em;vertical-align:top;" | The production part of this wiki, also known as '''Wikitech''', contains internal technical documentation for the Wikimedia Foundation. Documentation is available on most aspects of the technical operations of the [[Clusters|production server clusters]] as well as information on how to become involved in improving the underlying infrastructure of Wikimedia projects as volunteer.


For technical documentation of MediaWiki software, see [[:mw:Main Page|MediaWiki.org]].
[[Help:Terminology|Labs Account Holders]] are governed by the [[Project:Labs Terms of use|Labs terms of use]]. The [[mw:Wikimedia Labs/Agreement to disclosure of personally identifiable information|agreement to disclosure of personally identifiable information]] covers [[Help:Terminology|Labs End-Users]].

For more information, start at [[Help:Contents]].
</div>
|-
! style="padding: 2px;" | <h2 id="mp-itn-h2" style="margin: 3px; background: #cedff2; font-size: 120%; font-weight: bold; border: 1px solid #a3b0bf; text-align: left; color: #000; padding: 0.2em 0.4em;">Tool Labs</h2>
|-
| style="color: #000;" | <div id="mf-preserve" style="padding: 2px 5px">
Tool Labs, a reliable, scalable hosting environment for community developers working on tools and bots, is part of Wikimedia Labs and consists of two projects [[Nova Resource:Tools]] and [[Nova Resource:Toolsbeta]]. For more information pertaining to the Tool Labs environment, please see [[Help:Tool Labs]].
</div>
|-
! style="padding: 2px;" | <h2 id="mp-itn-h2" style="margin: 3px; background: #cedff2; font-size: 120%; font-weight: bold; border: 1px solid #a3b0bf; text-align: left; color: #000; padding: 0.2em 0.4em;">Usage</h2>
|-
| style="color: #000; padding: 2px 5px;" |
<div id="mf-preserve">{{Infobox2
| label1='''Number of {{#ask:[[Resource Type::project]]
|?
|?Description
|format=broadtable
|limit=0
|link=all
|headers=show
|mainlabel=-
|searchlabel=projects
}}:'''
| data1={{#ask: [[Resource Type::project]]|format=count}}
| label2='''Number of {{#ask:[[Resource Type::instance]]|?Instance Name|?Instance Type|?Project|?Image Id|?FQDN|?Launch Time|?Puppet Class|?Modification date|?Instance Host|?Number of CPUs|?RAM Size|?Amount of Storage|limit=0|searchlabel=instances}}:'''
| data2={{#ask: [[Resource Type::instance]]|limit=5000|format=count}}
| label3='''Amount of RAM in use (in MBs):'''
| data3={{#ask: [[Resource Type::instance]]|limit=5000|?RAM Size|format=sum}}
| label4='''Amount of allocated storage (in GBs):'''
| data4={{#ask: [[Resource Type::instance]]|limit=5000|?Amount of Storage|format=sum}}
| label5='''Number of virtual CPUs in use:'''
| data5={{#ask: [[Resource Type::instance]]|limit=5000|?Number of CPUs|format=sum}}
| label6='''Number of users:'''
| data6={{NUMBEROFUSERS}}
}}
</div>
|}
|}
|}
<noinclude>__NOTOC__</noinclude>
<noinclude>__NOTOC__</noinclude>

Revision as of 05:37, 29 January 2016

Welcome to Wikitech. This wiki hosts documentation related to the technical infrastructure maintained by the Wikimedia Foundation as well as the Wikimedia Labs cloud computing infrastructure, the Tool Labs hosting environment, and many other technical projects such as the Beta cluster project used to validate new software before deployment to the production cluster.

Portals
Wikimedia Tool Labs logo
Tool Labs
Tool Labs (or Tools) is a hosting environment for community developers working on tools and bots that help users maintain and use Wikimedia wikis. Tool Labs provides access to replicas of Wikimedia databases and other services that allow developers to easily compute analytics, do bot work, and create tools to help editors and other volunteers in their work. The infrastructure is supported by a dedicated group of Wikimedia Foundation staff and volunteers.

All Tool Labs web applications are served through tools.wmflabs.org. A list of all tools is available.

The Tool Labs platform is hosted by Wikimedia Labs, but this aspect is not relevant to its users. Tool Labs supersedes the "Toolserver" previously run by Wikimedia Deutschland.

Wikimedia Labs logo
Wikimedia Labs
Wikimedia Labs (or Labs) provides a cloud computing infrastructure powered by OpenStack for projects related to the Wikimedia movement. Much of the configuration for Labs projects is managed using OpenStackManager provided special pages on this wiki. The environment also provides auxiliary services, such as shared NFS storage, and access to live replica databases of Wikimedia Foundation wikis.
Wikitech logo
Wikitech
The production part of this wiki, also known as Wikitech, contains internal technical documentation for the Wikimedia Foundation. Documentation is available on most aspects of the technical operations of the production server clusters as well as information on how to become involved in improving the underlying infrastructure of Wikimedia projects as volunteer.

For technical documentation of MediaWiki software, see MediaWiki.org.