Quality Assurance
This MediaWiki page is inactive and kept for historical interest. It may document extensions or features that are obsolete and/or no longer supported. Do not rely on the information here being up-to-date. |
Group: | Wikimedia Release Engineering Team |
Start: | 2012-05-01 |
Team: | Wikimedia Release Engineering Team |
Contents
Mission
The Quality Assurance (QA) efforts at WMF are a part of the Wikimedia Release Engineering Team.
The job of Release Engineering is to get software from the developer's head to production as quickly, easily, efficiently and safely as possible. QA is where we drive forward the safety part of that list.
Getting Started
Getting started with Quality Assurance? Take a look at pages that are both in QA and New contributors categories.
Projects
Software testing
WMF practices two main approaches to software testing: exploratory testing and automated browser testing.
Exploratory testing is "simultaneous learning, test design and test execution" or "test design and test execution at the same time". Exploratory testing is a powerful approach that everyone should know.
Our automated browser tests use Cucumber to define test scenarios and implement the Page Object design pattern. Browser test code resides with the code repositories that they test. You can find browser test code in the /tests/browser directory of the repositories.
We have pages devoted to exploratory testing and automated browser testing.
Testing environment
The test environment is known as the Beta Cluster. This cluster mimics, as closely as possible, the production setup but in a smaller (virtualized) footprint.
It duplicates a few Wikimedia projects, for example http://en.wikipedia.beta.wmflabs.org and http://wikidata.beta.wmflabs.org. It runs the latest version of the master branch of the wiki software and all extensions. The code on the beta cluster is updated automatically every 10 minutes, and the databases about every hour.
On the Beta cluster we test the most recent software features that are assumed to be viable. It does not host wild experiments or unsupported features, but only the latest version of the master branch of features to be deployed to production.
Contact
Mailing list: The QA mail list is a great resource not only for testing Wikipedia software but also for general discussion of QA and testing practice
IRC: We are on IRC in #wikimedia-releng
connect on Freenode.
More information
Because our QA effort is spread across Wikimedia Engineering we are not always 100% engaged with every project. We have a guide on when to use QA services.
We also collaborate with Bug management, Continuous integration, Wikimedia Labs and the testing plans of other Wikimedia Engineering teams.
Documents
- Article Feedback Test Plan
- Automation discussion
- Examples
- Exploratory testing
- First week
- Getting Started
- Guide to getting started
- How we prioritize
- Levels
- Meetings
- Meetings/2013-07-18
- Meetings/2015-06-02
- Meetings/2015-06-09
- Meetings/2015-06-16
- Meetings/2015-06-23
- Meetings/2015-07-07
- Meetings/2015-08-25
- Meetings/2015-09-15
- Meetings/2015-09-22
- Meetings/2015-09-29
- Meetings/2015-10-06
- Meetings/2015-10-13
- Meetings/2015-10-20
- Meetings/2015-11-03
- Meetings/2015-11-10
- Meetings/2015-11-17
- Meetings/2015-11-24
- Meetings/2015-12-01
- Monitoring results
- Refactoring 2014
- Review February 2013
- Roadmap
- Status 2012-2014
- Status 2012-2015
- Strategy
- User priorities
- VisualEditor regression test backlog
- Weekly goals
- When to use QA services
- Workshops
- Workshops/Pair programming for fun and profit
- Workshops/Pair programming for fun and profit/2013-11-21
- Workshops/Search features
- Workshops/Selenium Workshop
- Workshops/TDD workshop
- Workshops/WTA ACUX Test Plan Apr 6
- Workshops/WTA Test Plan
- Writing feature descriptions
See also
- The first week of training QA staff get
- Bug management & How to report a bug
- Continuous integration
- Wikimedia Labs
- Manual:Unit testing
Subpages
- Article Feedback Test Plan
- Automation discussion
- Examples
- Exploratory testing
- First week
- Getting Started
- Guide to getting started
- How we prioritize
- Levels
- Meetings
- Meetings/2013-07-18
- Meetings/2015-06-02
- Meetings/2015-06-09
- Meetings/2015-06-16
- Meetings/2015-06-23
- Meetings/2015-07-07
- Meetings/2015-08-25
- Meetings/2015-09-15
- Meetings/2015-09-22
- Meetings/2015-09-29
- Meetings/2015-10-06
- Meetings/2015-10-13
- Meetings/2015-10-20
- Meetings/2015-11-03
- Meetings/2015-11-10
- Meetings/2015-11-17
- Meetings/2015-11-24
- Meetings/2015-12-01
- Monitoring results
- Refactoring 2014
- Review February 2013
- Roadmap
- Status 2012-2014
- Status 2012-2015
- Strategy
- User priorities
- VisualEditor regression test backlog
- Weekly goals
- When to use QA services
- Workshops
- Workshops/Pair programming for fun and profit
- Workshops/Pair programming for fun and profit/2013-11-21
- Workshops/Search features
- Workshops/Selenium Workshop
- Workshops/TDD workshop
- Workshops/WTA ACUX Test Plan Apr 6
- Workshops/WTA Test Plan
- Writing feature descriptions
- Pages kept for historical interest
- WMF Projects 2012q2
- WMF Projects 2012q3
- WMF Projects 2012q4
- WMF Projects 2013q1
- WMF Projects 2013q2
- WMF Projects 2013q3
- WMF Projects 2013q4
- WMF Projects 2014q1
- WMF Projects 2014q2
- WMF Projects 2014q3
- WMF Projects 2014q4
- WMF Projects 2015q1
- WMF Projects 2015q2
- WMF Projects 2015q3
- WMF Projects 2015q4
- WMF Projects 2016q1
- WMF Projects 2016q2
- WMF Projects 2016q3
- WMF Projects 2016q4
- Quality Assurance