1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
|
# Mattermost Release Process
Mattermost core team works on a monthly release process, with a new version shipping on the 16th of each month.
This document outlines the development process for the Mattermost core team, which draws from what we find works best for us from Agile, Scrum and Software Development Lifecycle approaches.
Notes:
- All cut-off dates are based on 10am PST (UTC-07/08) on the day stated.
- T-minus counts are measured in "working days" (weekdays other than major holidays concurrent in US and Canada) prior to release day.
### (Code complete date of previous release) Beginning of release
Pre-work for the current release begins at the code complete date of the previous release. See "Code Complete" section below for details.
### (T-minus 10 working days) Cut-off for major features
No pull requests for major features should be submitted to the current release after this date (except if release manager decides to add "release-exception" label to Jira ticket).
1. Logistics:
1. Post this checklist in Release channel
2. PM:
1. Write compatibility updates for config.json and database changes [See example](https://github.com/mattermost/platform/blob/master/CHANGELOG.md#compatibility)
- Confirm changes to config.json in compatibility section of Changelog are written back to [settings documentation](https://github.com/mattermost/platform/blob/master/doc/install/Configuration-Settings.md)
- Update [Upgrade Guide](https://github.com/mattermost/platform/blob/master/doc/install/Upgrade-Guide.md) for any steps needed to upgrade to new version
- Prepare tickets for [cutting RC builds](https://mattermost.atlassian.net/browse/PLT-985), [creating the final release candidate](https://mattermost.atlassian.net/browse/PLT-986), [creating AMIs](https://mattermost.atlassian.net/browse/PLT-1213), and [testing GitLab RC with Mattermost](https://mattermost.atlassian.net/browse/PLT-1013)
3. Dev:
1. Prioritize reviewing, updating, and merging of pull requests for current release until there are no more tickets in the [pull request queue](https://github.com/mattermost/platform/pulls) marked for the current release
4. Leads: Meet to prioritize the final tickets of the release
1. Backlog is reviewed and major features that won’t make it are moved to next release
- Triage tickets
- Finalize roadmap for next release
- Draft roadmap for release after next (used to prioritize design tasks)
5. Marketing:
1. Drafts marketing bullet points for next release based off of roadmap
- Submits pull request for "Highlights" section of the Changelog
- Notes date of announcements in release channel
6. Team:
1. In Stand-up, each team member discusses worst bug (10-15s)
### (T-minus 8 working days) Feature Complete and Stabilization
**Stablization** period begins when all features for release have been committed. During this period, only **bugs** can be committed to master. Non-bug pull requests are tagged for next version, and are not committed to master until after a release candidate is cut.
Exceptions can be made by the release manager setting priority to "Highest" and adding a "release-exception" label to the Jira ticket. This will add the ticket to the [hotfix list for release candidate](https://mattermost.atlassian.net/issues/?filter=10204).
1. Logistics:
1. Post this checklist in Release channel
- Update the channel header to reflect date
- Mail out mugs to any new contributors
- Dev:
1. Prioritize reviewing, updating, and merging of pull requests for current release until there are no more tickets in the [pull request queue](https://github.com/mattermost/platform/pulls) marked for the current release
- PM:
1. Review all [Severity 1 bugs (data loss or security)](https://mattermost.atlassian.net/secure/IssueNavigator.jspa?mode=hide&requestId=10600) to consider for adding to Hotfix list
- Update documentation:
1. Make Changelog PR with updates for latest feature additions, known issues, and contributors
- Make NOTICE.txt PR for any new libraries added from dev, if not added already
- Prioritize any developer documentation tickets
- Draft [GitLab ticket](https://gitlab.com/gitlab-org/omnibus-gitlab/issues/942) to take next Mattermost version in the Omnibus, but do not post until RC1 is cut
- Coordinate testing:
1. Work with Ops to check the [Quality Gate](https://github.com/mattermost/process/blob/master/release/quality-gates.md) for feature complete
- Receive testing sign-off from feature area owners (i.e. PM/Dev either signs-off that their area is well tested, or flags potential quality issues that may exist)
- Check that Release Candidate Testing Spreadsheet is up to date
- **(Team) Feature Complete Meeting (10:15am PST)**:
1. (PM) Leads review of Changelog
- (Team) Each team member discusses worst bug (10-15s)
- (PM) Review feature list for next release
- (Marketing) Share draft of marketing bullet points for next release
- Marketing:
1. Communicate checklist of items needed by specific dates to write the blog post announce (e.g. screenshots, GIFs, documentation) and begins to write the blog post, tweet, and email for the release announcement
### (T-minus 5 working days) Code Complete and Release Candidate Cut
1. Logistics:
1. Post this checklist in Release channel
- For the next release, create team meetings on Feature Complete and Code Complete dates
- PM:
1. Remove "Under Development" notice for current release from Changelog on master
- Assign each area of the release testing spreadsheet to a team member
- **(Team) Code Complete Meeting (10:15am PST meeting)**
1. (Logistics) Walk through each item of this checklist
- (Dev) Last check of tickets that need to be merged before RC1
- (Team) Each team member discusses worst bug (10-15s)
- **Code Complete** is declared after meeting
- Dev:
1. Prioritize reviewing, updating, and merging of pull requests for current release until there are no more tickets in the [pull request queue](https://github.com/mattermost/platform/pulls) marked for the current release
- Build:
1. Master is tagged and branched and “Release Candidate 1″ is cut (e.g. 1.1.0-RC1) according to the [Release Candidate Checklist](https://github.com/mattermost/process/blob/master/release/create-release-candidate.md)
- PM:
1. Create meta issue for regressions in GitHub (see [example](https://github.com/mattermost/platform/issues/574))
- Include link to meta-issue in release notes of RC1
- Submit GitLab ticket to take next Mattermost version in the Omnibus
- Marketing:
1. Tweet announcement that RC1 is ready (see [example](https://twitter.com/mattermosthq/status/664172166368264192))
### (T-minus 4 working days) Release Candidate Testing
1. Logistics:
1. Post this checklist in Release channel
- Queue an agenda item for next team meeting for Release Process Kaizen/Q&A
- Build:
1. Test upgrade from previous version to current version, following the [Upgrade Guide](https://github.com/mattermost/platform/blob/master/doc/install/Upgrade-Guide.md)
- Database upgrade should be tested on both MySQL and Postgres
- Team:
1. Test assigned areas of the Release Candidate Testing Spreadsheet and file any bugs found in Jira
- Post a link to any "Blocking" issue that may need a hotfix to the RC in the Release room, with the **#p1** tag. If the issue is security related or contains confidential information, post the link in the Confidential Bugs private group. Blocking issues are considered to be security issues, data loss issues, issues that break core functionality, or significantly impact aesthetics.
- Triage hotfix candidates and decide on whether and when to cut next RC or final
- If no blocking issues are found, PM, Dev and Ops signs off on the release
- PM:
1. Post links to all issues found in RC as comments on the meta issue
- Update the meta issue description to include approved fixes
- Post screenshot and link to final tickets for next RC to the Release room
- Update Changelog “Known Issues” section with any significant issues that were found and not fixed for the final release
- Dev:
1. PRs for hotfixes made to release branch, and changes from release branch are merged into master
- Logistics:
1. For potentially destabilizing changes, test approved fixes on a spinmint private build
- Build:
1. Push next RC to acceptance after testing is complete and approved fixes merged, announces in Town Square on pre-release.mattermost.com/core
- PM:
1. Closes the meta issue after the next RC is cut, and opens another ticket for new RC
- Ops:
1. Verifies each of the issues in meta ticket is fixed
### (T-minus 2 working days) Release Build Cut
The final release is cut. If an urgent and important issue needs to be addressed between major releases, a bug fix release (e.g. 1.1.1) may be created
1. Logistics:
1. Post this checklist in Release channel
- Build:
1. Tags a new release (e.g. 1.1.0) and runs an official build which should be essentially identical to the last RC
- Delete RCs after final version is shipped
- PM:
1. Copy and paste the Release Notes from the Changelog to the Release Description
- Update the mattermost.org/download page
- Update the AMI links on mattermost.org/download and mattermost.org/installation
- Close final GitHub RC meta ticket
- Marketing:
1. Finalize mailchimp email blast
- Finalize blog post and put on timer for release
- Finalize tweet announcement
- Finalize announcement on general mailing list
- Finalize announcement for gitlab.mattermost.com
### (T-minus 0 working days) Release Day
1. Logistics:
1. Post this checklist in Release channel
- Post key dates for the next release in the header of the Release channel
- PM:
1. Close the release in Jira
- Set header of next release as UNDER DEVELOPMENT in CHANGELOG on master
- Dev:
1. Check if any libraries need to be updated for the next release, and if so bring up in weekly team meeting
- Marketing:
1. Confirm marketing has been posted (animated GIFs, screenshots, mail announcement, tweets, blog posts)
|
