ReleasingWesnoth

Tools

Tools needed for releasing:

• Normal tools to build everything from Wesnoth and to fetch the repository head (cmake based assumed for this page!)
• po4a (to be able to update the manpages and manual)
• docbook-xml-dtd (to generate the manual HTML files)
• xdelta 1.x (to create the Xdelta files)
• rsync for upload of tarballs

Tools for other processes:

• optipng (only for needed to run utils/wesnoth-optipng, not for normal releases)
• imagemagick (tool convert, only for needed to run utils/wesnoth-optipng, not for normal releases)
• advancecomp (tool advdef, only for needed to run utils/wesnoth-optipng, not for normal releases)

General maintenance

Not strictly release associated though the pot-update part should be done right before every release.

• Run utils/wesnoth-optipng from the main directory of the checkout every now and then (read: very rarely, it enlarges the Git repository for very negligible reductions in distribution size), requires the packages optipng, imagemagick and advancecomp
• Run a pot-update regularly, once shortly before the release and before each string-freeze (including string-freezes in preparation for stable releases). This involves the following steps as of 1.13.3:

Change into the repository directory, pull (and rebase!)
# create build folder and cd into it
mkdir wesnoth-build && cd wesnoth-build
# run cmake and at leastenable the pot-update target
cmake ../ -DENABLE_POT_UPDATE_TARGET=TRUE

# Recreate the manpages (watch out for errors, they are very frequent!)
make update-po4a-man
# Recreate the manual (replace <N> with number of parallel jobs to run)
make update-po4a-manual -j<N>
# Update all the other pot and po files (replace <N> with number of parallel jobs to run)
make pot-update -j<N>
# make sure all files compile
make mo-update

# get out of the build folder back to the git folder
cd ../
# Make sure that no new files were created in doc/, if new manpages/manuals were created, add them
git status doc/

# Commit the bunch of updated po files and manpages/manuals
git commit doc/ po/

(the following commands should be run but are usually forgotten...)

• Run make lint inside data/tools (runs wmllint with appropriate options), fix warnings or prod campaign and content maintainers as needed
• Run make reindent from data/tools to reindent all mainline WML according to our conventions (probably don't want to do this too often as it may inconvenience coders)
• Have a look at the pages from the category Review on Release

Release tasks

Preparation steps

• Make sure to run and commit a pot-update (see above), and update to the latest revision of the branch if needed. At this point you should warn people to stop pushing commits to the branch you'll be using for the release so as to avoid last-minute work sync issues or new unexpected bugs.
• Check changelog and players_changelog for completeness and correctness, line wrap to 80 columns.
• Bump the version numbers in src/wesconfig.h, Doxyfile, changelog, and players_changelog and commit. Note that as of version 1.13.2 there are additional RC_VERSION_* macros in src/wesconfig.h needed by Windows builds. Since unlike VERSION these aren't freeform values, they should represent the next release version whenever VERSION represents an in-dev version (e.g. if VERSION is 1.13.2+dev, the RC_VERSION_* macros should have the values for 1.13.3 instead).

Generating the files

# Update the git checkout, just to be sure that you have the
# latest version

git pull --rebase

# Export the git checkout into a release tar archive (substitute
# $VERSION with the release version number and $BRANCH with the
# source branch). This will automatically exclude unwanted
# directories from the archive following export-ignore rules in
# .gitattributes

git archive --format=tar --prefix="wesnoth-$VERSION/" $BRANCH > "wesnoth-$VERSION.tar"

# Create the xdelta patch for the archives (this assumes that the
# uncompressed $OLDVERSION tar archive is present!)

xdelta delta wesnoth-$OLDVERSION.tar wesnoth-$VERSION.tar wesnoth-$OLDVERSION.tar-wesnoth-$VERSION.tar.xdelta

# Compress the tarball

bzip2 wesnoth-$VERSION.tar

# Create the SHA256 sum for the tarball

sha256sum wesnoth-$VERSION.tar.bz2 > wesnoth-$VERSION.tar.bz2.sha256

File upload

The following files should be ready for upload now:

• wesnoth-$VERSION.tar.bz2
• wesnoth-$VERSION.tar.bz2.sha256
• wesnoth-$OLDVERSION.tar-wesnoth-$VERSION.tar.xdelta

You must upload these files to SourceForge.net and to files.wesnoth.org/releases/ (as backup). Since the tarballs are very large it's recommended to use rsync via SSH instead of web uploads to guarantee their integrity. After uploading to wesnoth.org it might save time to rsync to SF.net from there.

For uploading to wesnoth.org, you will need to ask the site administrators for help with setting up your SSH configuration, as well as determining the destination path for the files.

# Upload to files.wesnoth.org (path for reference purposes only,
# does not reflect actual server set-up).

rsync -avP -e ssh <FILES> <USERNAME>@wesnoth.org:WWW/html/files/

# Upload to SF.net:
#
# * STREAM: replace with 'wesnoth' for development releases and
#   'wesnoth-X.Y' for a stable release of the X.Y series.
# * RELEASENAME: replace with the release name, e.g.
#   'wesnoth-X.Y.Z'.

rsync -avP -e ssh <FILES> <USERNAME>,wesnoth@frs.sourceforge.net:/home/frs/project/w/we/wesnoth/<STREAM>/<RELEASENAME>

Build the release for testing

You can build the release for testing while the upload is in progress. Before installing the test build make sure that no old leftover files are there, and also remove the old preferences or (preferably) use the utils/wesnoth-defaults script found in the repository to use a throwaway preferences dir.

# Depending on whether you already compressed the tarball or not
tar -xvf wesnoth-$VERSION.tar
tar -xvf wesnoth-$VERSION.tar.bz2

cd wesnoth-$VERSION && mkdir build && cd build

# CMake command to create a test build with suffix -X.Y.Z to be
# installed to /opt/wesnoth-X.Y.Z instead of /usr/local
cmake .. \
		-DCMAKE_INSTALL_PREFIX=/opt/wesnoth-X.Y.Z \
		-DENABLE_SERVER=TRUE \
		-DENABLE_CAMPAIGN_SERVER=TRUE \
		-DPREFERENCES_DIR=.wesnoth-X.Y.Z \
		-DBINARY_SUFFIX=-X.Y.Z \
		-DENABLE_NOTIFICATIONS=TRUE \
		-DENABLE_STRICT_COMPILATION=TRUE

# Build
make -j<N>

# install
sudo make install

Now cd somewhere else and run the installed copy of the game (e.g. /opt/wesnoth-X.Y.Z/bin/wesnoth). Running right from the sources is not enough to be sure that everything works as expected.

Test the build

This at least includes the following:

• Start the editor, check if creating a map is possible
• Start the game and try to connect to the official multiplayer server and to the add-on server
• Start the server, connect to it using the game to see if you can enter the lobby
• Check if in the game each campaign does start
• Check if you can start the in-game help and the credits
• Check if it is possible to create a local game
• Play at least one game/scenario (or droid your side to let the AI play), this can either be a normal campaign scenario or a multiplayer game

If all of those points are working as expected, go on, if not, fix the problems and restart from the very beginning.

Tagging and extra release related steps

If everything works as expected, tag your release. Just use the version number (e.g. 1.13.2 or 1.14.0) for the tag, no need to add wesnoth- in front:

git tag $VERSION HEAD -m "Wesnoth $VERSION" && git push $VERSION

Update macro-reference.html:

cd data/tools/
make macro-reference.html
scp macro-reference.html wesnoth@wesnoth.org:WWW/html/macro-reference.html

Regenerate the game credits and paste the contents to Credits on the wiki:

data/tools/about_cfg_to_wiki -w <PATH TO GAME EXECUTABLE> > about.wiki

Notify packagers

Once all steps above are done and the upload to sourceforge is finished, you still need to notify the packagers. The announcement should include the important changes for packagers (especially path, dependencies, and other build-time changes), as well as the SHA256 checksum of the tarball attached.

For the current list of packagers, check /scratch/packagers-list on the files.wesnoth.org filesystem.

Example messages

Development version

Subject: Wesnoth X.Y.Z is out!

Hello,

Wesnoth X.Y.Z, a new feature release in the X.Y.x development series, is out 
now.

The sources are already available on SourceForge.net, and files.wesnoth.org 
(for backup or in case you don't trust the authenticity of the files on 
SF.net). We will announce the release within the next 72 hours. In the 
meantime you can create and upload your packages.

Nothing has changed for packagers in terms of dependencies or install 
locations in this release.

Thank you for your contribution to Wesnoth!

Stable version

Subject: Wesnoth X.Y.Z is out!

Hello,

Wesnoth X.Y.Z, a new maintenance release in the X.Y.x stable series, is out 
now.

The sources are already available on SourceForge.net, and files.wesnoth.org 
(for backup or in case you don't trust the authenticity of the files on 
SF.net). We will announce the release within the next 72 hours. In the 
meantime you can create and upload your packages.

As this is a stable maintenance release, nothing has changed for packagers in
terms of dependencies or install locations.

Thank you for your contribution to Wesnoth!

Cleanup and post release steps

Bump the version numbers in the files mentioned above in the release preparation steps and commit your changes. Consider deleting the test build, tarball, xdelta, etc. from your filesystem as needed.

Contact shadowm or Soliton to update the MP servers' configuration to allow users of the new release or rebuild the servers as needed (only required for development releases).

The real announcement

Prepare the real announcement forum post for the day it is to be posted. To do so copy the last announcement from the release thread into the hidden forum (edit, then copy & paste). Edit the new copy to match the new release as needed, and leave it there for fixes and comments until the time for the real announcement comes. Make sure to use the items from RELEASE_NOTES (which you will purge after the final announcement is published).

You should also prepare the front page/News forum post in advance.

Wait until the announcement conditions are met (waited at least 24 hours and OS X and Windows builds are ready OR 72 hours passed).

When ready to make the announcement public, do the following:

• Update Download in the wiki (currently takes the relevant contents from Template:StableDownload and Template:DevDownload).
• Post the contents of the new announcement post to the Release forum section as a new 'Announcement' topic.
• Set the previous announcement to a 'Normal' topic and lock it.
• Post the new News forum post to the News forum section.
• Update the wesnoth.org front page (yes, this has to be done by hand, I know, it sucks ― shadowm):
  • Change versions, sizes, and links in the overview section to point to the latest version.
  • Update the front page news section with an HTML version of the News forum post.
  • If the front page news section is getting too large, remove some of the oldest posts.
• Copy the new news to Older_News.
• Update topics on IRC and post to social media (Twitter, etc.) as applicable.
• Clean up RELEASE_NOTES in the repository so it only contains the template for the next release.