Buildbot - Revision history

Gajop: /* Outside the chroot again */

2018-08-19T08:23:51Z

Outside the chroot again

← Older revision		Revision as of 09:23, 19 August 2018
Line 188:		Line 188:

	Get the Makefile from the Spring repository that can be used to start/stop the slave easily:		Get the Makefile from the Spring repository that can be used to start/stop the slave easily:
	~~<code>~~<pre>		<pre>
	wget https://raw.github.com/spring/spring/master/buildbot/master/buildbot.mk -O Makefile		wget https://raw.github.com/spring/spring/master/buildbot/master/buildbot.mk -O Makefile
	</pre~~></code~~>		</pre>

	Then you can use:		Then you can use:
	~~<code>~~<pre>		<pre>
	make start-slave # creates schroot session and starts buildslave in it		make start-slave # creates schroot session and starts buildslave in it
	make stop-slave # stops buildslave and remove schroot session		make stop-slave # stops buildslave and remove schroot session
	make enter-chroot # enter the schroot as buildbot user		make enter-chroot # enter the schroot as buildbot user
	</pre~~></code~~>		</pre>

	Make sure you review the Makefile and fix the chroot name, paths, etc. before using it!		Make sure you review the Makefile and fix the chroot name, paths, etc. before using it!

Gajop: /* Run (as buildbot user) */

2018-08-19T08:23:38Z

Run (as buildbot user)

← Older revision		Revision as of 09:23, 19 August 2018
Line 175:		Line 175:
	Substitute MASTER with host:port of the buildmaster and SLAVENAME and PASSWORD with the slave name and password as configured in the master.		Substitute MASTER with host:port of the buildmaster and SLAVENAME and PASSWORD with the slave name and password as configured in the master.

	~~<code>~~<pre>		<pre>
	buildslave create-slave /slave MASTER SLAVENAME PASSWORD		buildslave create-slave /slave MASTER SLAVENAME PASSWORD
	cd /slave		cd /slave
	git clone git://github.com/spring/mingwlibs.git		git clone git://github.com/spring/mingwlibs.git
	</pre~~></code~~>		</pre>

	== ccache==		== ccache==

Gajop: /* Patch a few things */

2018-08-19T08:23:28Z

Patch a few things

← Older revision		Revision as of 09:23, 19 August 2018
Line 152:		Line 152:
	For Linux builds:		For Linux builds:

	~~<code>~~<pre>		<pre>
	mv /usr/bin/ld /usr/bin/ld.orig		mv /usr/bin/ld /usr/bin/ld.orig
	cp ld /usr/bin/ld		cp ld /usr/bin/ld
	</pre~~></code~~>		</pre>

	For MinGW builds:		For MinGW builds:
	~~<code>~~<pre>		<pre>
	mv /usr/bin/i586-mingw32msvc-ld /usr/bin/i586-mingw32msvc-ld.orig		mv /usr/bin/i586-mingw32msvc-ld /usr/bin/i586-mingw32msvc-ld.orig
	cp ld /usr/bin/i586-mingw32msvc-ld		cp ld /usr/bin/i586-mingw32msvc-ld
	mv /usr/i586-mingw32msvc/bin/ld /usr/i586-mingw32msvc/bin/ld.orig		mv /usr/i586-mingw32msvc/bin/ld /usr/i586-mingw32msvc/bin/ld.orig
	cp ld /usr/i586-mingw32msvc/bin/ld		cp ld /usr/i586-mingw32msvc/bin/ld
	</pre~~></code~~>		</pre>

	For makensis:		For makensis:
	~~<code>~~<pre>		<pre>
	gcc -shared -m32 no-msync.c -o no-msync.so		gcc -shared -m32 no-msync.c -o no-msync.so
	cp makensis no-msync.so /usr/local/bin/		cp makensis no-msync.so /usr/local/bin/
	</pre~~></code~~>		</pre>

	== Run (as buildbot user)==		== Run (as buildbot user)==

Gajop: /* Recompile MinGW package with dwarf2 exceptions instead of sjlj exceptions (as root) */

2018-08-19T08:23:09Z

Recompile MinGW package with dwarf2 exceptions instead of sjlj exceptions (as root)

← Older revision		Revision as of 09:23, 19 August 2018
Line 104:		Line 104:

	First recompile the compiler itself:		First recompile the compiler itself:
	~~<code>~~<pre>		<pre>
	mkdir mingw		mkdir mingw
	cd mingw		cd mingw
Line 115:		Line 115:
	dpkg -i gcc-mingw32*.deb		dpkg -i gcc-mingw32*.deb
	echo "gcc-mingw32 hold"\|dpkg --set-selections		echo "gcc-mingw32 hold"\|dpkg --set-selections
	</pre~~></code~~>		</pre>

	Then recompile the runtime libraries against the new compiler:		Then recompile the runtime libraries against the new compiler:

	~~<code>~~<pre>		<pre>
	apt-get build-dep mingw32-runtime		apt-get build-dep mingw32-runtime
	apt-get source mingw32-runtime		apt-get source mingw32-runtime
Line 127:		Line 127:
	dpkg -i mingw32-runtime*.deb		dpkg -i mingw32-runtime*.deb
	echo "mingw32-runtime hold"\|dpkg --set-selections		echo "mingw32-runtime hold"\|dpkg --set-selections
	</pre~~></code~~>		</pre>

	Optionally, remove build dependencies (check what apt-get build-dep installed!):		Optionally, remove build dependencies (check what apt-get build-dep installed!):

	~~<code>~~<pre>		<pre>
	apt-get purge autoconf automake autotools-dev cdbs debhelper fdupes gettext \		apt-get purge autoconf automake autotools-dev cdbs debhelper fdupes gettext \
	gettext-base groff-base html2text intltool intltool-debian libcroco3 \		gettext-base groff-base html2text intltool intltool-debian libcroco3 \
Line 139:		Line 139:
	libsys-hostname-long-perl libunistring0 liburi-perl libwww-perl \		libsys-hostname-long-perl libunistring0 liburi-perl libwww-perl \
	libxml-parser-perl lzma m4 man-db mingw-w64 po-debconf		libxml-parser-perl lzma m4 man-db mingw-w64 po-debconf
	</pre~~></code~~>		</pre>

	== Patch a few things ==		== Patch a few things ==

Gajop: /* Building and entering the chroot */

2018-08-19T08:22:37Z

Building and entering the chroot

← Older revision		Revision as of 09:22, 19 August 2018
Line 42:		Line 42:
	==Building and entering the chroot==		==Building and entering the chroot==

	~~<code>~~<pre>		<pre>
	debootstrap --variant=buildd --arch i386 maverick $DIR http://ftp.cvut.cz/ubuntu/		debootstrap --variant=buildd --arch i386 maverick $DIR http://ftp.cvut.cz/ubuntu/
	mkdir -p $DIR/home/buildbot/www		mkdir -p $DIR/home/buildbot/www
	chown buildbot:buildbot $DIR/home/buildbot		chown buildbot:buildbot $DIR/home/buildbot
	schroot -c buildbot-maverick		schroot -c buildbot-maverick
	</pre~~></code~~>		</pre>

	= Inside the chroot=		= Inside the chroot=

Gajop: /* Run (as root) */

2018-08-19T08:22:14Z

Run (as root)

← Older revision		Revision as of 09:22, 19 August 2018
Line 52:		Line 52:

	== Run (as root)==		== Run (as root)==
	~~<code>~~<pre>		<pre>
	echo 'deb http://ftp.cvut.cz/ubuntu maverick universe' >> /etc/apt/sources.list		echo 'deb http://ftp.cvut.cz/ubuntu maverick universe' >> /etc/apt/sources.list
	sed s/deb/deb-src/g /etc/apt/sources.list >> /etc/apt/sources.list		sed s/deb/deb-src/g /etc/apt/sources.list >> /etc/apt/sources.list
Line 66:		Line 66:
	mkdir /slave		mkdir /slave
	chown buildbot:buildbot /slave		chown buildbot:buildbot /slave
	</pre~~></code~~>		</pre>

	Build dependencies for Windows build (except MinGW, see below):		Build dependencies for Windows build (except MinGW, see below):
	~~<code>~~<pre>		<pre>
	apt-get install cmake nsis p7zip-full unzip wget pandoc wine		apt-get install cmake nsis p7zip-full unzip wget pandoc wine
	apt-get install openjdk-6-jdk #to enable building of Java AIs		apt-get install openjdk-6-jdk #to enable building of Java AIs
	</pre~~></code~~>		</pre>

	Build dependencies for Linux build:		Build dependencies for Linux build:
	~~<code>~~<pre>		<pre>
	apt-get install libboost-all-dev libdevil-dev libfreetype6-dev libopenal-dev \		apt-get install libboost-all-dev libdevil-dev libfreetype6-dev libopenal-dev \
	libogg-dev libvorbis-dev libglew-dev libsdl-dev libxcursor-dev \		libogg-dev libvorbis-dev libglew-dev libsdl-dev libxcursor-dev \
	p7zip-full		p7zip-full
	</pre~~></code~~>		</pre>

	Build dependencies for validation test:		Build dependencies for validation test:
	~~<code>~~<pre>		<pre>
	apt-get install gdb libcurl4-gnutls-dev		apt-get install gdb libcurl4-gnutls-dev
	</pre~~></code~~>		</pre>

	Build dependencies for doxygen:		Build dependencies for doxygen:
	~~<code>~~<pre>		<pre>
	apt-get install doxygen		apt-get install doxygen
	</pre~~></code~~>		</pre>

	Build dependencies for cppcheck:		Build dependencies for cppcheck:
	~~<code>~~<pre>		<pre>
	apt-get install cppcheck		apt-get install cppcheck
	</pre~~></code~~>		</pre>

	Speed up linking:		Speed up linking:
	~~<code>~~<pre>		<pre>
	apt-get install binutils-gold		apt-get install binutils-gold
	</pre~~></code~~>		</pre>

	== Recompile MinGW package with dwarf2 exceptions instead of sjlj exceptions (as root)==		== Recompile MinGW package with dwarf2 exceptions instead of sjlj exceptions (as root)==

Gajop: /* Configuring schroot */

2018-08-19T08:21:24Z

Configuring schroot

← Older revision		Revision as of 09:21, 19 August 2018
Line 23:		Line 23:
	Add a file (name does not matter) to `/etc/schroot/chroot.d` with the following contents, after substituting an absolute path for `$DIR`:		Add a file (name does not matter) to `/etc/schroot/chroot.d` with the following contents, after substituting an absolute path for `$DIR`:

	~~<code>~~<pre>		<pre>
	[buildbot-maverick]		[buildbot-maverick]
	description=Ubuntu Maverick		description=Ubuntu Maverick
Line 34:		Line 34:
	script-config=script-defaults		script-config=script-defaults
	message-verbosity=verbose		message-verbosity=verbose
	</pre~~></code~~>		</pre>

	Then, remove or comment out the `/home` bind mount in `/etc/schroot/default/fstab`!		Then, remove or comment out the `/home` bind mount in `/etc/schroot/default/fstab`!

Gajop: /* Setting up buildmaster */

2018-08-19T08:21:10Z

Setting up buildmaster

← Older revision		Revision as of 09:21, 19 August 2018
Line 5:		Line 5:
	=Setting up buildmaster=		=Setting up buildmaster=

	~~<code>~~<pre>		<pre>
	sudo apt-get install buildbot		sudo apt-get install buildbot
	cd spring/buildbot/master		cd spring/buildbot/master
Line 11:		Line 11:
	buildbot start		buildbot start
	buildbot create-master		buildbot create-master
	</pre~~></code~~>		</pre>

	After creating the master, the generated `public_html` can be erased and linked to the `buildbot/master/public_html` in the Spring repository.		After creating the master, the generated `public_html` can be erased and linked to the `buildbot/master/public_html` in the Spring repository.

Abma at 16:12, 14 March 2018

2018-03-14T16:12:24Z

← Older revision		Revision as of 17:12, 14 March 2018
Line 1:		Line 1:
	Spring uses a [~~http~~://buildbot.springrts.com/waterfall buildbot] to automaticly compile commits to the git repository to test if the commit broke something and to create the official installers.		Spring uses a [https://buildbot.springrts.com/waterfall buildbot] to automaticly compile commits to the git repository to test if the commit broke something and to create the official installers.

	There are currently three buildbot setups, based on [[Buildbot:Gentoo\|Gentoo]], [[Buildbot:OSX\|OSX]] and ubuntu (this page, but deprecated).		There are currently three buildbot setups, based on [[Buildbot:Gentoo\|Gentoo]], [[Buildbot:OSX\|OSX]] and ubuntu (this page, but deprecated).

Abma at 17:57, 16 January 2015

2015-01-16T17:57:45Z

← Older revision		Revision as of 18:57, 16 January 2015
Line 2:		Line 2:

	There are currently three buildbot setups, based on [[Buildbot:Gentoo\|Gentoo]], [[Buildbot:OSX\|OSX]] and ubuntu (this page, but deprecated).		There are currently three buildbot setups, based on [[Buildbot:Gentoo\|Gentoo]], [[Buildbot:OSX\|OSX]] and ubuntu (this page, but deprecated).

	~~{{deprecated}}~~

	=Setting up buildmaster=		=Setting up buildmaster=

	~~The build master is set up using virtualenv, so that buildbot needs not to be installed as root, and so that buildbot can't conflict with other installed python packages.~~
	~~So, first, set up the virtualenv (in the directory virtualenv in this example):~~

	~~<code><pre>~~
	~~apt-get install python-dev python-virtualenv~~
	~~virtualenv --no-site-packages virtualenv~~
	~~echo 'source $HOME/virtualenv/bin/activate' >> ~/.profile~~
	~~source virtualenv/bin/activate~~
	~~</pre></code>~~

	~~Then we check out buildbot sources, switch to the last stable release, and install into the virtual environment.~~

	<code><pre>		<code><pre>
	~~git clone git://github.com/~~buildbot~~/buildbot.git~~		sudo apt-get install buildbot
	cd buildbot/master		cd spring/buildbot/master
	~~git checkout v0~~.8.5		cp passwords.py.template passwords.py
	~~python setup~~.py ~~install~~		buildbot start
			buildbot create-master
	</pre></code>		</pre></code>

	~~After this commands like `buildbot create-master` and `buildbot start` can be used to create/control the master.~~
	After creating the master, the generated `public_html` can be erased and linked to the `buildbot/master/public_html` in the Spring repository.		After creating the master, the generated `public_html` can be erased and linked to the `buildbot/master/public_html` in the Spring repository.