Update the NEWS file and set the version number

accordingly.

.gitattributes

@@ -0,0 +1 @@
+src/IDF/version.php     export-subst

.gitignore

@@ -1,3 +1,4 @@
+*~
 tmp
 src/IDF/conf/idf.php
 src/IDF/conf/idf.test.php
@@ -6,3 +7,5 @@ www/media/upload
 src/IDF/gettexttemplates
 indefero-*.zip
 src/IDF/conf/path.php
+.tx/config
+src/IDF/locale/idf.pot.bak

AUTHORS

@@ -1,28 +1,41 @@
 InDefero was originally created during summer 2008
 by Loïc d'Anterroches with the support of Céondo Ltd.
 
-Much appreciated contributors:
+Much appreciated contributors (in alphabetical order):
 
-    Nicolas Lassalle <http://www.beroot.org/> - Subversion support
-    bohwaz <http://bohwaz.net/>
+    Adrien Bustany <madcat@mymadcat.com>
+    Andrew Nguyen <andrew-git-indefero@na-consulting.net>
+    Baptiste Durand-Bret <bathizte@ozazar.org>
+    Baptiste Michaud <bactisme@gmail.com>           - Subversion sync
     Benjamin Jorand <benjamin.jorand@gmail.com>     - Mercurial support
-    Baptiste Michaud <bactisme@gmail.com> - Subversion synchronization
-    Julien Issler 
+    Brenda Wallace <shiny@cpan.org>
+    Brian Armstrong <brianar>
+    Charles Melbye <charlie@yourwiki.net>
+    Ciaran Gultnieks <ciaran@ciarang.com>
+    David Feeney <davidf>
+    Denis Kot <denis.kot@gmail.com>                 - Russian translation
+    Dmitry Dulepov <dmitryd>
+    Fernando Sayago Gil <mikados.mikados@gmail.com> - Spanish translation
+    Jakub Viták <mainiak@gmail.com>                 - Czech translation
+    Janez Troha <http://www.dz0ny.info>             - Slovenian translation
+    Jean-Philippe Fleury <jpfleury>
+    Jerry <lxb429@gmail.com>                        - Chinese translation
+    Julien Issler <julien@issler.net>
+    Ludovic Bellière <xrogaan>
     Manuel Eidenberger <eidenberger@gmail.com>
-    Ciaran Gultnieks
+    Matthew Dawson <mjd>
+    Matías Halles <matias@halles.cl>
     Mehdi Kabab <http://pioupioum.fr/>
-    Sindre R. Myren
+    Nicolas Lassalle <nicolas@beroot.org>           - Subversion support
     Patrick Georgi <patrick.georgi@coresystems.de>
-    Adrien Bustany
-    Charles Melbye
-    Baptiste Durand-Bret
-    Andrew Nguyen
-    David Feeney
-    Denis Kot <denis.kot@gmail.com>
-    Samuel Suther
-    Ludovic Bellière
-    Brian Armstrong
-    Raphaël Emourgeon
+    Raphaël Emourgeon <raphael>
+    Samuel Suther <info@suther.de>                  - German translation
+    Sindre R. Myren <sindrero@stud.ntnu.no>
+    Thomas Keller <me@thomaskeller.biz>             - Monotone support
+    Vladimir Solomatin <slash>
+    William Martin <william.martin@lcpc.fr>
+    Xavier Brochard <xavier@alternatif.org>
+    bohwaz <http://bohwaz.net/>
 
 And all the nice users who spent time reporting issues and promoting
 the project. The project could not live without them.

CONTRIBUTE.mdtext

@@ -0,0 +1,116 @@
+[Indefero][idf] is not only a software you can use either hosted for
+you or hosted by you, but also a free software you can contribute to. 
+
+Here you will get how to contribute and what to contribute.
+
+[idf]: http://www.indefero.net 
+
+# Quick Way on How to Contribute
+
+Simple contribution:
+
+1. Open a ticket with your idea. You can directly propose a patch if
+   you have it.
+
+2. Wait for it to be checked by the devs or meet us on the #indefero
+   channel on [FreeNode][freenode].
+
+Bigger contribution:
+
+1. Fork Indefero where you want (fork from the develop branch).
+
+2. Code your change and document it.
+
+3. Open a ticket with a pull request and talk about it on IRC.
+
+# The General Contribution Workflow for Regular Contributors
+
+1. Fork Indefero from the **develop** branch.
+2. Request a pull request if you do not have write access on the repository.
+3. Merge your changes without fast forward in develop. This keeps track of 
+   the history of the changes and makes understanding what is going on easy.
+4. Merge your changes with fast forward **only if a single commit**.
+
+Indefero is composed of two main branches:
+
+1. **master**: this is the shipped branch, only a select number of people
+   can push into it.
+2. **develop**: this is the development branch, all the people having write
+   access to the repository are welcomed to push in.
+
+**Note:** The branching model we use is [explained in details here][bmi]. You
+**must** understand it to really contribute to the code base in an
+efficient way. 
+
+[bmi]: http://nvie.com/git-model "A successful Git branching model"
+
+# What to Contribute
+
+Contribution is easy, you can contribute in a lot of different fields,
+contributions small or big are always appreciated. Here is an example
+list of what you can do:
+
+- Install InDefero on your system and report the problem you had.
+- Find the bad English and typos and propose corrections.
+- Help with the translation effort.
+- Find little bugs or usability problems and provide ideas on how to fix them.
+- Register to the [discussion group][group] and help new users.
+- Come and chat on IRC #indefero on the [FreeNode][freenode] servers.
+- Find ways to improve the design while keeping it **beautifully simple**.
+- Write a blog post about the project, what you think is good or bad.
+- Translate InDefero for the sake of the community.
+- Or maybe really hack into the code.
+
+As you can see, the real hacking into the code is just a small part of the work, so even if you are not a coder you can do a lot.
+
+[group]: http://groups.google.com/group/indefero-users
+[freenode]: http://freenode.net/ 
+
+## I am a simple user
+
+Thanks a lot! Really! As a project leader, I consider **you** as 
+**the most important person in the success of the project**. So do not
+worry, I will really listen to your needs and make you love this
+project.
+
+What you can do to help:
+
+- Use the software and each time you find something a bit annoying in your daily use, report a bug. Usability issues are high priority issues.
+- Find typos, grammar mistakes, etc. and report a bug.
+- Write about InDefero on your blog/website.
+- Read the issues submitted by the users and provide answers if you have them.
+- ...
+
+## I am a designer
+
+A lot of things to do for you:
+
+- Check the design and find the flaws in it. Is the space well used, does it look really nice and is it also functional for the first users?
+- Do we have good support of all the major browsers?
+- ...
+
+## I am a coder
+
+Checkout the code and have fun, but keep in mind that your results
+must be simple to use. Do not worry about the beautiful part, the
+designers can work on that.
+
+## I am a security guy
+
+Please, do try to break it, if you find a problem, come on IRC or
+contact the developers to get the issue fixed as soon as
+possible. Please, be nice, do not release the issue in the wild
+without first talking to us.
+
+## I am a translator
+
+We currently use [transifex](http://trac.transifex.org) to help our
+users translate indefero. You don't have to use it, but it's an easy
+way to do the job. You can visit the indefero page at transifex here:
+
+    http://www.transifex.net/projects/p/indefero/
+
+Please understand that your changes will not be commited instantly,
+but are sent to the maintainers e-mails before. Then, your changes
+will not be in the main repository until the maintainer pushs the
+changes. In that way, try to do big changes with less submissions.

INSTALL.mdtext

@@ -37,6 +37,7 @@ docroot.
     $ sudo pear upgrade-all
     $ sudo pear install --alldeps Mail
     $ sudo pear install --alldeps Mail_mime
+    $ sudo pear install --alldeps Console_Getopt
 
 If you already have some of the PEAR packages installed with your
 distribution, the `Mail` package is often not up-to-date, 
@@ -213,3 +214,13 @@ may have problems as your certificate is not trusted, check the
 [procedure provided here][svnfix] to solve the problem.
 
 [svnfix]: http://projects.ceondo.com/p/indefero/issues/319/#ic1358
+
+## If the registration links are not working
+
+If You have standard instalaction of PHP ie in Debian, php.ini sets
+mbstring.func_overload to value "2" for overloading str*
+functions. You need to prevent the overload as it does not make sense
+anyway (magic in the background is bad!). 
+See the [corresponding ticket][reglink].
+
+[reglink]: http://projects.ceondo.com/p/indefero/issues/481/

Makefile

@@ -0,0 +1,141 @@
+# ***** BEGIN LICENSE BLOCK *****
+# This file is part of InDefero, an open source project management application.
+# Copyright (C) 2010 Céondo Ltd and contributors.
+#
+# InDefero is free software; you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation; either version 2 of the License, or
+# (at your option) any later version.
+#
+# InDefero is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write to the Free Software
+# Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA  02110-1301  USA
+#
+# ***** END LICENSE BLOCK ***** */
+
+#   Installation of external tools : transifex-client
+#   sudo apt-get install python-setuptools
+#   sudo easy_install -U transifex-client
+
+
+
+.PHONY: help
+help:
+	@printf "Rules for generating distributable files :\n"
+	@for b in `git branch | sed "s/^. //g"`; do \
+		printf "\t"$$b"-zipfile - Generate a zip archive of the "$$b" branch.\n"; \
+	done
+	@printf "\nRules for internationalization :\n";
+	@printf "\tpot-update - Update the POT file from HTML templates and PHP sources, then merge it with PO file.\n"
+	@printf "\tpot-push   - Send the POT file to the transifex server.\n"
+	@printf "\tpo-update  - Merge the POT file into the PO file. The POT is not regenerated.\n"
+	@printf "\tpo-push    - Send the all PO files to the transifex server.\n"
+	@printf "\tpo-pull    - Get all PO files from the transifex server.\n"
+	@printf "\tpo-stats   - Show translation statistics of all PO files.\n"
+
+#
+#   Internationalization rule, POT & PO file manipulation
+#
+.PHONY: pluf_path
+pluf_path:
+ifeq (src/IDF/conf/path.php, $(wildcard src/IDF/conf/path.php))
+PLUF_PATH=$(shell php -r "require_once('src/IDF/conf/path.php'); echo PLUF_PATH;")
+else
+	@printf "File 'src/IDF/conf/path.php' don't exist. Please configure it !\n"
+	@exit 1
+endif
+ 
+.PHONY: pot-update po-update
+pot-update: pluf_path
+	# Backup pot file
+	@if [ -e src/IDF/locale/idf.pot ]; then                     \
+	mv -f src/IDF/locale/idf.pot src/IDF/locale/idf.pot.bak;    \
+	fi
+	touch src/IDF/locale/idf.pot;
+	# Extract string
+	@cd src; php $(PLUF_PATH)/extracttemplates.php IDF/conf/idf.php IDF/gettexttemplates
+	@cd src; for phpfile in `find . -iname "*.php"`; do \
+		printf "Parsing file : "$$phpfile"\n"; \
+		xgettext -o idf.pot -p ./IDF/locale/ --from-code=UTF-8 -j \
+			--keyword --keyword=__ --keyword=_n:1,2 -L PHP $$phpfile ; \
+		done
+	#	Remove tmp folder
+	rm -Rf src/IDF/gettexttemplates
+	# Update PO
+	@make po-update
+
+po-update: pluf_path
+	@for pofile in `ls src/IDF/locale/*/idf.po`; do \
+		printf "Updating file : "$$pofile"\n"; \
+		msgmerge -v -U $$pofile src/IDF/locale/idf.pot; \
+		printf "\n"; \
+	done
+
+#
+#   Transifex
+#
+.PHONY: check-tx-config
+check-tx-config:
+	@if [ ! -e .tx/config ]; then                                       \
+	mkdir -p .tx;                                                       \
+	touch .tx/config;                                                   \
+	printf "[main]\n" >> .tx/config;                                        \
+	printf "host = http://www.transifex.net\n" >> .tx/config;               \
+	printf "\n" >> .tx/config;                                              \
+	printf "[indefero.idfpot]\n" >> .tx/config;                             \
+	printf "file_filter = src/IDF/locale/<lang>/idf.po\n" >> .tx/config;    \
+	printf "source_file = src/IDF/locale/idf.pot\n" >> .tx/config;          \
+	printf "source_lang = en\n" >> .tx/config;                              \
+	fi
+	@if [ ! -e $(HOME)/.transifexrc ]; then					\
+	touch $(HOME)/.transifexrc;												\
+	printf "[http://www.transifex.net]\n" >> $(HOME)/.transifexrc;						\
+	printf "username = \n" >> $(HOME)/.transifexrc;								\
+	printf "token = \n" >> $(HOME)/.transifexrc;								\
+	printf "password = \n" >> $(HOME)/.transifexrc;								\
+	printf "hostname = http://www.transifex.net\n" >> $(HOME)/.transifexrc;					\
+	printf "You must edit the file ~/.transifexrc to setup your transifex account (login & password) !\n";	\
+	exit 1;																\
+	fi
+
+pot-push: check-tx-config
+	@tx push -s
+
+po-push: check-tx-config
+	@tx push -t
+
+po-pull: check-tx-config
+	# Save PO
+	@for pofile in `ls src/IDF/locale/*/idf.po`; do \
+	    cp $$pofile $$pofile".save"; \
+	done
+	# Get new one
+	@tx pull -a
+	# Merge Transifex PO into local PO (so fuzzy entry is correctly saved)
+	@for pofile in `ls src/IDF/locale/*/idf.po`; do \
+	    msgmerge -U $$pofile".save" $$pofile; \
+	    rm -f $$pofile; \
+	    mv $$pofile".save" $$pofile; \
+	done
+
+po-stats:
+	@msgfmt --statistics -v src/IDF/locale/idf.pot
+	@for pofile in `ls src/IDF/locale/*/idf.po`; do \
+	    msgfmt --statistics -v $$pofile; \
+	done
+
+#
+#   Generic rule to build a zipfile of indefero for a specified branch
+#   ex: make master_zipfile
+#       make develop_zipfile
+#
+%-zipfile:
+	@git archive --format=zip --prefix="indefero/" $(@:-zipfile=) \
+		> indefero-$(@:-zipfile=)-`git log $(@:-zipfile=) -n 1 \
+		--pretty=format:%h`.zip
+

NEWS.mdtext

@@ -0,0 +1,105 @@
+# InDefero 1.1.2 - Thu May 26 07:42:25 UTC 2011
+
+## Bugfixes
+
+- Fix tags extraction from git repository (issue 675)
+- Fix SSH validation method (issue 671)
+- Fix malformed URL in the RSS (issue 666)
+- Fix validateRevision call for Mercurial Scm (issue 657)
+
+## Translations
+
+- Missing word in French translation (issue 672)
+- Update Spanish translation
+
+# InDefero 1.1.1 - Mon Mar 28 15:52 2011 UTC
+
+## Bugfixes
+
+- Fix an incompatibility with Python 3.1 in gitserve.py (issue 554)
+- Fix PHP error when the commit view shows a commit with changed binary files (issue 643)
+- A migration problem prevented the preferences page being displayed properly (issues 644 and 653)
+- Fix PHP error when trying to create Mercurial source archives (issue 648)
+- Improve the French translation (issue 651)
+- Registration page missed a link to password recovery that was mentioned in a form error (issue 652)
+
+# InDefero 1.1 - Sun Mar 20 11:44 2011 UTC
+
+## New Features
+
+* _Version control_:
+ - Support for the monotone Version Control system (see [[InstallationScmMonotone]])
+ - Display detailed changeset information in the commit details (git, mtn) (issue 544)
+ - Show branch in the commit details (git, mtn, hg) (issue 450)
+ - Render branch and tag names in a popup and make them filterable (git, hg, mtn) (issue 601)
+
+* _Issue tracking_:
+ - Forge-wide and per-project watch lists of starred issues (issue 589)
+ - Configure a default issue template for each project (issues 212 and 540)
+ - Pick default issue labels from the configured project settings (issue 556)
+ - Navigate to a preceding / following issue in the issue detail view
+ - Many new text syntaxes to auto-link revisions (see [[AutomaticLinks]], issue 569)
+
+* _Documentation wiki_:
+ - Automatically create a table of contents on wiki pages (issue 350)
+ - Allow the usage of text labels for Wiki text links (issue 456)
+
+* _Other_:
+ - Enhanced user profile page (issue 510)
+ - Manage multiple (commit) emails in the account settings (issues 136 and 500)
+ - Filter the timeline and its feed by item type (issue 543)
+ - Add multiple email addresses for project notifications (issue 372)
+ - Direct links to other projects via the new `Project List` dropdown
+ - InDefero gained a favicon (issue 594)
+
+## Bugfixes
+
+- Fix `Need SSH_ORIGINAL_COMMAND in environment` error for git sync (issue 198)
+- Added an option to disable lengthy project size calculation in the forge (issue 403)
+- Fix a problem when deleting an orphaned git repository (issue 467)
+- Ignore XML parsing problems when trying to retrieve commit messages for svn (issues 469 and 518)
+- Sort the project list by the display name of the project (issue 477)
+- Project creation form now has a short description field as well (issue 479)
+- Add more file extensions supported by our in-tree prettify version (issues 490 and 567)
+- Improve the parsing of hg's log output (issues 507 and 508)
+- Do not clean `<ins>` and `<del>` HTML markup from user input (issue 509)
+- Improve HTML validation by switching from `strict` to `transitional` DOCTYPE (issue 511)
+- Properly handle git commits without a changelog title (issue 520)
+- Improve BSD compatibility in shell scripts (issue 526)
+- Properly render inner whitespaces in viewed issue attachments (issue 528)
+- Support for uploading SSH keys without optional comment (issue 531)
+- Recognize irc: and git: protocols in Markdown renderer (issue 546)
+- New config option `git_core_quotepath` to handle non-ASCII git file names (issue 553)
+- Ensured that active views are rendered in the menu as such (issue 555)
+- Add CSS for nested and mixed ordered and unordered lists (issue 557)
+- Directories are now sorted before files in source tree views (issue 573)
+- File attachments now have explicit view and download links in issue views (issue 575)
+- Display anonymous access URL when user has no SSH key registered (issue 588)
+- Improve the rendering of tag lists in issue views (issue 591)
+- Improved error page when a commit or branch was not found (issue 609)
+- Disable browser autocomplete of password fields in the account settings (issue 616)
+- Improvements in the automatic linker parser (issue 618)
+- The `createIssue` API method did not check the API authentication (issue 619)
+- Reduce the memory footprint and compatibility of the internal diff parser (issues 627 and 633)
+- Print the git branches and tags in bold which contain the currently displayed revision
+
+## Documentation
+
+- Document how to contribute to Indefero in `CONTRIBUTE.mdtext` (issue 486)
+- Note possible problems with mbstring.func_overload in `INSTALL.mdtext` (issue 481)
+- Improve links to Markdown documentation (issue 489)
+- Explain purpose of `idf_strong_key_check` in `idf.php-dist` (issue 516)
+
+## Translations
+
+- Spanish translation added
+- Started with a Simplified Chinese translation (issue 521)
+- Started with a Russian translation
+- Updates and fixes to the French translation (issue 574)
+- Updates and fixes to the German translation
+- English source language has been improved (issues 441, 478, and 631)
+
+# InDefero 1.0 - Tue Apr 20 07:00 2010 UTC
+
+First stable release.
+

contrib/zipstream-php-0.2.2/COPYING

@@ -0,0 +1,20 @@
+Copyright (C) 2007-2009 Paul Duncan <pabs@pablotron.org>
+ 
+Permission is hereby granted, free of charge, to any person obtaining a
+copy of this software and associated documentation files (the
+"Software"), to deal in the Software without restriction, including
+without limitation the rights to use, copy, modify, merge, publish,
+distribute, sublicense, and/or sell copies of the Software, and to
+permit persons to whom the Software is furnished to do so, subject to
+the following conditions:
+  
+The above copyright notice and this permission notice shall be included
+in all copies or substantial portions of the of the Software.
+   
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS
+OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
+MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT.
+IN NO EVENT SHALL THE AUTHORS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING
+FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER
+DEALINGS IN THE SOFTWARE.  

contrib/zipstream-php-0.2.2/README

@@ -0,0 +1,42 @@
+ZipStream 0.2.2 README
+======================
+
+Please see the file COPYING for licensing and warranty information.  The
+latest version of this software is available at the following URL:
+
+    http://pablotron.org/software/zipstream-php/
+
+Overview
+========
+A fast and simple streaming zip file downloader for PHP.  Here's a
+simple example:
+
+    # create a new zipstream object
+    $zip = new ZipStream('example.zip');
+
+    # create a file named 'hello.txt' 
+    $zip->add_file('some_image.jpg', 'This is the contents of hello.txt');
+
+    # add a file named 'image.jpg' from a local file 'path/to/image.jpg'
+    $zip->add_file_from_path('some_image.jpg', 'path/to/image.jpg');
+
+    # finish the zip stream
+    $zip->finish();
+
+You can also add comments, modify file timestamps, and customize (or
+disable) the HTTP headers.  See the class file for details.  There are a
+couple of additional examples in the initial release announcement at the
+following URL:
+
+    http://pablotron.org/?cid=1535
+
+Requirements
+============
+
+  * PHP version 5.1.2 or newer (specifically, the hash_init and
+    hash_file functions).
+
+About the Author
+================
+Paul Duncan <pabs@pablotron.org>
+http://pablotron.org/

contrib/zipstream-php-0.2.2/extras/README

@@ -0,0 +1,2 @@
+Based on PKZIP appnotes, which are included here.
+

contrib/zipstream-php-0.2.2/test/index.php

@@ -0,0 +1,52 @@
+<?php
+
+# load zipstream class
+require '../zipstream.php';
+
+# get path to current file
+$pwd = dirname(__FILE__);
+
+# add some random files
+$files = array(
+  '../extras/zip-appnote-6.3.1-20070411.txt',
+  '../zipstream.php',
+);
+
+# create new zip stream object
+$zip = new ZipStream('test.zip', array(
+  'comment' => 'this is a zip file comment.  hello?'
+));
+
+# common file options
+$file_opt = array(
+  # file creation time (2 hours ago)
+  'time'    => time() - 2 * 3600,
+
+  # file comment
+  'comment' => 'this is a file comment. hi!',
+);
+
+# add files under folder 'asdf'
+foreach ($files as $file) {
+  # build absolute path and get file data
+  $path = ($file[0] == '/') ? $file : "$pwd/$file";
+  $data = file_get_contents($path);
+
+  # add file to archive
+  $zip->add_file('asdf/' . basename($file), $data, $file_opt);
+}
+
+# add same files again wihtout a folder
+foreach ($files as $file) {
+  # build absolute path and get file data
+  $path = ($file[0] == '/') ? $file : "$pwd/$file";
+  $data = file_get_contents($path);
+
+  # add file to archive
+  $zip->add_file(basename($file), $data, $file_opt);
+}
+
+# finish archive
+$zip->finish();
+
+?>

contrib/zipstream-php-0.2.2/zipstream.php

@@ -0,0 +1,580 @@
+<?php
+
+##########################################################################
+# ZipStream - Streamed, dynamically generated zip archives.              #
+# by Paul Duncan <pabs@pablotron.org>                                    #
+#                                                                        #
+# Copyright (C) 2007-2009 Paul Duncan <pabs@pablotron.org>               #
+#                                                                        #
+# Permission is hereby granted, free of charge, to any person obtaining  #
+# a copy of this software and associated documentation files (the        #
+# "Software"), to deal in the Software without restriction, including    #
+# without limitation the rights to use, copy, modify, merge, publish,    #
+# distribute, sublicense, and/or sell copies of the Software, and to     #
+# permit persons to whom the Software is furnished to do so, subject to  #
+# the following conditions:                                              #
+#                                                                        #
+# The above copyright notice and this permission notice shall be         #
+# included in all copies or substantial portions of the of the Software. #
+#                                                                        #
+# THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,        #
+# EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF     #
+# MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. #
+# IN NO EVENT SHALL THE AUTHORS BE LIABLE FOR ANY CLAIM, DAMAGES OR      #
+# OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE,  #
+# ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR  #
+# OTHER DEALINGS IN THE SOFTWARE.                                        #
+##########################################################################
+
+#
+# ZipStream - Streamed, dynamically generated zip archives.
+# by Paul Duncan <pabs@pablotron.org>
+#
+# Requirements:
+#
+# * PHP version 5.1.2 or newer.
+#
+# Usage:
+#
+# Streaming zip archives is a simple, three-step process:
+#
+# 1.  Create the zip stream:
+#
+#     $zip = new ZipStream('example.zip');
+#
+# 2.  Add one or more files to the archive:
+#
+#     # add first file
+#     $data = file_get_contents('some_file.gif');
+#     $zip->add_file('some_file.gif', $data);
+#
+#     # add second file
+#     $data = file_get_contents('some_file.gif');
+#     $zip->add_file('another_file.png', $data);
+#
+# 3.  Finish the zip stream:
+#
+#     $zip->finish();
+#
+# You can also add an archive comment, add comments to individual files,
+# and adjust the timestamp of files.  See the API documentation for each
+# method below for additional information.
+#
+# Example:
+#
+#   # create a new zip stream object
+#   $zip = new ZipStream('some_files.zip');
+#
+#   # list of local files
+#   $files = array('foo.txt', 'bar.jpg');
+#
+#   # read and add each file to the archive
+#   foreach ($files as $path)
+#     $zip->add_file($path, file_get_contents($path));
+# 
+#   # write archive footer to stream
+#   $zip->finish();
+#
+class ZipStream {
+  const VERSION = '0.2.2';
+
+  var $opt = array(),
+      $files = array(),
+      $cdr_ofs = 0,
+      $need_headers = false,
+      $ofs = 0; 
+
+  #
+  # Create a new ZipStream object.
+  #
+  # Parameters:
+  #
+  #   $name - Name of output file (optional).
+  #   $opt  - Hash of archive options (optional, see "Archive Options"
+  #           below).
+  #
+  # Archive Options:
+  #
+  #   comment             - Comment for this archive.
+  #   content_type        - HTTP Content-Type.  Defaults to 'application/x-zip'.
+  #   content_disposition - HTTP Content-Disposition.  Defaults to 
+  #                         'attachment; filename=\"FILENAME\"', where
+  #                         FILENAME is the specified filename.
+  #   large_file_size     - Size, in bytes, of the largest file to try
+  #                         and load into memory (used by
+  #                         add_file_from_path()).  Large files may also
+  #                         be compressed differently; see the
+  #                         'large_file_method' option.
+  #   large_file_method   - How to handle large files.  Legal values are
+  #                         'store' (the default), or 'deflate'.  Store
+  #                         sends the file raw and is significantly
+  #                         faster, while 'deflate' compresses the file
+  #                         and is much, much slower.  Note that deflate
+  #                         must compress the file twice and extremely
+  #                         slow.
+  #   send_http_headers   - Boolean indicating whether or not to send
+  #                         the HTTP headers for this file.
+  #
+  # Note that content_type and content_disposition do nothing if you are
+  # not sending HTTP headers.
+  #
+  # Large File Support:
+  #
+  # By default, the method add_file_from_path() will send send files
+  # larger than 20 megabytes along raw rather than attempting to
+  # compress them.  You can change both the maximum size and the
+  # compression behavior using the large_file_* options above, with the
+  # following caveats:
+  #
+  # * For "small" files (e.g. files smaller than large_file_size), the
+  #   memory use can be up to twice that of the actual file.  In other
+  #   words, adding a 10 megabyte file to the archive could potentially
+  #   occupty 20 megabytes of memory.
+  #
+  # * Enabling compression on large files (e.g. files larger than
+  #   large_file_size) is extremely slow, because ZipStream has to pass
+  #   over the large file once to calculate header information, and then
+  #   again to compress and send the actual data.
+  #
+  # Examples:
+  #
+  #   # create a new zip file named 'foo.zip'
+  #   $zip = new ZipStream('foo.zip');
+  #
+  #   # create a new zip file named 'bar.zip' with a comment
+  #   $zip = new ZipStream('bar.zip', array(
+  #     'comment' => 'this is a comment for the zip file.',
+  #   ));
+  #
+  # Notes:
+  #
+  # If you do not set a filename, then this library _DOES NOT_ send HTTP
+  # headers by default.  This behavior is to allow software to send its
+  # own headers (including the filename), and still use this library.
+  #
+  function __construct($name = null, $opt = array()) {
+    # save options
+    $this->opt = $opt;
+
+    # set large file defaults: size = 20 megabytes, method = store
+    if (!isset($this->opt['large_file_size']))
+      $this->opt['large_file_size'] = 20 * 1024 * 1024;
+    if (!isset($this->opt['large_file_method']))
+      $this->opt['large_file_method'] = 'store';
+
+    $this->output_name = $name;
+    if ($name || (isset($opt['send_http_headers']) 
+        && $opt['send_http_headers']))
+      $this->need_headers = true; 
+  }
+
+  #
+  # add_file - add a file to the archive
+  #
+  # Parameters:
+  #   
+  #  $name - path of file in archive (including directory).
+  #  $data - contents of file
+  #  $opt  - Hash of options for file (optional, see "File Options"
+  #          below).  
+  #
+  # File Options: 
+  #  time     - Last-modified timestamp (seconds since the epoch) of
+  #             this file.  Defaults to the current time.
+  #  comment  - Comment related to this file.
+  #
+  # Examples:
+  #
+  #   # add a file named 'foo.txt'
+  #   $data = file_get_contents('foo.txt');
+  #   $zip->add_file('foo.txt', $data);
+  # 
+  #   # add a file named 'bar.jpg' with a comment and a last-modified
+  #   # time of two hours ago
+  #   $data = file_get_contents('bar.jpg');
+  #   $zip->add_file('bar.jpg', $data, array(
+  #     'time'    => time() - 2 * 3600,
+  #     'comment' => 'this is a comment about bar.jpg',
+  #   ));
+  # 
+  function add_file($name, $data, $opt = array()) {
+    # compress data
+    $zdata = gzdeflate($data);
+
+    # calculate header attributes
+    $crc  = crc32($data);
+    $zlen = strlen($zdata);
+    $len  = strlen($data);
+    $meth = 0x08;
+
+    # send file header
+    $this->add_file_header($name, $opt, $meth, $crc, $zlen, $len);
+
+    # print data
+    $this->send($zdata);
+  }
+
+  #
+  # add_file_from_path - add a file at path to the archive.
+  #
+  # Note that large files may be compresed differently than smaller
+  # files; see the "Large File Support" section above for more
+  # information.
+  #
+  # Parameters:
+  #   
+  #  $name - name of file in archive (including directory path).
+  #  $path - path to file on disk (note: paths should be encoded using
+  #          UNIX-style forward slashes -- e.g '/path/to/some/file').
+  #  $opt  - Hash of options for file (optional, see "File Options"
+  #          below).  
+  #
+  # File Options: 
+  #  time     - Last-modified timestamp (seconds since the epoch) of
+  #             this file.  Defaults to the current time.
+  #  comment  - Comment related to this file.
+  #
+  # Examples:
+  #
+  #   # add a file named 'foo.txt' from the local file '/tmp/foo.txt'
+  #   $zip->add_file_from_path('foo.txt', '/tmp/foo.txt');
+  # 
+  #   # add a file named 'bigfile.rar' from the local file
+  #   # '/usr/share/bigfile.rar' with a comment and a last-modified
+  #   # time of two hours ago
+  #   $path = '/usr/share/bigfile.rar';
+  #   $zip->add_file_from_path('bigfile.rar', $path, array(
+  #     'time'    => time() - 2 * 3600,
+  #     'comment' => 'this is a comment about bar.jpg',
+  #   ));
+  # 
+  function add_file_from_path($name, $path, $opt = array()) {
+    if ($this->is_large_file($path)) {
+      # file is too large to be read into memory; add progressively
+      $this->add_large_file($name, $path, $opt);
+    } else {
+      # file is small enough to read into memory; read file contents and
+      # handle with add_file()
+      $data = file_get_contents($path);
+      $this->add_file($name, $data, $opt);
+    }
+  }
+
+  #
+  # finish - Write zip footer to stream.
+  #
+  # Example:
+  #
+  #   # add a list of files to the archive
+  #   $files = array('foo.txt', 'bar.jpg');
+  #   foreach ($files as $path)
+  #     $zip->add_file($path, file_get_contents($path));
+  # 
+  #   # write footer to stream
+  #   $zip->finish();
+  # 
+  function finish() {
+    # add trailing cdr record
+    $this->add_cdr($this->opt);
+    $this->clear();
+  }
+
+  ###################
+  # PRIVATE METHODS #
+  ###################
+
+  #
+  # Create and send zip header for this file.
+  #
+  private function add_file_header($name, $opt, $meth, $crc, $zlen, $len) {
+    # strip leading slashes from file name
+    # (fixes bug in windows archive viewer)
+    $name = preg_replace('/^\\/+/', '', $name);
+
+    # calculate name length
+    $nlen = strlen($name);
+
+    # create dos timestamp
+    $opt['time'] = isset($opt['time']) ? $opt['time'] : time();
+    $dts = $this->dostime($opt['time']);
+
+    # build file header
+    $fields = array(            # (from V.A of APPNOTE.TXT)
+      array('V', 0x04034b50),     # local file header signature
+      array('v', (6 << 8) + 3),   # version needed to extract
+      array('v', 0x00),           # general purpose bit flag
+      array('v', $meth),          # compresion method (deflate or store)
+      array('V', $dts),           # dos timestamp
+      array('V', $crc),           # crc32 of data
+      array('V', $zlen),          # compressed data length
+      array('V', $len),           # uncompressed data length
+      array('v', $nlen),          # filename length
+      array('v', 0),              # extra data len
+    );
+
+    # pack fields and calculate "total" length
+    $ret = $this->pack_fields($fields);
+    $cdr_len = strlen($ret) + $nlen + $zlen;
+
+    # print header and filename
+    $this->send($ret . $name);
+
+    # add to central directory record and increment offset
+    $this->add_to_cdr($name, $opt, $meth, $crc, $zlen, $len, $cdr_len);
+  }
+
+  #
+  # Add a large file from the given path.
+  #
+  private function add_large_file($name, $path, $opt = array()) {
+    $st = stat($path);
+    $block_size = 1048576; # process in 1 megabyte chunks
+    $algo = 'crc32b';
+
+    # calculate header attributes
+    $zlen = $len = $st['size'];
+
+    $meth_str = $this->opt['large_file_method'];
+    if ($meth_str == 'store') {
+      # store method
+      $meth = 0x00;
+      $crc  = unpack('V', hash_file($algo, $path, true));
+      $crc = $crc[1];
+    } elseif ($meth_str == 'deflate') {
+      # deflate method
+      $meth = 0x08;
+
+      # open file, calculate crc and compressed file length
+      $fh = fopen($path, 'rb');
+      $hash_ctx = hash_init($algo);
+      $zlen = 0;
+
+      # read each block, update crc and zlen
+      while ($data = fgets($fh, $block_size)) {
+        hash_update($hash_ctx, $data);
+        $data = gzdeflate($data);
+        $zlen += strlen($data);
+      }
+
+      # close file and finalize crc
+      fclose($fh);
+      $crc = unpack('V', hash_final($hash_ctx, true));
+      $crc = $crc[1];
+    } else {
+      die("unknown large_file_method: $meth_str");
+    }
+
+    # send file header
+    $this->add_file_header($name, $opt, $meth, $crc, $zlen, $len);
+
+    # open input file
+    $fh = fopen($path, 'rb');
+
+    # send file blocks
+    while ($data = fgets($fh, $block_size)) {
+      if ($meth_str == 'deflate') 
+        $data = gzdeflate($data);
+
+      # send data
+      $this->send($data);
+    }
+
+    # close input file
+    fclose($fh);
+  }
+
+  #
+  # Is this file larger than large_file_size?
+  #
+  function is_large_file($path) {
+    $st = stat($path);
+    return ($this->opt['large_file_size'] > 0) && 
+           ($st['size'] > $this->opt['large_file_size']);
+  }
+
+  #
+  # Save file attributes for trailing CDR record.
+  #
+  private function add_to_cdr($name, $opt, $meth, $crc, $zlen, $len, $rec_len) {
+    $this->files[] = array($name, $opt, $meth, $crc, $zlen, $len, $this->ofs);
+    $this->ofs += $rec_len;
+  }
+
+  #
+  # Send CDR record for specified file.
+  #
+  private function add_cdr_file($args) {
+    list ($name, $opt, $meth, $crc, $zlen, $len, $ofs) = $args;
+
+    # get attributes
+    $comment = isset($opt['comment']) ? $opt['comment'] : '';
+
+    # get dos timestamp
+    $dts = $this->dostime($opt['time']);
+
+    $fields = array(                  # (from V,F of APPNOTE.TXT)
+      array('V', 0x02014b50),           # central file header signature
+      array('v', (6 << 8) + 3),         # version made by
+      array('v', (6 << 8) + 3),         # version needed to extract
+      array('v', 0x00),                 # general purpose bit flag
+      array('v', $meth),                # compresion method (deflate or store)
+      array('V', $dts),                 # dos timestamp
+      array('V', $crc),                 # crc32 of data
+      array('V', $zlen),                # compressed data length
+      array('V', $len),                 # uncompressed data length
+      array('v', strlen($name)),        # filename length
+      array('v', 0),                    # extra data len
+      array('v', strlen($comment)),     # file comment length
+      array('v', 0),                    # disk number start
+      array('v', 0),                    # internal file attributes
+      array('V', 32),                   # external file attributes
+      array('V', $ofs),                 # relative offset of local header
+    );
+
+    # pack fields, then append name and comment
+    $ret = $this->pack_fields($fields) . $name . $comment;
+
+    $this->send($ret);
+
+    # increment cdr offset
+    $this->cdr_ofs += strlen($ret);
+  }
+
+  #
+  # Send CDR EOF (Central Directory Record End-of-File) record.
+  #
+  private function add_cdr_eof($opt = null) {
+    $num = count($this->files);
+    $cdr_len = $this->cdr_ofs;
+    $cdr_ofs = $this->ofs;
+
+    # grab comment (if specified)
+    $comment = '';
+    if ($opt && isset($opt['comment']))
+      $comment = $opt['comment'];
+
+    $fields = array(                # (from V,F of APPNOTE.TXT)
+      array('V', 0x06054b50),         # end of central file header signature
+      array('v', 0x00),               # this disk number
+      array('v', 0x00),               # number of disk with cdr
+      array('v', $num),               # number of entries in the cdr on this disk
+      array('v', $num),               # number of entries in the cdr
+      array('V', $cdr_len),           # cdr size
+      array('V', $cdr_ofs),           # cdr ofs
+      array('v', strlen($comment)),   # zip file comment length
+    );
+
+    $ret = $this->pack_fields($fields) . $comment;
+    $this->send($ret);
+  }
+
+  #
+  # Add CDR (Central Directory Record) footer.
+  #
+  private function add_cdr($opt = null) {
+    foreach ($this->files as $file)
+      $this->add_cdr_file($file);
+    $this->add_cdr_eof($opt);
+  }
+
+  #
+  # Clear all internal variables.  Note that the stream object is not
+  # usable after this.
+  #
+  function clear() {
+    $this->files = array();
+    $this->ofs = 0;
+    $this->cdr_ofs = 0;
+    $this->opt = array();
+  }
+
+  ###########################
+  # PRIVATE UTILITY METHODS #
+  ###########################
+
+  #
+  # Send HTTP headers for this stream.
+  #
+  private function send_http_headers() {
+    # grab options
+    $opt = $this->opt;
+    
+    # grab content type from options
+    $content_type = 'application/x-zip';
+    if (isset($opt['content_type']))
+      $content_type = $this->opt['content_type'];
+
+    # grab content disposition 
+    $disposition = 'attachment';
+    if (isset($opt['content_disposition']))
+      $disposition = $opt['content_disposition'];
+
+    if ($this->output_name) 
+      $disposition .= "; filename=\"{$this->output_name}\"";
+
+    $headers = array(
+      'Content-Type'              => $content_type,
+      'Content-Disposition'       => $disposition,
+      'Pragma'                    => 'public',
+      'Cache-Control'             => 'public, must-revalidate',
+      'Content-Transfer-Encoding' => 'binary',
+    );
+
+    foreach ($headers as $key => $val)
+      header("$key: $val");
+  }
+
+  #
+  # Send string, sending HTTP headers if necessary.
+  #
+  private function send($str) {
+    if ($this->need_headers)
+      $this->send_http_headers();
+    $this->need_headers = false;
+
+    echo $str;
+  }
+
+  #
+  # Convert a UNIX timestamp to a DOS timestamp.
+  #
+  function dostime($when = 0) {
+    # get date array for timestamp
+    $d = getdate($when);
+
+    # set lower-bound on dates
+    if ($d['year'] < 1980) {
+      $d = array('year' => 1980, 'mon' => 1, 'mday' => 1, 
+                 'hours' => 0, 'minutes' => 0, 'seconds' => 0);
+    }
+
+    # remove extra years from 1980
+    $d['year'] -= 1980;
+
+    # return date string
+    return ($d['year'] << 25) | ($d['mon'] << 21) | ($d['mday'] << 16) |
+           ($d['hours'] << 11) | ($d['minutes'] << 5) | ($d['seconds'] >> 1);
+  }
+
+  #
+  # Create a format string and argument list for pack(), then call
+  # pack() and return the result.
+  #
+  function pack_fields($fields) {
+    list ($fmt, $args) = array('', array());
+
+    # populate format string and argument list
+    foreach ($fields as $field) {
+      $fmt .= $field[0];
+      $args[] = $field[1];
+    }
+
+    # prepend format string to argument list
+    array_unshift($args, $fmt);
+
+    # build output string from header and compressed data
+    return call_user_func_array('pack', $args);
+  }
+};
+
+?>

doc/syncmonotone.mdtext

@@ -0,0 +1,272 @@
+# Plugin SyncMonotone by Thomas Keller (me@thomaskeller.biz)
+
+The SyncMonotone plugin allow the direct creation and synchronisation of
+monotone repositories with the InDefero database. It has been built to
+work together with monotone's "super server" usher, which is used to control
+several repositories at once, acts as proxy and single entrance.
+
+## Prerequisites
+
+* a unixoid operating system
+* monotone >= 0.99.1
+* for a proxy setup with usher:
+    * boost headers (for usher compilation)
+    * a current version of usher
+    * a daemonizer, like supervise
+
+## Installation of monotone
+
+If you install monotone from a distribution package, ensure you do not
+install and / or activate the server component. We just need a plain
+client installation which usually consists only of the `mtn` binary and
+a few docs.
+
+If you install monotone from source (<http://monotone.ca/downloads.php>),
+please follow the `INSTALL` document which comes with the software.
+It contains detailed instructions, including all needed dependencies.
+
+## Choose your indefero setup
+
+The monotone plugin can be used in several different ways:
+
+1. One database for everything. This is the easiest setup and of possible
+   use in case you do not want indefero to manage the access to your project.
+   Your `idf.php` should look like this:
+
+            $ cat idf.php
+            ...
+            $cfg['mtn_path'] = 'mtn';
+            $cfg['mtn_opts'] = array('--no-workspace', '--no-standard-rcfiles');
+            $cfg['mtn_repositories'] = '/home/monotone/all_projects.mtn';
+            $cfg['mtn_remote_url'] = 'ssh://monotone@my.server.com:~all_projects.mtn';
+            $cfg['mtn_db_access'] = 'local';
+            ...
+
+   Pro:
+      * easy to setup and to manage
+
+   Con:
+      * you need to give committers SSH access to your machine
+      * database lock problem: the database from which
+        indefero reads its data might be locked in case a user
+        syncs at the very moment via SSH
+
+2. One database for every project. Similar to the above setup, but this
+   time you use the '%s' placeholder which is replaced with the short name
+   of the indefero project:
+
+            $ cat idf.php
+            ...
+            $cfg['mtn_path'] = 'mtn';
+            $cfg['mtn_opts'] = array('--no-workspace', '--no-standard-rcfiles');
+            $cfg['mtn_repositories'] = '/home/monotone/%s.mtn';
+            $cfg['mtn_remote_url'] = 'ssh://monotone@my.server.com:~%s.mtn';
+            $cfg['mtn_db_access'] = 'local';
+            ...
+
+   The same pro's and con's apply. Additionally you have to be careful about
+   not giving people physical read/write access of another project's database.
+
+   Furthermore, if you do not want to use `ssh`, but `netsync` transport,
+   each project's database must be served over a separate port.
+
+3. One database for every project, all managed with usher. This is the
+   recommended setup for a mid-size forge setup. The remaining part of this
+   document will describe the process to set this up in detail.
+
+   Pro:
+      * access rights can be granted per project and are automatically
+        managed by indefero, just like the user's public monotone keys
+      * no database locking issues
+      * one public server running on the one well-known port
+
+   Con:
+      * harder to setup
+
+## Installation and configuration of usher
+
+1. Clone usher's monotone repository:
+
+            $ mtn clone "mtn://monotone.ca?net.venge.monotone.contrib.usher"
+
+2. Compile usher:
+
+            $ autoreconf -i
+            $ ./configure && make
+            $ sudo make install
+
+   This installs the usher binary in $prefix/bin.
+
+3. Create a new usher user:
+
+            $ adduser --system --disabled-login --home /var/lib/usher usher
+
+4. Create the basic usher setup:
+
+            $ cd /var/lib/usher
+            $ mkdir projects logs
+            $ cat > usher.conf
+             userpass "admin" "<secret-password>"
+            adminaddr "127.0.0.1:12345"
+               logdir "log"
+            ^D
+            $ chmod 600 usher.conf
+
+    Your indefero www user needs later write access to `usher.conf` and
+    `projects/`. There are two ways of setting this up:
+
+    * Make the usher user the web user, for example via Apache's `suexec`
+    * Use acls, like this:
+
+            $ setfacl -m u:www:rw usher.conf
+            $ setfacl -m d:u:www:rwx projects/
+
+5. Wrap a daemonizer around usher, for example supervise from daemontools
+   (<http://cr.yp.to/damontools.html>):
+
+            $ cat > run
+            #!/bin/sh
+            cd /var/lib/usher
+            exec 2>&1
+            exec \
+                setuidgid usher \
+                usher usher.conf
+            ^D
+
+   The service can now be started through supervise:
+
+            $ supervise /var/lib/usher
+
+## Configuration of indefero
+
+Based on the above setup, the configuration in `src/IDF/conf/idf.php` should
+look like this:
+
+        $ cat idf.php
+        ...
+        $cfg['mtn_path'] = 'mtn';
+        $cfg['mtn_opts'] = array('--no-workspace', '--no-standard-rcfiles');
+        $cfg['mtn_repositories'] = '/var/lib/usher/projects/%s/';
+        $cfg['mtn_remote_url'] = 'mtn://my.server.com/%s';
+        $cfg['mtn_db_access'] = 'remote';
+        $cfg['mtn_usher_conf'] = '/var/lib/usher/usher.conf';
+        ...
+
+The `%s` placeholders are automatically replaced by the name of the
+indefero project. The plugin assumes that every project is separated
+by a distinct server name in the monotone URL (hence the use of `/%s`),
+so if a user calls
+
+        $ mtn sync mtn://my.server.com/project1
+
+then the database / repository of the indefero `project1` is used.
+Note that 'mtn_remote_url' is also used as internal URI to query the data
+for indefero's source view, so it *must* be a valid host!
+
+Usher also allows the identification of a project repository by hostname,
+which would allow an URL template like `mtn://%s.my.server.com`, however
+the plugin does not write out the configuration which is needed for this
+yet.
+
+For even more advanced setups, usher can also be used to forward sync
+requests to other remote servers for load balancing, please consult the
+README file for more information.
+
+## Security and remote access
+
+Indefero distinguishs between public and private projects and so does
+the monotone plugin.
+
+Public projects can be pulled by everybody and pushed by team members
+or additional invited people. Remote command execution is enabled, but
+only for read-only commands.
+
+Remote commands can be helpful for a user or a 3rd party tool (like
+[mtn-browse](http://mtn-browse.sourceforge.net) or
+[guitone](http://guitone.thomaskeller.biz)) to browse the database
+contents remotely without having to pull everything in first instance.
+
+Private projects on the other hand can only be synced by team members
+or additional invited people. Remote command execution is disabled
+by default. If you want to enable that, simply put the keys of the users
+you want to give access to in your project's `remote-automate-permissions`
+file. In the future this plugin might handle this file just as it handles
+`read-permissions` and `write-permissions`.
+
+## Notifications
+
+If you have successfully set up your monotone instance, you probably want
+to notify 3rd party systems for incoming changes or simply mirror them
+somewhere else for backup purposes.  The monotone source tree already comes
+with [many example scripts and hooks](http://code.monotone.ca/p/monotone/source/tree/h:net.venge.monotone/contrib)
+which serve these purposes, after only little additional configuration.
+
+The usher/indefero-controlled setup automatically looks for *.lua files
+in a directory called `hooks.d` right under the project's base directory
+(configured via $cfg['mtn_repositories']) and this is the ideal place to
+put or link these additional lua sources.
+
+## Custom project configurations and templates
+
+If a new project is created in IDF, the SyncMonotone plugin creates a new
+configuration tree for the project into the project's configuration directory,
+determined by `$cfg['mtn_repositories']`. IDF ships with the minimum set of
+files for this configuration tree and sets up everything automatically for you.
+
+Even more, most of the configuration files from the newly created tree are only
+symlinked to the original configuration directory which is configurable via
+`$cfg['mtn_confdir']` and defaults to `src/IDF/Plugin/SyncMonotone/`. This has
+the advantage that your standard IDF setup automatically receives updates to
+existing (symlinked) configuration files as soon as you update to a newer
+version.
+
+You could, however, also choose to place the directory tree somewhere else
+and adapt the contents of the individual files yourself, so these changes get
+automatically applied to all new projects you create. You could even go so far
+and add new files to the tree and let them be processed automatically just
+as the basic files! All you need to do is to copy your files and / or directories
+underknees your `$cfg['mtn_confdir']` and add their relative paths to
+`$cfg['mtn_confdir_extra']`.
+
+By convention, all entries which end with a slash are considered directories,
+so mkdir(1) is issued for these entries, all files which do not end up with
+".in" are considered to be static script files which are just symlinked from
+the basic configuration dir and all entries ending on ".in" are considered
+configuration files or templates, which are copied over to the project's
+configuration tree and which get some basic project-specific values replaced.
+
+The following placeholders are currently recognized and replaced for these files:
+
+ * %%PROJECT%% - the name of the created project
+ * %%MTNPOSTPUSH%% - the absolute path to the `mtn-post-push` script
+ * %%MTNCLIENTKEY%% - the public key hash of the key which is used by IDF
+   to authenticate remote stdio access
+
+Thats it - I hope you find it useful :)
+
+## Q&A
+
+### After I created a new project, IDF throws an exception and tells me that it couldn't save the membership data with a cryptic error message. Whats wrong?
+
+Multiple issues could cause that. If you've set up usher, make sure the usher
+can fork your database at all and look out for specific errors in the log file
+of your project. If you stumble upon permission issues, ensure that the user
+who runs the usher can access all files in your project's configuration directory,
+including symlinked files.
+
+### I pushed a branch to my server, but it does not show up in IDF. Whats wrong?
+
+Check if the heads of your branch are not suspended, i.e. do not carry a
+`suspend` certificate.  This usually hides the branch and all of its history
+from monotone's eyes and therefor also from indefero.  You can either choose
+to "unsuspend" the branch simply by committing and pushing another head or
+by letting monotone ignore all suspend certs.  For the latter, its usually
+enough to add `--ignore-suspend-certs` to the list of options in `$cfg['mtn_opts']`.
+
+### I want to display another default branch when I click the "Source" tab. How can I do that?
+
+Let the forge admin know the new master branch for your project.  He is able
+to change that quickly.  Depending on the backend / server setup this might
+also require some changes in the usher configuration, but only if usher
+recognizes and proxies your database on a branch name level.
+

doc/syncsvn.mdtext

@@ -79,3 +79,12 @@ the following configuration variables:
 * **idf_plugin_syncsvn_access_public ('r')**: Anonymous access.
 * **idf_plugin_syncsvn_access_private ('')**: Anonymous access in the case of a private project.
 
+## svn: Can't open file '/root/.subversion/servers': Permission denied error
+
+If you get the error:
+
+    svn: Can't open file '/root/.subversion/servers': Permission denied
+
+Check the [fix available](http://projects.ceondo.com/p/indefero/issues/458/)
+
+

logo/indefero-logo-lite.svg

@@ -0,0 +1,86 @@
+<?xml version="1.0" encoding="UTF-8" standalone="no"?>
+<!-- Created with Inkscape (http://www.inkscape.org/) -->
+
+<svg
+   xmlns:dc="http://purl.org/dc/elements/1.1/"
+   xmlns:cc="http://creativecommons.org/ns#"
+   xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
+   xmlns:svg="http://www.w3.org/2000/svg"
+   xmlns="http://www.w3.org/2000/svg"
+   xmlns:sodipodi="http://sodipodi.sourceforge.net/DTD/sodipodi-0.dtd"
+   xmlns:inkscape="http://www.inkscape.org/namespaces/inkscape"
+   width="16"
+   height="16"
+   id="svg2"
+   sodipodi:version="0.32"
+   inkscape:version="0.48.0 r9654"
+   version="1.0"
+   sodipodi:docname="indefero-logo-lite.svg"
+   inkscape:output_extension="org.inkscape.output.svg.inkscape">
+  <defs
+     id="defs4">
+    <inkscape:perspective
+       sodipodi:type="inkscape:persp3d"
+       inkscape:vp_x="0 : 526.18109 : 1"
+       inkscape:vp_y="0 : 1000 : 0"
+       inkscape:vp_z="744.09448 : 526.18109 : 1"
+       inkscape:persp3d-origin="372.04724 : 350.78739 : 1"
+       id="perspective10" />
+  </defs>
+  <sodipodi:namedview
+     id="base"
+     pagecolor="#ffffff"
+     bordercolor="#666666"
+     borderopacity="1.0"
+     gridtolerance="10000"
+     guidetolerance="10"
+     objecttolerance="10"
+     inkscape:pageopacity="0.0"
+     inkscape:pageshadow="2"
+     inkscape:zoom="11.313708"
+     inkscape:cx="31.568929"
+     inkscape:cy="-0.35578703"
+     inkscape:document-units="px"
+     inkscape:current-layer="layer1"
+     showgrid="false"
+     inkscape:window-width="1280"
+     inkscape:window-height="723"
+     inkscape:window-x="0"
+     inkscape:window-y="24"
+     inkscape:window-maximized="1" />
+  <metadata
+     id="metadata7">
+    <rdf:RDF>
+      <cc:Work
+         rdf:about="">
+        <dc:format>image/svg+xml</dc:format>
+        <dc:type
+           rdf:resource="http://purl.org/dc/dcmitype/StillImage" />
+      </cc:Work>
+    </rdf:RDF>
+  </metadata>
+  <g
+     inkscape:label="Layer 1"
+     inkscape:groupmode="layer"
+     id="layer1"
+     transform="translate(0,-728.09451)">
+    <g
+       id="g2401"
+       transform="matrix(0.13580542,0,0,0.13580542,-47.580342,708.10521)"
+       style="fill:#8ae234;stroke:#4e9a06;stroke-width:2.4000001;stroke-miterlimit:4;stroke-dasharray:none"
+       inkscape:export-filename="/home/loa/Projects/indefero/logo/powered-by-indefero.png"
+       inkscape:export-xdpi="12.330909"
+       inkscape:export-ydpi="12.330909">
+      <path
+         id="path2383"
+         d="m 396.19089,173.14471 c -7.67621,0.80661 -14.40195,5.39406 -19.58101,10.89131 -7.23597,7.88004 -11.69742,18.07908 -13.32198,28.60362 -1.7236,11.28173 -0.25925,23.20635 5.07686,33.37271 3.78607,7.24384 9.53161,13.92339 17.29701,16.96772 3.86478,1.53937 8.98362,1.03284 11.67912,-2.41036 2.64357,-3.5671 2.69463,-8.234 2.85756,-12.48867 0.045,-7.61054 -0.54749,-15.25544 0.45618,-22.83193 0.87131,-9.50623 4.03944,-18.56751 6.71612,-27.66851 1.16242,-4.44333 2.25094,-9.02808 1.97499,-13.64988 -0.48817,-4.62476 -3.58059,-9.31042 -8.2964,-10.4067 -1.57489,-0.44882 -3.23412,-0.48948 -4.85845,-0.37931 z"
+         style="fill:#8ae234;fill-opacity:1;fill-rule:nonzero;stroke:#4e9a06;stroke-width:2.4000001;stroke-linecap:round;stroke-linejoin:miter;stroke-miterlimit:4;stroke-opacity:1;stroke-dasharray:none;stroke-dashoffset:0"
+         inkscape:connector-curvature="0" />
+      <path
+         id="path2391"
+         d="m 433.14691,149.28687 c 7.2059,2.76589 12.51512,8.93778 16.09494,15.58815 4.94991,9.48434 6.61962,20.49058 5.46486,31.07695 -1.25505,11.34342 -5.75582,22.48271 -13.54134,30.92159 -5.53192,6.01709 -12.81048,10.98198 -21.09918,11.91276 -4.13154,0.4866 -8.94486,-1.32748 -10.65734,-5.35104 -1.63027,-4.12976 -0.4717,-8.65084 0.47212,-12.80269 1.92628,-7.36287 4.47721,-14.59393 5.4687,-22.17201 1.61875,-9.40784 0.90381,-18.98034 0.67386,-28.46402 0.0272,-4.59278 0.1624,-9.30303 1.62515,-13.69592 1.66851,-4.34082 5.86829,-8.06645 10.70716,-7.90484 1.63738,-0.0259 3.25061,0.36424 4.79107,0.89107 z"
+         style="fill:#8ae234;fill-opacity:1;fill-rule:nonzero;stroke:#4e9a06;stroke-width:2.4000001;stroke-linecap:round;stroke-linejoin:miter;stroke-miterlimit:4;stroke-opacity:1;stroke-dasharray:none;stroke-dashoffset:0"
+         inkscape:connector-curvature="0" />
+    </g>
+  </g>
+</svg>

phpunit.xml

@@ -0,0 +1,15 @@
+<phpunit backupGlobals="true"
+         backupStaticAttributes="false"
+         bootstrap="test/bootstrap.php"
+         convertErrorsToExceptions="true"
+         convertNoticesToExceptions="true"
+         convertWarningsToExceptions="true"
+         strict="false"
+         verbose="true">
+
+    <testsuites>
+        <testsuite name="Everything">
+            <directory>test/IDF/</directory>
+        </testsuite>
+    </testsuites>
+</phpunit>

release-script

@@ -1,8 +1,11 @@
 #!/bin/sh
 last="$1"
 new="$2"
+PLUF_PATH=`php -r "require_once('./IDF/conf/path.php'); echo PLUF_PATH;"`
+echo "php $PLUF_PATH/extracttemplates.php ./IDF/conf/idf.php ./IDF/gettexttemplates"
 echo "xgettext -o idf.pot -p ./IDF/locale --force-po --from-code=UTF-8 --keyword --keyword=__ --keyword=_n:1,2 -L PHP ./IDF/*.php"
 echo "find ./ -iname \"*.php\" -exec xgettext -o idf.pot -p ./IDF/locale/ --from-code=UTF-8 -j --keyword --keyword=__ --keyword=_n:1,2 -L PHP {} \;"
+echo 'for pofile in `ls ./IDF/locale/*/idf.po`; do msgmerge -U $pofile ./IDF/locale/idf.pot; done'
 echo "# git tag v$new"
 echo "git archive --format=zip --prefix=indefero-$new/ v$new > indefero-$new.zip"
 echo "git log --no-merges v$new ^v$last > ChangeLog-$new"

scripts/git-post-update

@@ -17,8 +17,8 @@
 # git$ ln -s /home/www/indefero/scripts/git-post-update post-update
 #
 
-SCRIPTDIR=$(dirname $(readlink -f $0))
-FULL_GIT_DIR=$(readlink -f $GIT_DIR)
+SCRIPTDIR=$(dirname $(readlink $0))
+FULL_GIT_DIR=$(cd "$GIT_DIR" && /bin/pwd || "$GIT_DIR")
 PHP_POST_UPDATE=$SCRIPTDIR/gitpostupdate.php
 
 echo php $PHP_POST_UPDATE $FULL_GIT_DIR | at now > /dev/null 2>&1

scripts/gitpostupdate.php

@@ -53,6 +53,7 @@ Pluf_Dispatcher::loadControllers(Pluf::f('idf_views'));
  */
 $params = array('git_dir' => $argv[1],
                 'env' => array_merge($_ENV, $_SERVER));
+Pluf_Log::event(array('gitpostupdate.php', 'Send run signal.', $params));
 Pluf_Signal::send('gitpostupdate.php::run', 'gitpostupdate.php', $params);
 
 

scripts/gitserve.py

@@ -23,14 +23,17 @@
 
 import os
 import sys
-import commands
-import traceback
+import subprocess
+
+SCRIPTDIR = os.path.abspath(__file__).rsplit(os.path.sep, 1)[0]
+GITSERVEPHP = '%s/gitserve.php' % SCRIPTDIR
+process = subprocess.Popen(['php', GITSERVEPHP, sys.argv[1]],
+                stdout=subprocess.PIPE, stderr=subprocess.PIPE)
+output = str.encode("\n").join(process.communicate()).strip()
+status = process.wait()
 
-n = len("/gitserve.py")
-GITSERVEPHP = '%s/gitserve.php' % traceback.extract_stack(limit=1)[0][0][0:-n]
-status, output = commands.getstatusoutput('php %s %s' % (GITSERVEPHP, sys.argv[1]))
 if status == 0:
     os.execvp('git', ['git', 'shell', '-c', output.strip()])
 else:
-    sys.stderr.write("%s\n" % output)
+    sys.stderr.write("%s\n" % output.strip())
 sys.exit(1)

scripts/mtn-post-push

@@ -0,0 +1,22 @@
+#!/bin/sh
+#
+# This hook informs IDF that new revisions arrived in the database
+# of the specified project.
+#
+# This hook is normally installed automatically at the creation of your
+# repository if you have everything configured correctly. If you want
+# to enable it later, you need to call it into your monotonerc file
+# from the hook "note_netsync_end". (See chapter "Event Notifications
+# and Triggers" on <http://monotone.ca/docs/Hooks.html#Hooks>.)
+#
+
+dir=$(dirname "$0")
+res=$(cd "$dir" && /bin/pwd || "$dir")
+SCRIPTDIR="$res/$(readlink $0)"
+PHP_POST_PUSH=$SCRIPTDIR/mtnpostpush.php
+
+TMPFILE=$(mktemp /tmp/mtn-post-push.XXXXXX) || exit 1
+while read rev; do echo $rev >> $TMPFILE; done
+
+echo php $PHP_POST_PUSH "$1" \< $TMPFILE \&\& rm -f $TMPFILE |\
+    at now > /dev/null 2>&1

scripts/mtnpostpush.php

@@ -0,0 +1,63 @@
+<?php
+/* -*- tab-width: 4; indent-tabs-mode: nil; c-basic-offset: 4 -*- */
+/*
+# ***** BEGIN LICENSE BLOCK *****
+# This file is part of InDefero, an open source project management application.
+# Copyright (C) 2008-2010 Céondo Ltd and contributors.
+#
+# InDefero is free software; you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation; either version 2 of the License, or
+# (at your option) any later version.
+#
+# InDefero is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write to the Free Software
+# Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA  02110-1301  USA
+#
+# ***** END LICENSE BLOCK ***** */
+
+/**
+ * This script will send the notifications after a push in your 
+ * repository.
+ */
+
+require dirname(__FILE__).'/../src/IDF/conf/path.php';
+require 'Pluf.php';
+Pluf::start(dirname(__FILE__).'/../src/IDF/conf/idf.php');
+Pluf_Dispatcher::loadControllers(Pluf::f('idf_views'));
+
+/**
+ * [signal]
+ *
+ * mtnpostpush.php::run
+ *
+ * [sender]
+ *
+ * mtnpostpush.php
+ *
+ * [description]
+ *
+ * This signal allows an application to perform a set of tasks
+ * after a push to a monotone repository.
+ *
+ * [parameters]
+ *
+ * array('project' => 'name-of-the-project',
+ *       'revisions' => array('123abc...', '456def...', ...));
+ *
+ */
+
+fwrite(STDERR, "waiting for revisions on STDIN...\n");
+$stdin = file_get_contents('php://stdin');
+
+$params = array('project' => $argv[1],
+                'revisions' => explode("\n", chop($stdin)));
+Pluf_Signal::send('mtnpostpush.php::run', 'mtnpostpush.php', $params);
+
+
+

scripts/queuecron.php

@@ -0,0 +1,69 @@
+<?php
+/* -*- tab-width: 4; indent-tabs-mode: nil; c-basic-offset: 4 -*- */
+/*
+# ***** BEGIN LICENSE BLOCK *****
+# This file is part of InDefero, an open source project management application.
+# Copyright (C) 2008 Céondo Ltd and contributors.
+#
+# InDefero is free software; you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation; either version 2 of the License, or
+# (at your option) any later version.
+#
+# InDefero is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write to the Free Software
+# Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA  02110-1301  USA
+#
+# ***** END LICENSE BLOCK ***** */
+
+/**
+ * This script process the queue of items.
+ *
+ * At the moment the queue is only used for the webhooks, but it would
+ * be good in the future to use it for indexing and email
+ * notifications.
+ *
+ */
+
+require dirname(__FILE__).'/../src/IDF/conf/path.php';
+require 'Pluf.php';
+Pluf::start(dirname(__FILE__).'/../src/IDF/conf/idf.php');
+Pluf_Dispatcher::loadControllers(Pluf::f('idf_views'));
+
+#;*/ ::
+$lock_file = Pluf::f('idf_queuecron_lock', 
+                     Pluf::f('tmp_folder', '/tmp').'/queuecron.lock');
+if (file_exists($lock_file)) {
+    Pluf_Log::event(array('queuecron.php', 'skip'));
+    return;
+}
+file_put_contents($lock_file, time(), LOCK_EX);
+
+/**
+ * [signal]
+ *
+ * queuecron.php::run
+ *
+ * [sender]
+ *
+ * queuecron.php
+ *
+ * [description]
+ *
+ * This signal allows an application to perform a set of tasks when
+ * the queue cron job is run. This is done usually every 5 minutes.
+ *
+ * [parameters]
+ *
+ * array()
+ *
+ */
+$params = array();
+Pluf_Signal::send('queuecron.php::run', 'queuecron.php', $params);
+
+unlink($lock_file);

scripts/svn-post-commit

@@ -18,7 +18,7 @@
 # www$ ln -s /home/www/indefero/scripts/svn-post-commit post-commit
 #
 
-SCRIPTDIR=$(dirname $(readlink -f $0))
+SCRIPTDIR=$(dirname $(readlink $0))
 PHP_POST_COMMIT=$SCRIPTDIR/svnpostcommit.php
 
 echo php $PHP_POST_COMMIT "$1" "$2" | at now > /dev/null 2>&1

scripts/svn-post-revprop-change

@@ -0,0 +1,29 @@
+#!/bin/sh
+#
+# This hook does only one thing:
+#
+# 1. It calls the svnpostrevpropchange.php script with the current repository
+#    and revision as argument. The svnpostrevpropchange.php script will then 
+#    trigger the 'svnpostrevpropchange.php::run' event with the repository 
+#    path, revision, username, property name and action as arguments together
+#    with merged $_ENV and $_SERVER array.
+#
+# This hook is normally installed automatically at the creation of your
+# repository if you have everything configured correctly. If you want
+# to enable it later, you need to symlink it as "post-revprop-change" in your 
+# $REPOSITORY/hooks folder. It needs to be executable.
+#
+# www$ chmod +x /home/www/indefero/scripts/svn-post-revprop-change
+# www$ cd /home/svn/repositories/project/hooks
+# www$ ln -s /home/www/indefero/scripts/svn-post-revprop-change post-revprop-change
+#
+
+SCRIPTDIR=$(dirname $(readlink $0))
+PHP_POST_REVPROP=$SCRIPTDIR/svnpostrevpropchange.php
+
+echo php $PHP_POST_REVPROP "$1" "$2" "$3" "$4" "$5" | at now > /dev/null 2>&1
+REPOS="$1"
+REV="$2"
+USER="$3"
+PROPNAME="$4"
+ACTION="$5"

scripts/svnpostcommit.php

@@ -55,6 +55,7 @@ Pluf_Dispatcher::loadControllers(Pluf::f('idf_views'));
 $params = array('repo_dir' => $argv[1],
                 'revision' => $argv[2],
                 'env' => array_merge($_ENV, $_SERVER));
+Pluf_Log::event(array('svnpostcommit.php', 'Send run signal.', $params));
 Pluf_Signal::send('svnpostcommit.php::run', 'svnpostcommit.php', $params);
 
 

scripts/svnpostrevpropchange.php

@@ -0,0 +1,70 @@
+<?php
+/* -*- tab-width: 4; indent-tabs-mode: nil; c-basic-offset: 4 -*- */
+/*
+# ***** BEGIN LICENSE BLOCK *****
+# This file is part of InDefero, an open source project management application.
+# Copyright (C) 2008-2010 Céondo Ltd and contributors.
+#
+# InDefero is free software; you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation; either version 2 of the License, or
+# (at your option) any later version.
+#
+# InDefero is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write to the Free Software
+# Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA  02110-1301  USA
+#
+# ***** END LICENSE BLOCK ***** */
+
+/**
+ * This script allows you to hook into the post-revprop-change action
+ * of your subversion repository. I am using it to perform near real
+ * time backup of the repositories on indefero.net.
+ */
+
+require dirname(__FILE__).'/../src/IDF/conf/path.php';
+require 'Pluf.php';
+Pluf::start(dirname(__FILE__).'/../src/IDF/conf/idf.php');
+Pluf_Dispatcher::loadControllers(Pluf::f('idf_views'));
+
+/**
+ * [signal]
+ *
+ * svnpostrevpropchange.php::run
+ *
+ * [sender]
+ *
+ * svnpostrevpropchange.php
+ *
+ * [description]
+ *
+ * This signal allows an application to perform a set of tasks on a
+ * post property revision change of a subversion repository.
+ *
+ * [parameters]
+ *
+ * array('repo_dir' => '/path/to/subversion/repository',
+ *       'revision' => 1234,
+ *       'user' => 'username',
+ *       'propname' => 'changed-property',
+ *       'action' => 'the action M, A or D',
+ *       'env' => array_merge($_ENV, $_SERVER));
+ *
+ */
+
+$params = array('repo_dir' => $argv[1],
+                'revision' => $argv[2],
+                'user' => $argv[3],
+                'propname' => $argv[4],
+                'action' => $argv[5],
+                'env' => array_merge($_ENV, $_SERVER));
+Pluf_Signal::send('svnpostrevpropchange.php::run', 'svnpostrevpropchange.php', 
+                  $params);
+
+
+

src/IDF/Commit.php

@@ -34,6 +34,7 @@ Pluf::loadFunction('Pluf_Template_dateAgo');
 class IDF_Commit extends Pluf_Model
 {
     public $_model = __CLASS__;
+    public $extra = null; /**< Extra data as IDF_Gconf object */
 
     function init()
     {
@@ -127,6 +128,7 @@ class IDF_Commit extends Pluf_Model
     {
         IDF_Timeline::remove($this);
         IDF_Search::remove($this);
+        IDF_Gconf::dropForModel($this);
     }
 
     /**
@@ -142,6 +144,10 @@ class IDF_Commit extends Pluf_Model
                             array($project->id, $change->commit));
         $r = Pluf::factory('IDF_Commit')->getList(array('filter'=>$sql->gen()));
         if ($r->count() > 0) {
+            $r[0]->extra = new IDF_Gconf();
+            $r[0]->extra->serialize = true;
+            $r[0]->extra->setModel($r[0]);
+            $r[0]->extra->initCache();
             return $r[0];
         }
         if (!isset($change->full_message)) {
@@ -154,9 +160,16 @@ class IDF_Commit extends Pluf_Model
         $commit->summary = self::toUTF8($change->title);
         $commit->fullmessage = self::toUTF8($change->full_message);
         $commit->author = $scm->findAuthor($change->author);
-        $commit->origauthor = $change->author;
+        $commit->origauthor = self::toUTF8($change->author);
         $commit->creation_dtime = $change->date;
         $commit->create();
+        $extra = $scm->getExtraProperties($change);
+        $commit->extra = new IDF_Gconf();
+        $commit->extra->serialize = true; // As we can store arrays
+        $commit->extra->setModel($commit);
+        foreach ($extra as $key => $val) {
+            $commit->extra->setVal($key, $val);
+        }
         $commit->notify($project->getConf());
         return $commit;
     }
@@ -264,9 +277,38 @@ class IDF_Commit extends Pluf_Model
      */
     public function notify($conf, $create=true)
     {
+        // Now we add to the queue, soon we will push everything in
+        // the queue, including email notifications and indexing.
+        // Even if the url is empty, we add to the queue as some
+        // plugins may want to do something with this information in
+        // an asynchronous way.
+        $project = $this->get_project();
+        $scm = $project->getConf()->getVal('scm', 'git');
+        $url = str_replace(array('%p', '%r'),
+                           array($project->shortname, $this->scm_id),
+                           $conf->getVal('webhook_url', ''));
+        $payload = array('to_send' => array(
+                                            'project' => $project->shortname,
+                                            'rev' => $this->scm_id,
+                                            'scm' => $scm,
+                                            'summary' => $this->summary,
+                                            'fullmessage' => $this->fullmessage,
+                                            'author' => $this->origauthor,
+                                            'creation_date' => $this->creation_dtime,
+                                            ),
+                         'project_id' => $project->id,
+                         'authkey' => $project->getPostCommitHookKey(),
+                         'url' => $url,
+                         );
+        $item = new IDF_Queue();
+        $item->type = 'new_commit';
+        $item->payload = $payload;
+        $item->create();
+
         if ('' == $conf->getVal('source_notification_email', '')) {
             return;
         }
+
         $current_locale = Pluf_Translation::getLocale();
         $langs = Pluf::f('languages', array('en'));
         Pluf_Translation::loadSetLocale($langs[0]);
@@ -280,13 +322,16 @@ class IDF_Commit extends Pluf_Model
                                              );
         $tmpl = new Pluf_Template('idf/source/commit-created-email.txt');
         $text_email = $tmpl->render($context);
+        $addresses = explode(',', $conf->getVal('source_notification_email'));
+        foreach ($addresses as $address) {
             $email = new Pluf_Mail(Pluf::f('from_email'),
-                               $conf->getVal('source_notification_email'),
+                                   $address,
                                    sprintf(__('New Commit %s - %s (%s)'),
                                            $this->scm_id, $this->summary,
                                            $this->get_project()->shortname));
             $email->addTextMessage($text_email);
             $email->sendMail();
+        }
         Pluf_Translation::loadSetLocale($current_locale);
     }
 }

src/IDF/Diff.php

@@ -27,17 +27,17 @@
  */
 class IDF_Diff
 {
-    public $repo = '';
-    public $diff = '';
+    public $path_strip_level = 0;
     protected $lines = array();
 
     public $files = array();
 
-    public function __construct($diff, $repo='')
+    public function __construct($diff, $path_strip_level = 0)
     {
-        $this->repo = $repo;
-        $this->diff = $diff;
-        $this->lines = preg_split("/\015\012|\015|\012/", $diff);
+        $this->path_strip_level = $path_strip_level;
+        // this works because in unified diff format even empty lines are
+        // either prefixed with a '+', '-' or ' '
+        $this->lines = preg_split("/\015\012|\015|\012/", $diff, -1, PREG_SPLIT_NO_EMPTY);
     }
 
     public function parse()
@@ -49,90 +49,95 @@ class IDF_Diff
         $files = array();
         $indiff = false; // Used to skip the headers in the git patches
         $i = 0; // Used to skip the end of a git patch with --\nversion number
-        foreach ($this->lines as $line) {
+        $diffsize = count($this->lines);
+        while ($i < $diffsize) {
+            // look for the potential beginning of a diff
+            if (substr($this->lines[$i], 0, 4) !== '--- ') {
                 $i++;
-            if (0 === strpos($line, '--') and isset($this->lines[$i]) 
-                and preg_match('/^\d+\.\d+\.\d+\.\d+$/', $this->lines[$i])) {
+                continue;
+            }
+
+            // we're inside a diff candiate
+            $oldfileline = $this->lines[$i++];
+            $newfileline = $this->lines[$i++];
+            if (substr($newfileline, 0, 4) !== '+++ ') {
+                // not a valid diff here, move on
+                continue;
+            }
+
+            // use new file name by default
+            preg_match("/^\+\+\+ ([^\t]+)/", $newfileline, $m);
+            $current_file = $m[1];
+            if ($current_file === '/dev/null') {
+                // except if it's /dev/null, use the old one instead
+                // eg. mtn 0.48 and newer
+                preg_match("/^--- ([^\t]+)/", $oldfileline, $m);
+                $current_file = $m[1];
+            }
+            if ($this->path_strip_level > 0) {
+                $fileparts = explode('/', $current_file, $this->path_strip_level+1);
+                $current_file = array_pop($fileparts);
+            }
+            $current_chunk = 0;
+            $files[$current_file] = array();
+            $files[$current_file]['chunks'] = array();
+            $files[$current_file]['chunks_def'] = array();
+
+            while ($i < $diffsize && substr($this->lines[$i], 0, 3) === '@@ ') {
+                $elems = preg_match('/@@ -(\d+),?(\d*) \+(\d+),?(\d*) @@.*/',
+                                    $this->lines[$i++], $results);
+                if ($elems != 1) {
+                    // hunk is badly formatted
                     break;
                 }
-            if (0 === strpos($line, 'diff --git a')) {
-                $current_file = self::getFile($line);
-                $files[$current_file] = array();
-                $files[$current_file]['chunks'] = array();
-                $files[$current_file]['chunks_def'] = array();
-                $current_chunk = 0;
-                $indiff = true;
-                continue;
-            } else if (preg_match('#^diff -r [^\s]+ -r [^\s]+ (.+)$#', $line, $matches)) {
-                $current_file = $matches[1];
-                $files[$current_file] = array();
-                $files[$current_file]['chunks'] = array();
-                $files[$current_file]['chunks_def'] = array();
-                $current_chunk = 0;
-                $indiff = true;
-                continue;
-            } else if (0 === strpos($line, 'Index: ')) {
-                $current_file = self::getSvnFile($line);
-                $files[$current_file] = array();
-                $files[$current_file]['chunks'] = array();
-                $files[$current_file]['chunks_def'] = array();
-                $current_chunk = 0;
-                $indiff = true;
-                continue;
-            }
-            if (!$indiff) {
-                continue;
-            }
-            if (0 === strpos($line, '@@ ')) {
-                $files[$current_file]['chunks_def'][] = self::getChunk($line);
+                $delstart = $results[1];
+                $dellines = $results[2] === '' ? 1 : $results[2];
+                $addstart = $results[3];
+                $addlines = $results[4] === '' ? 1 : $results[4];
+
+                $files[$current_file]['chunks_def'][] = array(
+                    array($delstart, $dellines), array($addstart, $addlines)
+                );
                 $files[$current_file]['chunks'][] = array();
+
+                while ($i < $diffsize && ($addlines >= 0 || $dellines >= 0)) {
+                    $linetype = $this->lines[$i] != '' ? $this->lines[$i][0] : ' ';
+                    switch ($linetype) {
+                        case ' ':
+                            $files[$current_file]['chunks'][$current_chunk][] =
+                                array($delstart, $addstart, substr($this->lines[$i++], 1));
+                            $dellines--;
+                            $addlines--;
+                            $delstart++;
+                            $addstart++;
+                            break;
+                        case '+':
+                            $files[$current_file]['chunks'][$current_chunk][] =
+                                array('', $addstart, substr($this->lines[$i++], 1));
+                            $addlines--;
+                            $addstart++;
+                            break;
+                        case '-':
+                            $files[$current_file]['chunks'][$current_chunk][] =
+                                array($delstart, '', substr($this->lines[$i++], 1));
+                            $dellines--;
+                            $delstart++;
+                            break;
+                        case '\\':
+                            // ignore newline handling for now, see issue 636
+                            $i++;
+                            continue;
+                        default:
+                            break 2;
+                    }
+                }
                 $current_chunk++;
-                $lline = $files[$current_file]['chunks_def'][$current_chunk-1][0][0];
-                $rline = $files[$current_file]['chunks_def'][$current_chunk-1][1][0];
-                continue;
-            }
-            if (0 === strpos($line, '---') or 0 === strpos($line, '+++')) {
-                continue;
-            }
-            if (0 === strpos($line, '-')) {
-                $files[$current_file]['chunks'][$current_chunk-1][] = array($lline, '', substr($line, 1));
-                $lline++;
-                continue;
-            }
-            if (0 === strpos($line, '+')) {
-                $files[$current_file]['chunks'][$current_chunk-1][] = array('', $rline, substr($line, 1));
-                $rline++;
-                continue;
-            }
-            if (0 === strpos($line, ' ')) {
-                $files[$current_file]['chunks'][$current_chunk-1][] = array($lline, $rline, substr($line, 1));
-                $rline++;
-                $lline++;
-                continue;
-            }
-            if ($line == '') {
-                $files[$current_file]['chunks'][$current_chunk-1][] = array($lline, $rline, $line);
-                $rline++;
-                $lline++;
-                continue;
             }
         }
         $this->files = $files;
         return $files;
     }
 
-    public static function getFile($line)
-    {
-        $line = substr(trim($line), 10);
-        $n = (int) strlen($line)/2;
-        return trim(substr($line, 3, $n-3));
-    }
-
-    public static function getSvnFile($line)
-    {
-        return substr(trim($line), 7);
-    }
-
     /**
      * Return the html version of a parsed diff.
      */
@@ -141,8 +146,8 @@ class IDF_Diff
         $out = '';
         foreach ($this->files as $filename=>$file) {
             $pretty = '';
-            $fileinfo = IDF_Views_Source::getMimeType($filename);
-            if (IDF_Views_Source::isSupportedExtension($fileinfo[2])) {
+            $fileinfo = IDF_FileUtil::getMimeType($filename);
+            if (IDF_FileUtil::isSupportedExtension($fileinfo[2])) {
                 $pretty = ' prettyprint';
             }
             $out .= "\n".'<table class="diff" summary="">'."\n";
@@ -169,7 +174,6 @@ class IDF_Diff
         return Pluf_Template::markSafe($out);
     }
 
-
     public static function padLine($line)
     {
         $line = str_replace("\t", '    ', $line);
@@ -182,19 +186,6 @@ class IDF_Diff
         return str_repeat('&nbsp;', $i).substr($line, $i);
     }
 
-    /**
-     * @return array array(array(start, n), array(start, n))
-     */
-    public static function getChunk($line)
-    {
-        $elts = explode(' ', $line);
-        $res = array();
-        for ($i=1;$i<3;$i++) {
-            $res[] = explode(',', trim(substr($elts[$i], 1)));
-        }
-        return $res;
-    }
-
     /**
      * Review patch.
      *
@@ -319,12 +310,11 @@ class IDF_Diff
         return $nnew_chunks;
     }
 
-
     public function renderCompared($chunks, $filename)
     {
-        $fileinfo = IDF_Views_Source::getMimeType($filename);
+        $fileinfo = IDF_FileUtil::getMimeType($filename);
         $pretty = '';
-        if (IDF_Views_Source::isSupportedExtension($fileinfo[2])) {
+        if (IDF_FileUtil::isSupportedExtension($fileinfo[2])) {
             $pretty = ' prettyprint';
         }
         $out = '';
@@ -353,6 +343,5 @@ class IDF_Diff
             $i++;
         }
         return Pluf_Template::markSafe($out);
-
     }
 }

src/IDF/EmailAddress.php

@@ -0,0 +1,96 @@
+<?php
+/* -*- tab-width: 4; indent-tabs-mode: nil; c-basic-offset: 4 -*- */
+/*
+# ***** BEGIN LICENSE BLOCK *****
+# This file is part of InDefero, an open source project management application.
+# Copyright (C) 2008 Céondo Ltd and contributors.
+#
+# InDefero is free software; you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation; either version 2 of the License, or
+# (at your option) any later version.
+#
+# InDefero is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write to the Free Software
+# Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA  02110-1301  USA
+#
+# ***** END LICENSE BLOCK ***** */
+
+/**
+ * Storage of Email addresses
+ *
+ */
+class IDF_EmailAddress extends Pluf_Model
+{
+    public $_model = __CLASS__;
+
+    function init()
+    {
+        $this->_a['table'] = 'idf_emailaddresses';
+        $this->_a['model'] = __CLASS__;
+        $this->_a['cols'] = array(
+                             // It is mandatory to have an "id" column.
+                            'id' =>
+                            array(
+                                  'type' => 'Pluf_DB_Field_Sequence',
+                                  //It is automatically added.
+                                  'blank' => true,
+                                  ),
+                            'user' =>
+                            array(
+                                  'type' => 'Pluf_DB_Field_Foreignkey',
+                                  'model' => 'Pluf_User',
+                                  'blank' => false,
+                                  'verbose' => __('user'),
+                                  ),
+                            'address' =>
+                            array(
+                                  'type' => 'Pluf_DB_Field_Email',
+                                  'blank' => false,
+                                  'verbose' => __('email'),
+                                  'unique' => true,
+                                  ),
+                            );
+        // WARNING: Not using getSqlTable on the Pluf_User object to
+        // avoid recursion.
+        $t_users = $this->_con->pfx.'users';
+        $this->_a['views'] = array(
+                              'join_user' =>
+                              array(
+                                    'join' => 'LEFT JOIN '.$t_users
+                                    .' ON '.$t_users.'.id='.$this->_con->qn('user'),
+                                    'select' => $this->getSelect().', '
+                                    .$t_users.'.login AS login',
+                                    'props' => array('login' => 'login'),
+                                    )
+                                   );
+    }
+
+    function get_email_addresses_for_user($user)
+    {
+        $addr = $user->get_idf_emailaddress_list();
+        $addr[] = (object)array("address" => $user->email, "id" => -1, "user" => $user);
+        return $addr;
+    }
+
+    function get_user_for_email_address($email)
+    {
+        $sql = new Pluf_SQL('email=%s', array($email));
+        $users = Pluf::factory('Pluf_User')->getList(array('filter'=>$sql->gen()));
+        if ($users->count() > 0) {
+            return $users[0];
+        }
+        $sql = new Pluf_SQL('address=%s', array($email));
+        $matches = Pluf::factory('IDF_EmailAddress')->getList(array('filter'=>$sql->gen()));
+        if ($matches->count() > 0) {
+            return new Pluf_User($matches[0]->user);
+        }
+        return null;
+    }
+}
+

src/IDF/FileUtil.php

@@ -0,0 +1,165 @@
+<?php
+/* -*- tab-width: 4; indent-tabs-mode: nil; c-basic-offset: 4 -*- */
+/*
+# ***** BEGIN LICENSE BLOCK *****
+# This file is part of InDefero, an open source project management application.
+# Copyright (C) 2010 Céondo Ltd and contributors.
+#
+# InDefero is free software; you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation; either version 2 of the License, or
+# (at your option) any later version.
+#
+# InDefero is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write to the Free Software
+# Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA  02110-1301  USA
+#
+# ***** END LICENSE BLOCK ***** */
+
+/**
+ * File utilities.
+ *
+ */
+class IDF_FileUtil
+{
+    /**
+     * Extension supported by the syntax highlighter.
+     */
+    public static $supportedExtenstions = array(
+              'ascx', 'ashx', 'asmx', 'aspx', 'browser', 'bsh', 'c', 'cl', 'cc',
+              'config', 'cpp', 'cs', 'csh', 'csproj', 'css', 'cv', 'cyc', 'el', 'fs',
+              'h', 'hh', 'hpp', 'hs', 'html', 'html', 'java', 'js', 'lisp', 'master',
+              'pas', 'perl', 'php', 'pl', 'pm', 'py', 'rb', 'scm', 'sh', 'sitemap',
+              'skin', 'sln', 'svc', 'vala', 'vb', 'vbproj', 'vbs', 'wsdl', 'xhtml',
+              'xml', 'xsd', 'xsl', 'xslt');
+
+    /**
+     * Test if an extension is supported by the syntax highlighter.
+     *
+     * @param string The extension to test
+     * @return bool
+     */
+    public static function isSupportedExtension($extension)
+    {
+        return in_array($extension, self::$supportedExtenstions);
+    }
+
+    /**
+     * Returns a HTML snippet with a line-by-line pre-rendered table
+     * for the given source content
+     *
+     * @param array file information as returned by getMimeType or getMimeTypeFromContent
+     * @param string the content of the file
+     * @return string
+     */
+    public static function highLight($fileinfo, $content)
+    {
+        $pretty = '';
+        if (self::isSupportedExtension($fileinfo[2])) {
+            $pretty = ' prettyprint';
+        }
+        $table = array();
+        $i = 1;
+        foreach (preg_split("/\015\012|\015|\012/", $content) as $line) {
+            $table[] = '<tr class="c-line"><td class="code-lc" id="L'.$i.'"><a href="#L'.$i.'">'.$i.'</a></td>'
+                .'<td class="code mono'.$pretty.'">'.IDF_Diff::padLine(Pluf_esc($line)).'</td></tr>';
+            $i++;
+        }
+        return Pluf_Template::markSafe(implode("\n", $table));
+    }
+
+    /**
+     * Find the mime type of a file.
+     *
+     * Use /etc/mime.types to find the type.
+     *
+     * @param string Filename/Filepath
+     * @param array  Mime type found or 'application/octet-stream', basename, extension
+     */
+    public static function getMimeType($file)
+    {
+        static $mimes = null;
+        if ($mimes == null) {
+            $mimes = array();
+            $src = Pluf::f('idf_mimetypes_db', '/etc/mime.types');
+            $filecontent = @file_get_contents($src);
+            if ($filecontent !== false) {
+                $mimes = preg_split("/\015\012|\015|\012/", $filecontent);
+            }
+        }
+
+        $info = pathinfo($file);
+        if (isset($info['extension'])) {
+            foreach ($mimes as $mime) {
+                if ('#' != substr($mime, 0, 1)) {
+                    $elts = preg_split('/ |\t/', $mime, -1, PREG_SPLIT_NO_EMPTY);
+                    if (in_array($info['extension'], $elts)) {
+                        return array($elts[0], $info['basename'], $info['extension']);
+                    }
+                }
+            }
+        } else {
+            // we consider that if no extension and base name is all
+            // uppercase, then we have a text file.
+            if ($info['basename'] == strtoupper($info['basename'])) {
+                return array('text/plain', $info['basename'], 'txt');
+            }
+            $info['extension'] = 'bin';
+        }
+        return array('application/octet-stream', $info['basename'], $info['extension']);
+    }
+
+    /**
+     * Find the mime type of a file using the fileinfo class.
+     *
+     * @param string Filename/Filepath
+     * @param string File content
+     * @return array Mime type found or 'application/octet-stream', basename, extension
+     */
+    public static function getMimeTypeFromContent($file, $filedata)
+    {
+        $info = pathinfo($file);
+        $res = array('application/octet-stream',
+                     $info['basename'],
+                     isset($info['extension']) ? $info['extension'] : 'bin');
+        if (function_exists('finfo_open')) {
+            $finfo = finfo_open(FILEINFO_MIME);
+            $mime = finfo_buffer($finfo, $filedata);
+            finfo_close($finfo);
+            if ($mime) {
+                $res[0] = $mime;
+            }
+            if (!isset($info['extension']) && $mime) {
+                $res[2] = (0 === strpos($mime, 'text/')) ? 'txt' : 'bin';
+            } elseif (!isset($info['extension'])) {
+                $res[2] = 'bin';
+            }
+        }
+        return $res;
+    }
+
+    /**
+     * Find if a given mime type is a text file.
+     * This uses the output of the self::getMimeType function.
+     *
+     * @param array (Mime type, file name, extension)
+     * @return bool Is text
+     */
+    public static function isText($fileinfo)
+    {
+        if (0 === strpos($fileinfo[0], 'text/')) {
+            return true;
+        }
+        $ext = 'mdtext php-dist h gitignore diff patch';
+        $extra_ext = trim(Pluf::f('idf_extra_text_ext', ''));
+        if (!empty($extra_ext))
+            $ext .= ' ' . $extra_ext;
+        $ext = array_merge(self::$supportedExtenstions, explode(' ' , $ext));
+        return (in_array($fileinfo[2], $ext));
+    }
+}

src/IDF/Form/Admin/ProjectCreate.php

@@ -38,6 +38,7 @@ class IDF_Form_Admin_ProjectCreate extends Pluf_Form
                          'git' => __('git'),
                          'svn' => __('Subversion'),
                          'mercurial' => __('mercurial'),
+                         'mtn' => __('monotone'),
                          );
         foreach (Pluf::f('allowed_scm', array()) as $key => $class) {
             $choices[$options[$key]] = $key;
@@ -63,6 +64,14 @@ class IDF_Form_Admin_ProjectCreate extends Pluf_Form
                                             'help_text' => __('It must be unique for each project and composed only of letters, digits and dash (-) like "my-project".'),
                                             ));
 
+        $this->fields['shortdesc'] = new Pluf_Form_Field_Varchar(
+                                      array('required' => true,
+                                            'label' => __('Short description'),
+                                            'help_text' => __('A one line description of the project.'),
+                                            'initial' => '',
+                                            'widget_attrs' => array('size' => '35'),
+                                            ));
+
         $this->fields['scm'] = new Pluf_Form_Field_Varchar(
                     array('required' => true,
                           'label' => __('Repository type'),
@@ -92,6 +101,14 @@ class IDF_Form_Admin_ProjectCreate extends Pluf_Form
                           'widget' => 'Pluf_Form_Widget_PasswordInput',
                           ));
 
+        $this->fields['mtn_master_branch'] = new Pluf_Form_Field_Varchar(
+                    array('required' => false,
+                          'label' => __('Master branch'),
+                          'initial' => '',
+                          'widget_attrs' => array('size' => '35'),
+                          'help_text' => __('This should be a world-wide unique identifier for your project. A reverse DNS notation like "com.my-domain.my-project" is a good idea.'),
+                          ));
+
         $this->fields['owners'] = new Pluf_Form_Field_Varchar(
                                       array('required' => false,
                                             'label' => __('Project owners'),
@@ -109,6 +126,20 @@ class IDF_Form_Admin_ProjectCreate extends Pluf_Form
                                                                     'cols' => 40),
                                             'widget' => 'Pluf_Form_Widget_TextareaInput',
                                             ));
+
+        $projects = array('--' => '--');
+        foreach (Pluf::factory('IDF_Project')->getList(array('order' => 'name ASC')) as $proj) {
+            $projects[$proj->name] = $proj->shortname;
+        }
+        $this->fields['template'] = new Pluf_Form_Field_Varchar(
+                                      array('required' => false,
+                                            'label' => __('Project template'),
+                                            'initial' => '--',
+                                            'help_text' => __('Use the given project to initialize the new project. Access rights and general configuration will be taken from the template project.'),
+                                            'widget' => 'Pluf_Form_Widget_SelectInput',
+                                            'widget_attrs' => array('choices' => $projects),
+                                            ));
+
         /**
          * [signal]
          *
@@ -151,11 +182,39 @@ class IDF_Form_Admin_ProjectCreate extends Pluf_Form
         // we accept only starting with http(s):// to avoid people
         // trying to access the local filesystem.
         if (!preg_match('#^(http|https)://#', $url)) {
-            throw new Pluf_Form_Invalid(__('Only a remote repository available throught http or https are allowed. For example "http://somewhere.com/svn/trunk".'));
+            throw new Pluf_Form_Invalid(__('Only a remote repository available through HTTP or HTTPS is allowed. For example "http://somewhere.com/svn/trunk".'));
         }
         return $url;
     }
 
+    public function clean_mtn_master_branch()
+    {
+        // do not validate, but empty the field if a different
+        // SCM should be used
+        if ($this->cleaned_data['scm'] != 'mtn')
+            return '';
+
+        $mtn_master_branch = mb_strtolower($this->cleaned_data['mtn_master_branch']);
+        if (!preg_match('/^([\w\d]+([-][\w\d]+)*)(\.[\w\d]+([-][\w\d]+)*)*$/',
+                        $mtn_master_branch)) {
+            throw new Pluf_Form_Invalid(__(
+                'The master branch is empty or contains illegal characters, '.
+                'please use only letters, digits, dashs and dots as separators.'
+            ));
+        }
+
+        $sql = new Pluf_SQL('vkey=%s AND vdesc=%s',
+                            array('mtn_master_branch', $mtn_master_branch));
+        $l = Pluf::factory('IDF_Conf')->getList(array('filter'=>$sql->gen()));
+        if ($l->count() > 0) {
+            throw new Pluf_Form_Invalid(__(
+                'This master branch is already used. Please select another one.'
+            ));
+        }
+
+        return $mtn_master_branch;
+    }
+
     public function clean_shortname()
     {
         $shortname = mb_strtolower($this->cleaned_data['shortname']);
@@ -184,6 +243,11 @@ class IDF_Form_Admin_ProjectCreate extends Pluf_Form
                 $this->cleaned_data[$key] = '';
             }
         }
+
+        if ($this->cleaned_data['scm'] != 'mtn') {
+            $this->cleaned_data['mtn_master_branch'] = '';
+        }
+
         /**
          * [signal]
          *
@@ -217,24 +281,88 @@ class IDF_Form_Admin_ProjectCreate extends Pluf_Form
         $project = new IDF_Project();
         $project->name = $this->cleaned_data['name'];
         $project->shortname = $this->cleaned_data['shortname'];
+        $project->shortdesc = $this->cleaned_data['shortdesc'];
+
+        if ($this->cleaned_data['template'] != '--') {
+            // Find the template project
+            $sql = new Pluf_SQL('shortname=%s',
+                                array($this->cleaned_data['template']));
+            $tmpl = Pluf::factory('IDF_Project')->getOne(array('filter' => $sql->gen()));
+            $project->private = $tmpl->private;
+            $project->description = $tmpl->description;
+        } else {
             $project->private = $this->cleaned_data['private_project'];
             $project->description = __('Click on the Project Management tab to set the description of your project.');
+        }
         $project->create();
         $conf = new IDF_Conf();
         $conf->setProject($project);
-        $keys = array('scm', 'svn_remote_url', 
-                      'svn_username', 'svn_password');
+        $keys = array('scm', 'svn_remote_url', 'svn_username',
+                      'svn_password', 'mtn_master_branch');
         foreach ($keys as $key) {
             $this->cleaned_data[$key] = (!empty($this->cleaned_data[$key])) ?
                 $this->cleaned_data[$key] : '';
             $conf->setVal($key, $this->cleaned_data[$key]);
         }
+        if ($this->cleaned_data['template'] != '--') {
+            $tmplconf = new IDF_Conf();
+            $tmplconf->setProject($tmpl);
+            // We need to get all the configuration variables we want from
+            // the old project and put them into the new project.
+            $props = array(
+                           'labels_download_predefined' => IDF_Form_UploadConf::init_predefined,
+                           'labels_download_one_max' => IDF_Form_UploadConf::init_one_max,
+                           'labels_wiki_predefined' => IDF_Form_WikiConf::init_predefined,
+                           'labels_wiki_one_max' => IDF_Form_WikiConf::init_one_max,
+                           'labels_issue_template' => IDF_Form_IssueTrackingConf::init_template,
+                           'labels_issue_open' => IDF_Form_IssueTrackingConf::init_open,
+                           'labels_issue_closed' => IDF_Form_IssueTrackingConf::init_closed,
+                           'labels_issue_predefined' =>  IDF_Form_IssueTrackingConf::init_predefined,
+                           'labels_issue_one_max' => IDF_Form_IssueTrackingConf::init_one_max,
+                           'webhook_url' => '',
+                           'downloads_access_rights' => 'all',
+                           'review_access_rights' => 'all',
+                           'wiki_access_rights' => 'all',
+                           'source_access_rights' => 'all',
+                           'issues_access_rights' => 'all',
+                           'downloads_notification_email' => '',
+                           'review_notification_email' => '',
+                           'wiki_notification_email' => '',
+                           'source_notification_email' => '',
+                           'issues_notification_email' => '',
+                           );
+            foreach ($props as $prop => $def) {
+                $conf->setVal($prop, $tmplconf->getVal($prop, $def));
+            }
+        }
         $project->created();
+
+        if ($this->cleaned_data['template'] == '--') {
             IDF_Form_MembersConf::updateMemberships($project,
                                                     $this->cleaned_data);
+        } else {
+            // Get the membership of the template $tmpl
+            IDF_Form_MembersConf::updateMemberships($project,
+                                                    $tmpl->getMembershipData('string'));
+        }
         $project->membershipsUpdated();
         return $project;
     }
+
+    /**
+     * Check that the template project exists.
+     */
+    public function clean_template()
+    {
+        if ($this->cleaned_data['template'] == '--') {
+            return $this->cleaned_data['template'];
+        }
+        $sql = new Pluf_SQL('shortname=%s', array($this->cleaned_data['template']));
+        if (Pluf::factory('IDF_Project')->getOne(array('filter' => $sql->gen())) == null) {
+            throw new Pluf_Form_Invalid(__('This project is not available.'));
+        }
+        return $this->cleaned_data['template'];
+    }
 }
 
 

src/IDF/Form/Admin/ProjectUpdate.php

@@ -37,12 +37,32 @@ class IDF_Form_Admin_ProjectUpdate extends Pluf_Form
     {
         $this->project = $extra['project'];
         $members = $this->project->getMembershipData('string');
+        $conf = $this->project->getConf();
+
         $this->fields['name'] = new Pluf_Form_Field_Varchar(
                                       array('required' => true,
                                             'label' => __('Name'),
                                             'initial' => $this->project->name,
                                             ));
 
+        $this->fields['shortdesc'] = new Pluf_Form_Field_Varchar(
+                                      array('required' => true,
+                                            'label' => __('Short description'),
+                                            'help_text' => __('A one line description of the project.'),
+                                            'initial' => $this->project->shortdesc,
+                                            'widget_attrs' => array('size' => '35'),
+                                            ));
+
+        if ($this->project->getConf()->getVal('scm') == 'mtn') {
+            $this->fields['mtn_master_branch'] = new Pluf_Form_Field_Varchar(
+                                          array('required' => false,
+                                                'label' => __('Master branch'),
+                                                'initial' => $conf->getVal('mtn_master_branch'),
+                                                'widget_attrs' => array('size' => '35'),
+                                                'help_text' => __('This should be a world-wide unique identifier for your project. A reverse DNS notation like "com.my-domain.my-project" is a good idea.'),
+                                                ));
+        }
+
         $this->fields['owners'] = new Pluf_Form_Field_Varchar(
                                       array('required' => false,
                                             'label' => __('Project owners'),
@@ -61,6 +81,30 @@ class IDF_Form_Admin_ProjectUpdate extends Pluf_Form
                                             ));
     }
 
+    public function clean_mtn_master_branch()
+    {
+        $mtn_master_branch = mb_strtolower($this->cleaned_data['mtn_master_branch']);
+        if (!preg_match('/^([\w\d]+([-][\w\d]+)*)(\.[\w\d]+([-][\w\d]+)*)*$/',
+                        $mtn_master_branch)) {
+            throw new Pluf_Form_Invalid(__(
+                'The master branch is empty or contains illegal characters, '.
+                'please use only letters, digits, dashes and dots as separators.'
+            ));
+        }
+
+        $sql = new Pluf_SQL('vkey=%s AND vdesc=%s AND project!=%s',
+                            array('mtn_master_branch', $mtn_master_branch,
+                                  (string)$this->project->id));
+        $l = Pluf::factory('IDF_Conf')->getList(array('filter'=>$sql->gen()));
+        if ($l->count() > 0) {
+            throw new Pluf_Form_Invalid(__(
+                'This master branch is already used. Please select another one.'
+            ));
+        }
+
+        return $mtn_master_branch;
+    }
+
     public function clean_owners()
     {
         return IDF_Form_MembersConf::checkBadLogins($this->cleaned_data['owners']);
@@ -80,7 +124,15 @@ class IDF_Form_Admin_ProjectUpdate extends Pluf_Form
                                                 $this->cleaned_data);
         $this->project->membershipsUpdated();
         $this->project->name = $this->cleaned_data['name'];
+        $this->project->shortdesc = $this->cleaned_data['shortdesc'];
         $this->project->update();
+
+        $keys = array('mtn_master_branch');
+        foreach ($keys as $key) {
+            if (!empty($this->cleaned_data[$key])) {
+                $this->project->getConf()->setVal($key, $this->cleaned_data[$key]);
+            }
+        }
     }
 }
 

src/IDF/Form/Admin/UserCreate.php

@@ -68,7 +68,7 @@ class IDF_Form_Admin_UserCreate extends Pluf_Form
                                       array('required' => true,
                                             'label' => __('Email'),
                                             'initial' => '',
-                                            'help_text' => __('Double check the email address as the password is directly sent to the user.'),
+                                            'help_text' => __('Double check the email address as the password is sent directly to the user.'),
                                             ));
 
         $this->fields['language'] = new Pluf_Form_Field_Varchar(
@@ -82,17 +82,15 @@ class IDF_Form_Admin_UserCreate extends Pluf_Form
                                                                     ),
                                             ));
 
-        $this->fields['ssh_key'] = new Pluf_Form_Field_Varchar(
+        $this->fields['public_key'] = new Pluf_Form_Field_Varchar(
                                       array('required' => false,
-                                            'label' => __('Add a public SSH key'),
+                                            'label' => __('Add a public key'),
                                             'initial' => '',
                                             'widget_attrs' => array('rows' => 3,
                                                                     'cols' => 40),
                                             'widget' => 'Pluf_Form_Widget_TextareaInput',
-                                            'help_text' => __('Be careful to provide the public key and not the private key!')
+                                            'help_text' => __('Paste a SSH or monotone public key. Be careful to not provide your private key here!')
                                             ));
-        
-
     }
 
     /**
@@ -137,11 +135,11 @@ class IDF_Form_Admin_UserCreate extends Pluf_Form
         $params = array('user' => $user);
         Pluf_Signal::send('Pluf_User::passwordUpdated',
                           'IDF_Form_Admin_UserCreate', $params);
-        // Create the ssh key as needed
-        if ('' !== $this->cleaned_data['ssh_key']) {
+        // Create the public key as needed
+        if ('' !== $this->cleaned_data['public_key']) {
             $key = new IDF_Key();
             $key->user = $user;
-            $key->content = $this->cleaned_data['ssh_key'];
+            $key->content = $this->cleaned_data['public_key'];
             $key->create();
         }
         // Send an email to the user with the password
@@ -162,11 +160,6 @@ class IDF_Form_Admin_UserCreate extends Pluf_Form
         return $user;
     }
 
-    function clean_ssh_key()
-    {
-        return IDF_Form_UserAccount::checkSshKey($this->cleaned_data['ssh_key']);
-    }
-
     function clean_last_name()
     {
         $last_name = trim($this->cleaned_data['last_name']);
@@ -211,4 +204,12 @@ class IDF_Form_Admin_UserCreate extends Pluf_Form
         }
         return $this->cleaned_data['login'];
     }
+
+    public function clean_public_key()
+    {
+        $this->cleaned_data['public_key'] =
+            IDF_Form_UserAccount::checkPublicKey($this->cleaned_data['public_key']);
+
+        return $this->cleaned_data['public_key'];
+    }
 }

src/IDF/Form/Admin/UserUpdate.php

@@ -31,6 +31,8 @@ class IDF_Form_Admin_UserUpdate  extends Pluf_Form
     public function initFields($extra=array())
     {
         $this->user = $extra['user'];
+        $user_data = IDF_UserData::factory($this->user);
+
         $this->fields['first_name'] = new Pluf_Form_Field_Varchar(
                                       array('required' => false,
                                             'label' => __('First name'),
@@ -76,7 +78,7 @@ class IDF_Form_Admin_UserUpdate  extends Pluf_Form
                                             'label' => __('Password'),
                                             'initial' => '',
                                             'widget' => 'Pluf_Form_Widget_PasswordInput',
-                                            'help_text' => Pluf_Template::markSafe(__('Leave blank if you do not want to change the password.').'<br />'.__('The password must be hard for other people to find it, but easy for the user to remember.')),
+                                            'help_text' => Pluf_Template::markSafe(__('Leave blank if you do not want to change the password.').'<br />'.__('The password must be hard for other people to guess, but easy for the user to remember.')),
                                             'widget_attrs' => array(
                                                        'maxlength' => 50,
                                                        'size' => 15,
@@ -93,13 +95,73 @@ class IDF_Form_Admin_UserUpdate  extends Pluf_Form
                                                                     ),
                                             ));
 
+        $this->fields['description'] = new Pluf_Form_Field_Varchar(
+                                      array('required' => false,
+                                            'label' => __('Description'),
+                                            'initial' => $user_data->description,
+                                            'widget_attrs' => array('rows' => 3,
+                                                                    'cols' => 40),
+                                            'widget' => 'Pluf_Form_Widget_TextareaInput',
+                                            ));
+
+        $this->fields['twitter'] = new Pluf_Form_Field_Varchar(
+                                      array('required' => false,
+                                            'label' => __('Twitter username'),
+                                            'initial' => $user_data->twitter,
+                                            'widget_attrs' => array(
+                                                       'maxlength' => 50,
+                                                       'size' => 15,
+                                                                    ),
+                                            ));
+
+        $this->fields['public_email'] = new Pluf_Form_Field_Email(
+                                      array('required' => false,
+                                            'label' => __('Public email address'),
+                                            'initial' => $user_data->public_email,
+                                            'widget_attrs' => array(
+                                                       'maxlength' => 50,
+                                                       'size' => 15,
+                                                                    ),
+                                            ));
+
+        $this->fields['website'] = new Pluf_Form_Field_Url(
+                                      array('required' => false,
+                                            'label' => __('Website URL'),
+                                            'initial' => $user_data->website,
+                                            'widget_attrs' => array(
+                                                       'maxlength' => 50,
+                                                       'size' => 15,
+                                                                    ),
+                                            ));
+
+        $this->fields['custom_avatar'] = new Pluf_Form_Field_File(
+                                      array('required' => false,
+                                            'label' => __('Upload custom avatar'),
+                                            'initial' => '',
+                                            'max_size' => Pluf::f('max_upload_size', 2097152),
+                                            'move_function_params' => array('upload_path' => Pluf::f('upload_path').'/avatars',
+                                                                            'upload_path_create' => true,
+                                                                            'upload_overwrite' => true,
+                                                                            'file_name' => 'user_'.$this->user->id.'_%s'),
+                                            'help_text' => __('An image file with a width and height not larger than 60 pixels (bigger images are scaled down).'),
+                                            ));
+
+        $this->fields['remove_custom_avatar'] = new Pluf_Form_Field_Boolean(
+                                      array('required' => false,
+                                            'label' => __('Remove custom avatar'),
+                                            'initial' => false,
+                                            'widget' => 'Pluf_Form_Widget_CheckboxInput',
+                                            'widget_attrs' => array(),
+                                            'help_text' => __('Tick this to delete the custom avatar.'),
+                                            ));
+
         if ($extra['request']->user->administrator) {
             $this->fields['staff'] = new Pluf_Form_Field_Boolean(
                     array('required' => false,
                           'label' => __('Staff'),
                           'initial' => $this->user->staff,
                           'widget' => 'Pluf_Form_Widget_CheckboxInput',
-                          'help_text' => __('If you give staff rights to a user, you really need to trust him.'),
+                          'help_text' => __('If you give staff rights to a user, you really need to trust them.'),
                           ));
         }
 
@@ -111,7 +173,7 @@ class IDF_Form_Admin_UserUpdate  extends Pluf_Form
                           'initial' => $this->user->active,
                           'widget' => 'Pluf_Form_Widget_CheckboxInput',
                           'widget_attrs' => $attrs,
-                          'help_text' => __('If the user is not getting the confirmation email or is abusing the system, you can directly enable or disable his account here.'),
+                          'help_text' => __('If the user is not getting the confirmation email or is abusing the system, you can directly enable or disable their account here.'),
                           ));
     }
 
@@ -136,8 +198,37 @@ class IDF_Form_Admin_UserUpdate  extends Pluf_Form
             $update_pass = true;
         }
         $this->user->setFromFormData($this->cleaned_data);
+
         if ($commit) {
             $this->user->update();
+
+            // FIXME: go the extra mile and check the input lengths for
+            // all fields here!
+            // FIXME: this is all doubled in UserAccount!
+
+            $user_data = IDF_UserData::factory($this->user);
+
+            // Add or remove avatar - we need to do this here because every
+            // single setter directly leads to a save in the database
+            if ($user_data->avatar != '' &&
+                    ($this->cleaned_data['remove_custom_avatar'] == 1 ||
+                     $this->cleaned_data['custom_avatar'] != '')) {
+                $avatar_path = Pluf::f('upload_path').'/avatars/'.basename($user_data->avatar);
+                if (basename($avatar_path) != '' && is_file($avatar_path)) {
+                    unlink($avatar_path);
+                }
+                $user_data->avatar = '';
+            }
+
+            if ($this->cleaned_data['custom_avatar'] != '') {
+                $user_data->avatar = $this->cleaned_data['custom_avatar'];
+            }
+
+            $user_data->description  = $this->cleaned_data['description'];
+            $user_data->twitter      = $this->cleaned_data['twitter'];
+            $user_data->public_email = $this->cleaned_data['public_email'];
+            $user_data->website      = $this->cleaned_data['website'];
+
             if ($update_pass) {
                 /**
                  * [signal]
@@ -201,8 +292,19 @@ class IDF_Form_Admin_UserUpdate  extends Pluf_Form
         return $email;
     }
 
+    function clean_custom_avatar()
+    {
+        // Just png, jpeg/jpg or gif
+        if (!preg_match('/\.(png|jpg|jpeg|gif)$/i', $this->cleaned_data['custom_avatar']) &&
+            $this->cleaned_data['custom_avatar'] != '') {
+            @unlink(Pluf::f('upload_path').'/avatars/'.$this->cleaned_data['custom_avatar']);
+            throw new Pluf_Form_Invalid(__('For security reason, you cannot upload a file with this extension.'));
+        }
+        return $this->cleaned_data['custom_avatar'];
+    }
+
     /**
-     * Check to see if the 2 passwords are the same.
+     * Check to see if the two passwords are the same.
      */
     public function clean()
     {

src/IDF/Form/Field/EmailList.php

@@ -0,0 +1,51 @@
+<?php
+/* -*- tab-width: 4; indent-tabs-mode: nil; c-basic-offset: 4 -*- */
+/*
+# ***** BEGIN LICENSE BLOCK *****
+# This file is part of InDefero, an open source project management application.
+# Copyright (C) 2010 Céondo Ltd and contributors.
+#
+# Plume Framework is free software; you can redistribute it and/or modify
+# it under the terms of the GNU Lesser General Public License as published by
+# the Free Software Foundation; either version 2.1 of the License, or
+# (at your option) any later version.
+#
+# Plume Framework is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU Lesser General Public License for more details.
+#
+# You should have received a copy of the GNU Lesser General Public License
+# along with this program; if not, write to the Free Software
+# Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA  02110-1301  USA
+#
+# ***** END LICENSE BLOCK ***** */
+
+/**
+ * Similar to Pluf_Form_Field_Email, this form field validates one or more
+ * email addresses separated by a comma
+ */
+class IDF_Form_Field_EmailList extends Pluf_Form_Field
+{
+    public $widget = 'Pluf_Form_Widget_TextInput';
+
+    public function clean($value)
+    {
+        parent::clean($value);
+        if (in_array($value, $this->empty_values)) {
+            $value = '';
+        }
+        if ($value == '') {
+            return $value;
+        }
+        $emails = preg_split('/\s*,\s*/', $value, -1, PREG_SPLIT_NO_EMPTY);
+        foreach ($emails as $email) {
+            if (!Pluf_Utils::isValidEmail($email)) {
+                throw new Pluf_Form_Invalid(__(
+                    'Please enter one or more valid email addresses.'
+                ));
+            }
+        }
+        return implode(',', $emails);
+    }
+}

src/IDF/Form/IssueCreate.php

@@ -45,6 +45,9 @@ class IDF_Form_IssueCreate extends Pluf_Form
             or $this->user->hasPerm('IDF.project-member', $this->project)) {
             $this->show_full = true;
         }
+        $contentTemplate = $this->project->getConf()->getVal(
+            'labels_issue_template', IDF_Form_IssueTrackingConf::init_template
+        );
         $this->fields['summary'] = new Pluf_Form_Field_Varchar(
                                       array('required' => true,
                                             'label' => __('Summary'),
@@ -57,7 +60,7 @@ class IDF_Form_IssueCreate extends Pluf_Form
         $this->fields['content'] = new Pluf_Form_Field_Varchar(
                                       array('required' => true,
                                             'label' => __('Description'),
-                                            'initial' => '',
+                                            'initial' => $contentTemplate,
                                             'widget' => 'Pluf_Form_Widget_TextareaInput',
                                             'widget_attrs' => array(
                                                        'cols' => 58,
@@ -105,14 +108,41 @@ class IDF_Form_IssueCreate extends Pluf_Form
                                                        'size' => 15,
                                                                     ),
                                             ));
+
+            /*
+             * get predefined tags for issues from current project
+             *
+             * first Type:<...> and Priority:<...> will be used
+             *
+             */
+            $predefined = preg_split("/[\r\n]+/", $extra['project']->getConf()->getVal(
+              'labels_issue_predefined'
+            ));
+            $predefined_type = 'Type:Defect';
+            foreach ($predefined as $tag) {
+                if (strpos($tag, 'Type:') === 0) {
+                    $predefined_type = explode('=', $tag, 2);
+                    $predefined_type = trim($predefined_type[0]);
+                    break;
+                }
+            }
+            $predefined_priority = 'Priority:Medium';
+            foreach ($predefined as $tag) {
+                if (strpos($tag, 'Priority:') === 0) {
+                    $predefined_priority = explode('=', $tag, 2);
+                    $predefined_priority = trim($predefined_priority[0]);
+                    break;
+                }
+            }
+
             for ($i=1;$i<7;$i++) {
                 $initial = '';
                 switch ($i) {
                 case 1:
-                    $initial = 'Type:Defect';
+                    $initial = $predefined_type;
                     break;
                 case 2:
-                    $initial = 'Priority:Medium';
+                    $initial = $predefined_priority;
                     break;
                 }
                 $this->fields['label'.$i] = new Pluf_Form_Field_Varchar(
@@ -276,6 +306,7 @@ class IDF_Form_IssueCreate extends Pluf_Form
         $comment->create();
         // If we have a file, create the IDF_IssueFile and attach
         // it to the comment.
+        $created_files = array();
         for ($i=1;$i<4;$i++) {
             if ($this->cleaned_data['attachment'.$i]) {
                 $file = new IDF_IssueFile();
@@ -283,8 +314,36 @@ class IDF_Form_IssueCreate extends Pluf_Form
                 $file->submitter = $this->user;
                 $file->comment = $comment;
                 $file->create();
+                $created_files[] = $file;
             }
         }
+        /**
+         * [signal]
+         *
+         * IDF_Issue::create
+         *
+         * [sender]
+         *
+         * IDF_Form_IssueCreate
+         *
+         * [description]
+         *
+         * This signal allows an application to perform a set of tasks
+         * just after the creation of an issue. The comment contains
+         * the description of the issue.
+         *
+         * [parameters]
+         *
+         * array('issue' => $issue,
+         *       'comment' => $comment,
+         *       'files' => $attached_files);
+         *
+         */
+        $params = array('issue' => $issue,
+                        'comment' => $comment,
+                        'files' => $created_files);
+        Pluf_Signal::send('IDF_Issue::create', 'IDF_Form_IssueCreate',
+                          $params);
         return $issue;
     }
 

src/IDF/Form/IssueTrackingConf.php

@@ -31,6 +31,15 @@ class IDF_Form_IssueTrackingConf extends Pluf_Form
      * Defined as constants to easily access the value in the
      * IssueUpdate/Create form in the case nothing is in the db yet.
      */
+    const init_template = 'Steps to reproduce the problem:
+1.
+2.
+3.
+
+Expected result:
+
+Actual result:
+';
     const init_open = 'New                 = Issue has not had initial review yet
 Accepted            = Problem reproduced / Need acknowledged
 Started             = Work on this issue has begun';
@@ -66,6 +75,15 @@ Maintainability      = Hinders future changes';
 
     public function initFields($extra=array())
     {
+        $this->fields['labels_issue_template'] = new Pluf_Form_Field_Varchar(
+                                      array('required' => false,
+                                            'label' => __('Define an issue template to hint to the reporter to provide certain information'),
+                                            'initial' => self::init_template,
+                                            'widget_attrs' => array('rows' => 7,
+                                                                    'cols' => 75),
+                                            'widget' => 'Pluf_Form_Widget_TextareaInput',
+                                            ));
+
         $this->fields['labels_issue_open'] = new Pluf_Form_Field_Varchar(
                                       array('required' => true,
                                             'label' => __('Open issue status values'),
@@ -87,6 +105,7 @@ Maintainability      = Hinders future changes';
                                       array('required' => true,
                                             'label' => __('Predefined issue labels'),
                                             'initial' => self::init_predefined,
+                                            'help_text' => __('The first "Type:" and "Priority:" entries found in this list are automatically chosen as defaults for new issues.'),
                                             'widget_attrs' => array('rows' => 7,
                                                                     'cols' => 75),
                                             'widget' => 'Pluf_Form_Widget_TextareaInput',
@@ -99,8 +118,6 @@ Maintainability      = Hinders future changes';
                                             'widget_attrs' => array('size' => 60),
                                             ));
 
-
-
     }
 }
 

src/IDF/Form/IssueUpdate.php

@@ -305,6 +305,7 @@ class IDF_Form_IssueUpdate  extends IDF_Form_IssueCreate
             $this->issue->submitter != $this->user->id) {
             $this->issue->setAssoc($this->user); // interested user.
         }
+        $attached_files = array();
         for ($i=1;$i<4;$i++) {
             if ($this->cleaned_data['attachment'.$i]) {
                 $file = new IDF_IssueFile();
@@ -312,8 +313,36 @@ class IDF_Form_IssueUpdate  extends IDF_Form_IssueCreate
                 $file->submitter = $this->user;
                 $file->comment = $comment;
                 $file->create();
+                $attached_files[] = $file;
             }
         }
+        /**
+         * [signal]
+         *
+         * IDF_Issue::update
+         *
+         * [sender]
+         *
+         * IDF_Form_IssueUpdate
+         *
+         * [description]
+         *
+         * This signal allows an application to perform a set of tasks
+         * just after the update of an issue.
+         *
+         * [parameters]
+         *
+         * array('issue' => $issue,
+         *       'comment' => $comment,
+         *       'files' => $attached_files);
+         *
+         */
+        $params = array('issue' => $this->issue,
+                        'comment' => $comment,
+                        'files' => $attached_files);
+        Pluf_Signal::send('IDF_Issue::update', 'IDF_Form_IssueUpdate',
+                          $params);
+
         return $this->issue;
     }
 }

src/IDF/Form/MembersConf.php

@@ -101,7 +101,7 @@ class IDF_Form_MembersConf extends Pluf_Form
         $n = count($bad);
         if ($n) {
             $badlogins = Pluf_esc(implode(', ', $bad));
-            throw new Pluf_Form_Invalid(sprintf(_n('The following login is invalid: %s.', 'The following login are invalids: %s.', $n), $badlogins));
+            throw new Pluf_Form_Invalid(sprintf(_n('The following login is invalid: %s.', 'The following logins are invalid: %s.', $n), $badlogins));
         }
         return $logins;
     }

src/IDF/Form/Password.php

@@ -86,7 +86,7 @@ class IDF_Form_Password extends Pluf_Form
                 $return_url = Pluf_HTTP_URL_urlForView('IDF_Views::passwordRecoveryInputCode');
                 $tmpl = new Pluf_Template('idf/user/passrecovery-email.txt');
                 $cr = new Pluf_Crypt(md5(Pluf::f('secret_key')));
-                $code = trim($cr->encrypt($user->email.':'.$user->id.':'.time()), 
+                $code = trim($cr->encrypt($user->email.':'.$user->id.':'.time().':primary'), 
                              '~');
                 $code = substr(md5(Pluf::f('secret_key').$code), 0, 2).$code;
                 $url = Pluf::f('url_base').Pluf_HTTP_URL_urlForView('IDF_Views::passwordRecovery', array($code), array(), false);

src/IDF/Form/Register.php

@@ -42,7 +42,7 @@ class IDF_Form_Register extends Pluf_Form
                                             'max_length' => 15,
                                             'min_length' => 3,
                                             'initial' => $login,
-                                            'help_text' => __('The login must be between 3 and 15 characters long and contains only letters and digits.'),
+                                            'help_text' => __('The login must be between 3 and 15 characters long and contain only letters and digits.'),
                                             'widget_attrs' => array(
                                                        'maxlength' => 15,
                                                        'size' => 10,
@@ -52,7 +52,7 @@ class IDF_Form_Register extends Pluf_Form
                                       array('required' => true,
                                             'label' => __('Your email'),
                                             'initial' => '',
-                                            'help_text' => __('We will never send you any unsolicited emails. We hate spams too!'),
+                                            'help_text' => __('We will never send you any unsolicited emails. We hate spam too!'),
                                             ));
 
         $this->fields['terms'] = new Pluf_Form_Field_Boolean(
@@ -93,10 +93,8 @@ class IDF_Form_Register extends Pluf_Form
     function clean_email()
     {
         $this->cleaned_data['email'] = mb_strtolower(trim($this->cleaned_data['email']));
-        $guser = new Pluf_User();
-        $sql = new Pluf_SQL('email=%s', $this->cleaned_data['email']);
-        if ($guser->getCount(array('filter' => $sql->gen())) > 0) {
-            throw new Pluf_Form_Invalid(sprintf(__('The email "%s" is already used. If you need, click on the help link to recover your password.'), $this->cleaned_data['email']));
+        if (Pluf::factory('IDF_EmailAddress')->get_user_for_email_address($this->cleaned_data['email']) != null) {
+            throw new Pluf_Form_Invalid(sprintf(__('The email "%s" is already used. If you need to, click on the help link to recover your password.'), $this->cleaned_data['email']));
         }
         return $this->cleaned_data['email'];
     }

src/IDF/Form/RegisterConfirmation.php

@@ -69,7 +69,7 @@ class IDF_Form_RegisterConfirmation extends Pluf_Form
                                             'label' => __('Your password'),
                                             'initial' => '',
                                             'widget' => 'Pluf_Form_Widget_PasswordInput',
-                                            'help_text' => __('Your password must be hard for other people to find it, but easy for you to remember.'),
+                                            'help_text' => __('Your password must be hard for other people to guess, but easy for you to remember.'),
                                             'widget_attrs' => array(
                                                        'maxlength' => 50,
                                                        'size' => 15,

src/IDF/Form/ReviewCreate.php

@@ -205,6 +205,30 @@ class IDF_Form_ReviewCreate extends Pluf_Form
         $patch->patch = $this->cleaned_data['patch'];
         $patch->create();
         $patch->notify($this->project->getConf());
+        /**
+         * [signal]
+         *
+         * IDF_Review::create
+         *
+         * [sender]
+         *
+         * IDF_Form_ReviewCreate
+         *
+         * [description]
+         *
+         * This signal allows an application to perform a set of tasks
+         * just after the creation of a review and the notification.
+         *
+         * [parameters]
+         *
+         * array('review' => $review,
+         *       'patch' => $patch);
+         *
+         */
+        $params = array('review' => $review,
+                        'patch' => $patch);
+        Pluf_Signal::send('IDF_Review::create', 'IDF_Form_ReviewCreate',
+                          $params);
         return $review;
     }
 

src/IDF/Form/ReviewFileComment.php

@@ -64,6 +64,8 @@ class IDF_Form_ReviewFileComment extends Pluf_Form
         if ($this->user->hasPerm('IDF.project-owner', $this->project)
             or $this->user->hasPerm('IDF.project-member', $this->project)) {
             $this->show_full = true;
+        } else {
+            $this->show_full = false;
         }
         if ($this->show_full) {
             $this->fields['summary'] = new Pluf_Form_Field_Varchar(

src/IDF/Form/SourceConf.php

@@ -34,7 +34,7 @@ class IDF_Form_SourceConf extends Pluf_Form
     public function initFields($extra=array())
     {
         $this->conf = $extra['conf'];
-        if ($this->conf->getVal('scm', 'git') == 'svn') {
+        if ($extra['remote_svn']) {
             $this->fields['svn_username'] = new Pluf_Form_Field_Varchar(
                     array('required' => false,
                           'label' => __('Repository username'),
@@ -49,6 +49,16 @@ class IDF_Form_SourceConf extends Pluf_Form
                           'widget' => 'Pluf_Form_Widget_PasswordInput',
                           ));
         }
+        Pluf::loadFunction('Pluf_HTTP_URL_urlForView');
+        $url = Pluf_HTTP_URL_urlForView('idf_faq').'#webhooks';
+        $this->fields['webhook_url'] = new Pluf_Form_Field_Url(
+                    array('required' => false,
+                          'label' => __('Webhook URL'),
+                          'initial' => $this->conf->getVal('webhook_url', ''),
+                          'help_text' => sprintf(__('Learn more about the <a href="%s">post-commit web hooks</a>.'), $url),
+                          'widget_attrs' => array('size' => 35),
+                          ));
+
     }
 }
 

src/IDF/Form/TabsConf.php

@@ -63,10 +63,11 @@ class IDF_Form_TabsConf extends Pluf_Form
                     'source_notification_email',
                     'issues_notification_email',);
         foreach ($ak as $key) {
-            $this->fields[$key] = new Pluf_Form_Field_Email(
+            $this->fields[$key] = new IDF_Form_Field_EmailList(
                                       array('required' => false,
                                             'label' => $key,
                                             'initial' => $this->conf->getVal($key, ''),
+                                            'widget_attrs' => array('size' => 40),
                                             ));
         }
 

src/IDF/Form/UpdateUpload.php

@@ -146,6 +146,28 @@ class IDF_Form_UpdateUpload extends Pluf_Form
         $this->upload->modif_dtime = gmdate('Y-m-d H:i:s');
         $this->upload->update();
         $this->upload->batchAssoc('IDF_Tag', $tags);
+        /**
+         * [signal]
+         *
+         * IDF_Upload::update
+         *
+         * [sender]
+         *
+         * IDF_Form_UpdateUpload
+         *
+         * [description]
+         *
+         * This signal allows an application to perform a set of tasks
+         * just after the update of an uploaded file.
+         *
+         * [parameters]
+         *
+         * array('upload' => $upload);
+         *
+         */
+        $params = array('upload' => $this->upload);
+        Pluf_Signal::send('IDF_Upload::update', 
+                          'IDF_Form_UpdateUpload', $params);
         return $this->upload;
     }
 }

src/IDF/Form/Upload.php

@@ -83,7 +83,7 @@ class IDF_Form_Upload extends Pluf_Form
         if (strlen($extra)) $extra .= '|';
         if (!preg_match('/\.('.$extra.'png|jpg|jpeg|gif|bmp|psd|tif|aiff|asf|avi|bz2|css|doc|eps|gz|jar|mdtext|mid|mov|mp3|mpg|ogg|pdf|ppt|ps|qt|ra|ram|rm|rtf|sdd|sdw|sit|sxi|sxw|swf|tgz|txt|wav|xls|xml|war|wmv|zip)$/i', $this->cleaned_data['file'])) {
             @unlink(Pluf::f('upload_path').'/'.$this->project->shortname.'/files/'.$this->cleaned_data['file']);
-            throw new Pluf_Form_Invalid(__('For security reason, you cannot upload a file with this extension.'));
+            throw new Pluf_Form_Invalid(__('For security reasons, you cannot upload a file with this extension.'));
         }
         return $this->cleaned_data['file'];
     }
@@ -176,6 +176,28 @@ class IDF_Form_Upload extends Pluf_Form
         }
         // Send the notification
         $upload->notify($this->project->getConf());
+        /**
+         * [signal]
+         *
+         * IDF_Upload::create
+         *
+         * [sender]
+         *
+         * IDF_Form_Upload
+         *
+         * [description]
+         *
+         * This signal allows an application to perform a set of tasks
+         * just after the upload of a file and after the notification run.
+         *
+         * [parameters]
+         *
+         * array('upload' => $upload);
+         *
+         */
+        $params = array('upload' => $upload);
+        Pluf_Signal::send('IDF_Upload::create', 'IDF_Form_Upload',
+                          $params);
         return $upload;
     }
 }

src/IDF/Form/UserAccount.php

@@ -33,6 +33,8 @@ class IDF_Form_UserAccount  extends Pluf_Form
     public function initFields($extra=array())
     {
         $this->user = $extra['user'];
+        $user_data = IDF_UserData::factory($this->user);
+
         $this->fields['first_name'] = new Pluf_Form_Field_Varchar(
                                       array('required' => false,
                                             'label' => __('First name'),
@@ -77,6 +79,7 @@ class IDF_Form_UserAccount  extends Pluf_Form
                                             'widget' => 'Pluf_Form_Widget_PasswordInput',
                                             'help_text' => Pluf_Template::markSafe(__('Leave blank if you do not want to change your password.').'<br />'.__('Your password must be hard for other people to find it, but easy for you to remember.')),
                                             'widget_attrs' => array(
+                                                       'autocomplete' => 'off',
                                                        'maxlength' => 50,
                                                        'size' => 15,
                                                                     ),
@@ -87,22 +90,117 @@ class IDF_Form_UserAccount  extends Pluf_Form
                                             'initial' => '',
                                             'widget' => 'Pluf_Form_Widget_PasswordInput',
                                             'widget_attrs' => array(
+                                                       'autocomplete' => 'off',
                                                        'maxlength' => 50,
                                                        'size' => 15,
                                                                     ),
                                             ));
 
-        $this->fields['ssh_key'] = new Pluf_Form_Field_Varchar(
+        $this->fields['description'] = new Pluf_Form_Field_Varchar(
                                       array('required' => false,
-                                            'label' => __('Add a public SSH key'),
+                                            'label' => __('Description'),
+                                            'initial' => $user_data->description,
+                                            'widget_attrs' => array('rows' => 3,
+                                                                    'cols' => 40),
+                                            'widget' => 'Pluf_Form_Widget_TextareaInput',
+                                            ));
+
+        $this->fields['twitter'] = new Pluf_Form_Field_Varchar(
+                                      array('required' => false,
+                                            'label' => __('Twitter username'),
+                                            'initial' => $user_data->twitter,
+                                            'widget_attrs' => array(
+                                                       'maxlength' => 50,
+                                                       'size' => 15,
+                                                                    ),
+                                            ));
+
+        $this->fields['public_email'] = new Pluf_Form_Field_Email(
+                                      array('required' => false,
+                                            'label' => __('Public email address'),
+                                            'initial' => $user_data->public_email,
+                                            'widget_attrs' => array(
+                                                       'maxlength' => 50,
+                                                       'size' => 15,
+                                                                    ),
+                                            ));
+
+        $this->fields['website'] = new Pluf_Form_Field_Url(
+                                      array('required' => false,
+                                            'label' => __('Website URL'),
+                                            'initial' => $user_data->website,
+                                            'widget_attrs' => array(
+                                                       'maxlength' => 50,
+                                                       'size' => 15,
+                                                                    ),
+                                            ));
+
+        $this->fields['custom_avatar'] = new Pluf_Form_Field_File(
+                                      array('required' => false,
+                                            'label' => __('Upload custom avatar'),
+                                            'initial' => '',
+                                            'max_size' => Pluf::f('max_upload_size', 2097152),
+                                            'move_function_params' => array('upload_path' => Pluf::f('upload_path').'/avatars',
+                                                                            'upload_path_create' => true,
+                                                                            'upload_overwrite' => true,
+                                                                            'file_name' => 'user_'.$this->user->id.'_%s'),
+                                            'help_text' => __('An image file with a width and height not larger than 60 pixels (bigger images are scaled down).'),
+                                            ));
+
+        $this->fields['remove_custom_avatar'] = new Pluf_Form_Field_Boolean(
+                                      array('required' => false,
+                                            'label' => __('Remove custom avatar'),
+                                            'initial' => false,
+                                            'widget' => 'Pluf_Form_Widget_CheckboxInput',
+                                            'widget_attrs' => array(),
+                                            'help_text' => __('Tick this to delete the custom avatar.'),
+                                            ));
+
+        $this->fields['public_key'] = new Pluf_Form_Field_Varchar(
+                                      array('required' => false,
+                                            'label' => __('Add a public key'),
                                             'initial' => '',
                                             'widget_attrs' => array('rows' => 3,
                                                                     'cols' => 40),
                                             'widget' => 'Pluf_Form_Widget_TextareaInput',
-                                            'help_text' => __('Be careful to provide your public key and not your private key!')
+                                            'help_text' => __('Paste an SSH or monotone public key. Be careful to not provide your private key here!')
                                             ));
 
+        $this->fields['secondary_mail'] = new Pluf_Form_Field_Email(
+                                      array('required' => false,
+                                            'label' => __('Add a secondary mail address'),
+                                            'initial' => '',
+                                            'help_text' => __('You will get a mail to confirm that you own the address you specify.'),
+                                            ));
+    }
 
+    private function send_validation_mail($new_email, $secondary_mail=false)
+    {
+        if ($secondary_mail) {
+            $type = "secondary";
+        } else {
+            $type = "primary";
+        }
+        $cr = new Pluf_Crypt(md5(Pluf::f('secret_key')));
+        $encrypted = trim($cr->encrypt($new_email.':'.$this->user->id.':'.time().':'.$type), '~');
+        $key = substr(md5(Pluf::f('secret_key').$encrypted), 0, 2).$encrypted;
+        $url = Pluf::f('url_base').Pluf_HTTP_URL_urlForView('IDF_Views_User::changeEmailDo', array($key), array(), false);
+        $urlik = Pluf::f('url_base').Pluf_HTTP_URL_urlForView('IDF_Views_User::changeEmailInputKey', array(), array(), false);
+        $context = new Pluf_Template_Context(
+             array('key' => Pluf_Template::markSafe($key),
+                   'url' => Pluf_Template::markSafe($url),
+                   'urlik' => Pluf_Template::markSafe($urlik),
+                   'email' => $new_email,
+                   'user'=> $this->user,
+                   )
+        );
+        $tmpl = new Pluf_Template('idf/user/changeemail-email.txt');
+        $text_email = $tmpl->render($context);
+        $email = new Pluf_Mail(Pluf::f('from_email'), $new_email,
+                               __('Confirm your new email address.'));
+        $email->addTextMessage($text_email);
+        $email->sendMail();
+        $this->user->setMessage(sprintf(__('A validation email has been sent to "%s" to validate the email address change.'), Pluf_esc($new_email)));
     }
 
     /**
@@ -128,39 +226,52 @@ class IDF_Form_UserAccount  extends Pluf_Form
         $new_email = $this->cleaned_data['email'];
         unset($this->cleaned_data['email']);
         if ($old_email != $new_email) {
-            $cr = new Pluf_Crypt(md5(Pluf::f('secret_key')));
-            $encrypted = trim($cr->encrypt($new_email.':'.$this->user->id.':'.time()), '~');
-            $key = substr(md5(Pluf::f('secret_key').$encrypted), 0, 2).$encrypted;
-            $url = Pluf::f('url_base').Pluf_HTTP_URL_urlForView('IDF_Views_User::changeEmailDo', array($key), array(), false);
-            $urlik = Pluf::f('url_base').Pluf_HTTP_URL_urlForView('IDF_Views_User::changeEmailInputKey', array(), array(), false);
-            $context = new Pluf_Template_Context(
-                 array('key' => Pluf_Template::markSafe($key),
-                       'url' => Pluf_Template::markSafe($url),
-                       'urlik' => Pluf_Template::markSafe($urlik),
-                       'email' => $new_email,
-                       'user'=> $this->user,
-                       )
-                                                 );
-            $tmpl = new Pluf_Template('idf/user/changeemail-email.txt');
-            $text_email = $tmpl->render($context);
-            $email = new Pluf_Mail(Pluf::f('from_email'), $new_email,
-                                   __('Confirm your new email address.'));
-            $email->addTextMessage($text_email);
-            $email->sendMail();
-            $this->user->setMessage(sprintf(__('A validation email has been sent to "%s" to validate the email address change.'), Pluf_esc($new_email)));
+            $this->send_validation_mail($new_email);
         }
         $this->user->setFromFormData($this->cleaned_data);
         // Add key as needed.
-        if ('' !== $this->cleaned_data['ssh_key']) {
+        if ('' !== $this->cleaned_data['public_key']) {
             $key = new IDF_Key();
             $key->user = $this->user;
-            $key->content = $this->cleaned_data['ssh_key'];
+            $key->content = $this->cleaned_data['public_key'];
             if ($commit) {
                 $key->create();
             }
         }
+        if ('' !== $this->cleaned_data['secondary_mail']) {
+            $this->send_validation_mail($this->cleaned_data['secondary_mail'], true);
+        }
+
         if ($commit) {
             $this->user->update();
+
+            // FIXME: go the extra mile and check the input lengths for
+            // all fields here!
+            // FIXME: this is all doubled in admin/UserUpdate!
+
+            $user_data = IDF_UserData::factory($this->user);
+
+            // Add or remove avatar - we need to do this here because every
+            // single setter directly leads to a save in the database
+            if ($user_data->avatar != '' &&
+                    ($this->cleaned_data['remove_custom_avatar'] == 1 ||
+                     $this->cleaned_data['custom_avatar'] != '')) {
+                $avatar_path = Pluf::f('upload_path').'/avatars/'.basename($user_data->avatar);
+                if (basename($avatar_path) != '' && is_file($avatar_path)) {
+                    unlink($avatar_path);
+                }
+                $user_data->avatar = '';
+            }
+
+            if ($this->cleaned_data['custom_avatar'] != '') {
+                $user_data->avatar = $this->cleaned_data['custom_avatar'];
+            }
+
+            $user_data->description  = $this->cleaned_data['description'];
+            $user_data->twitter      = $this->cleaned_data['twitter'];
+            $user_data->public_email = $this->cleaned_data['public_email'];
+            $user_data->website      = $this->cleaned_data['website'];
+
             if ($update_pass) {
                 /**
                  * [signal]
@@ -190,7 +301,7 @@ class IDF_Form_UserAccount  extends Pluf_Form
     }
 
     /**
-     * Check an ssh key.
+     * Check arbitrary public keys.
      *
      * It will throw a Pluf_Form_Invalid exception if it cannot
      * validate the key.
@@ -199,27 +310,59 @@ class IDF_Form_UserAccount  extends Pluf_Form
      * @param $user int The user id of the user of the key (0)
      * @return string The clean key
      */
-    public static function checkSshKey($key, $user=0)
+    public static function checkPublicKey($key, $user=0)
     {
         $key = trim($key);
         if (strlen($key) == 0) {
             return '';
         }
+
+        if (preg_match('#^ssh\-[a-z]{3}\s\S+(\s\S+)?$#', $key)) {
             $key = str_replace(array("\n", "\r"), '', $key);
-        if (!preg_match('#^ssh\-[a-z]{3}\s(\S+)\s\S+$#', $key, $matches)) {
-            throw new Pluf_Form_Invalid(__('The format of the key is not valid. It must start with ssh-dss or ssh-rsa, a long string on a single line and at the end a comment.'));
-        }
+
             if (Pluf::f('idf_strong_key_check', false)) {
+
                 $tmpfile = Pluf::f('tmp_folder', '/tmp').'/'.$user.'-key';
                 file_put_contents($tmpfile, $key, LOCK_EX);
                 $cmd = Pluf::f('idf_exec_cmd_prefix', '').
                     'ssh-keygen -l -f '.escapeshellarg($tmpfile).' > /dev/null 2>&1';
                 exec($cmd, $out, $return);
                 unlink($tmpfile);
+
                 if ($return != 0) {
-                throw new Pluf_Form_Invalid(__('Please check the key as it does not appears to be a valid key.'));
+                    throw new Pluf_Form_Invalid(
+                        __('Please check the key as it does not appear '.
+                           'to be a valid SSH public key.')
+                    );
                 }
             }
+        }
+        else if (preg_match('#^\[pubkey [^\]]+\]\s*\S+\s*\[end\]$#', $key)) {
+            if (Pluf::f('idf_strong_key_check', false)) {
+
+                // if monotone can read it, it should be valid
+                $mtn_opts = implode(' ', Pluf::f('mtn_opts', array()));
+                $cmd = Pluf::f('idf_exec_cmd_prefix', '').
+                    sprintf('%s %s -d :memory: read >/tmp/php-out 2>&1',
+                            Pluf::f('mtn_path', 'mtn'), $mtn_opts);
+                $fp = popen($cmd, 'w');
+                fwrite($fp, $key);
+                $return = pclose($fp);
+
+                if ($return != 0) {
+                       throw new Pluf_Form_Invalid(
+                        __('Please check the key as it does not appear '.
+                           'to be a valid monotone public key.')
+                    );
+                }
+            }
+        }
+        else {
+            throw new Pluf_Form_Invalid(
+                __('Public key looks like neither an SSH '.
+                   'nor monotone public key.'));
+        }
+
         // If $user, then check if not the same key stored
         if ($user) {
             $ruser = Pluf::factory('Pluf_User', $user);
@@ -227,18 +370,27 @@ class IDF_Form_UserAccount  extends Pluf_Form
                 $sql = new Pluf_SQL('content=%s', array($key));
                 $keys = Pluf::factory('IDF_Key')->getList(array('filter' => $sql->gen()));
                 if (count($keys) > 0) {
-                    throw new Pluf_Form_Invalid(__('You already have uploaded this SSH key.'));
+                    throw new Pluf_Form_Invalid(
+                        __('You already have uploaded this key.')
+                    );
                 }
             }
         }
         return $key;
     }
 
-    function clean_ssh_key()
+
+    function clean_custom_avatar()
     {
-        return self::checkSshKey($this->cleaned_data['ssh_key'], 
-                                 $this->user->id);
+        // Just png, jpeg/jpg or gif
+        if (!preg_match('/\.(png|jpg|jpeg|gif)$/i', $this->cleaned_data['custom_avatar']) &&
+            $this->cleaned_data['custom_avatar'] != '') {
+            @unlink(Pluf::f('upload_path').'/avatars/'.$this->cleaned_data['custom_avatar']);
+            throw new Pluf_Form_Invalid(__('For security reason, you cannot upload a file with this extension.'));
         }
+        return $this->cleaned_data['custom_avatar'];
+    }
+
 
     function clean_last_name()
     {
@@ -263,17 +415,32 @@ class IDF_Form_UserAccount  extends Pluf_Form
     function clean_email()
     {
         $this->cleaned_data['email'] = mb_strtolower(trim($this->cleaned_data['email']));
-        $guser = new Pluf_User();
-        $sql = new Pluf_SQL('email=%s AND id!=%s', 
-                            array($this->cleaned_data['email'], $this->user->id));
-        if ($guser->getCount(array('filter' => $sql->gen())) > 0) {
+        $user = Pluf::factory('IDF_EmailAddress')->get_user_for_email_address($this->cleaned_data['email']);
+        if ($user != null and $user->id != $this->user->id) {
             throw new Pluf_Form_Invalid(sprintf(__('The email "%s" is already used.'), $this->cleaned_data['email']));
         }
         return $this->cleaned_data['email'];
     }
 
+    function clean_secondary_mail()
+    {
+        $this->cleaned_data['secondary_mail'] = mb_strtolower(trim($this->cleaned_data['secondary_mail']));
+        if (Pluf::factory('IDF_EmailAddress')->get_user_for_email_address($this->cleaned_data['secondary_mail']) != null) {
+            throw new Pluf_Form_Invalid(sprintf(__('The email "%s" is already used.'), $this->cleaned_data['secondary_mail']));
+        }
+        return $this->cleaned_data['secondary_mail'];
+    }
+
+    function clean_public_key()
+    {
+        $this->cleaned_data['public_key'] =
+                self::checkPublicKey($this->cleaned_data['public_key'],
+                                     $this->user->id);
+        return $this->cleaned_data['public_key'];
+    }
+
     /**
-     * Check to see if the 2 passwords are the same.
+     * Check to see if the 2 passwords are the same
      */
     public function clean()
     {
@@ -285,6 +452,9 @@ class IDF_Form_UserAccount  extends Pluf_Form
                 throw new Pluf_Form_Invalid(__('The passwords do not match. Please give them again.'));
             }
         }
+
         return $this->cleaned_data;
     }
+
+
 }

src/IDF/Form/UserChangeEmail.php

@@ -53,7 +53,7 @@ class IDF_Form_UserChangeEmail extends Pluf_Form
      * Throw a Pluf_Form_Invalid exception if the key is not valid.
      *
      * @param string Key
-     * @return array array($new_email, $user_id, time())
+     * @return array array($new_email, $user_id, time(), [primary|secondary])
      */
     public static function validateKey($key)
     {
@@ -63,7 +63,7 @@ class IDF_Form_UserChangeEmail extends Pluf_Form
             throw new Pluf_Form_Invalid(__('The validation key is not valid. Please copy/paste it from your confirmation email.'));
         }
         $cr = new Pluf_Crypt(md5(Pluf::f('secret_key')));
-        return explode(':', $cr->decrypt($encrypted), 3);
+        return explode(':', $cr->decrypt($encrypted), 4);
         
     }
 

src/IDF/Gconf.php

@@ -0,0 +1,210 @@
+<?php
+/* -*- tab-width: 4; indent-tabs-mode: nil; c-basic-offset: 4 -*- */
+/*
+# ***** BEGIN LICENSE BLOCK *****
+# This file is part of InDefero, an open source project management application.
+# Copyright (C) 2008 Céondo Ltd and contributors.
+#
+# InDefero is free software; you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation; either version 2 of the License, or
+# (at your option) any later version.
+#
+# InDefero is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write to the Free Software
+# Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA  02110-1301  USA
+#
+# ***** END LICENSE BLOCK ***** */
+
+/**
+ * Configuration of the objects.
+ *
+ * It is just storing a list of key/value pairs associated to
+ * different objects. If you use this table for your model, do not
+ * forget to drop the corresponding keys in your preDelete call.
+ */
+class IDF_Gconf extends Pluf_Model
+{
+    public $_model = __CLASS__;
+    public $datacache = null;
+    public $dirty = array();
+    public $f = null;
+    protected $_mod = null;
+    /**
+     * Do we (un)serialize the data when getting/setting them.
+     */
+    public $serialize = false;
+
+    function init()
+    {
+        $this->_a['table'] = 'idf_gconf';
+        $this->_a['model'] = __CLASS__;
+        $this->_a['cols'] = array(
+                             // It is mandatory to have an "id" column.
+                            'id' =>
+                            array(
+                                  'type' => 'Pluf_DB_Field_Sequence',
+                                  //It is automatically added.
+                                  'blank' => true,
+                                  ),
+                            'model_class' =>
+                            array(
+                                  'type' => 'Pluf_DB_Field_Varchar',
+                                  'blank' => false,
+                                  'size' => 150,
+                                  'verbose' => __('model class'),
+                                  ),
+                            'model_id' =>
+                            array(
+                                  'type' => 'Pluf_DB_Field_Integer',
+                                  'blank' => false,
+                                  'verbose' => __('model id'),
+                                  ),
+                            'vkey' =>
+                            array(
+                                  'type' => 'Pluf_DB_Field_Varchar',
+                                  'blank' => false,
+                                  'size' => 50,
+                                  'verbose' => __('key'),
+                                  ),
+                            'vdesc' =>
+                            array(
+                                  'type' => 'Pluf_DB_Field_Text',
+                                  'blank' => false,
+                                  'verbose' => __('value'),
+                                  ),
+                            );
+        $this->_a['idx'] = array('model_vkey_idx' =>
+                                 array(
+                                       'col' => 'model_class, model_id, vkey',
+                                       'type' => 'unique',
+                                       ),
+                                 );
+        $this->f = new IDF_Config_DataProxy($this);
+    }
+
+    function setModel($model)
+    {
+        $this->datacache = null;
+        $this->_mod = $model;
+    }
+
+    function initCache()
+    {
+        $this->datacache = array();
+        $this->dirty = array();
+        $sql = new Pluf_SQL('model_class=%s AND model_id=%s',
+                            array($this->_mod->_model, $this->_mod->id));
+        foreach ($this->getList(array('filter' => $sql->gen())) as $val) {
+            $this->datacache[$val->vkey] = ($this->serialize) ? unserialize($val->vdesc) : $val->vdesc;
+            $this->dirty[$val->vkey] = $val->id;
+        }
+    }
+
+    /**
+     * FIXME: This is not efficient when setting a large number of
+     * values in a loop.
+     */
+    function setVal($key, $value)
+    {
+        if (!is_null($this->getVal($key, null))
+            and $value == $this->getVal($key)) {
+            return;
+        }
+        $svalue = ($this->serialize) ? serialize($value) : $value;
+        if (isset($this->dirty[$key])) {
+            // we get to check if deleted by other process + update
+            $conf = new IDF_Gconf($this->dirty[$key]);
+            if ($conf->id == $this->dirty[$key]) {
+                $conf->vdesc = $svalue;
+                $conf->update();
+                $this->datacache[$key] = $value;
+                return;
+            }
+        }
+        // we insert
+        $conf = new IDF_Gconf();
+        $conf->model_class = $this->_mod->_model;
+        $conf->model_id = $this->_mod->id;
+        $conf->vkey = $key;
+        $conf->vdesc = $svalue;
+        $conf->create();
+        $this->datacache[$key] = $value;
+        $this->dirty[$key] = $conf->id;
+    }
+
+    function getVal($key, $default='')
+    {
+        if ($this->datacache === null) {
+            $this->initCache();
+        }
+        return (isset($this->datacache[$key])) ? $this->datacache[$key] : $default;
+    }
+
+    function delVal($key, $initcache=true)
+    {
+        $gconf = new IDF_Gconf();
+        $sql = new Pluf_SQL('vkey=%s AND model_class=%s AND model_id=%s', array($key, $this->_mod->_model, $this->_mod->id));
+        foreach ($gconf->getList(array('filter' => $sql->gen())) as $c) {
+            $c->delete();
+        }
+        if ($initcache) {
+            $this->initCache();
+        }
+    }
+
+    /**
+     * Collection selection.
+     *
+     * Suppose you have 5 objects with associated meta data in the
+     * Gconf storage, if you load the data independently for each
+     * object, you end up with 5 SELECT queries. With 25 objects, 25
+     * SELECT. You can select with one query all the data and merge in
+     * the code. It is faster. The collection selection get a
+     * model_class and a list of ids and returns an id indexed array
+     * of associative array data. This is for read only access as you
+     * do not get a series of Gconf objects.
+     */
+    public static function collect($class, $ids)
+    {
+        $gconf = new IDF_Gconf();
+        $stmpl = sprintf('model_class=%%s AND model_id IN (%s)', 
+                         implode(',' , $ids));
+        $sql = new Pluf_SQL($stmpl, array($class));
+        $out = array_fill_keys($ids, array());
+        foreach ($gconf->getList(array('filter' => $sql->gen())) as $c) {
+            $out[$c->model_id][$c->vkey] = $c->vdesc;
+        }
+
+        return $out;
+    }
+
+    /**
+     * Drop the conf of a model.
+     *
+     * If your model is using this table, just add the following line
+     * in your preDelete() method:
+     *
+     * IDF_Gconf::dropForModel($this)
+     *
+     * It will take care of the cleaning.
+     */
+    static public function dropForModel($model)
+    {
+        $table = Pluf::factory(__CLASS__)->getSqlTable();
+        $sql = new Pluf_SQL('model_class=%s AND model_id=%s',
+                            array($model->_model, $model->id));
+        $db = &Pluf::db();
+        $db->execute('DELETE FROM '.$table.' WHERE '.$sql->gen());
+    }
+
+    static public function dropUser($signal, &$params)
+    {
+        self::dropForModel($params['user']);
+    }
+}

src/IDF/Issue.php

@@ -242,8 +242,10 @@ class IDF_Issue extends Pluf_Model
         $to_email = array();
         if ('' != $conf->getVal('issues_notification_email', '')) {
             $langs     = Pluf::f('languages', array('en'));
-            $to_email[] = array($conf->getVal('issues_notification_email'),
-                                $langs[0]);
+            $addresses = explode(',', $conf->getVal('issues_notification_email'));
+            foreach ($addresses as $address) {
+                $to_email[] = array($address, $langs[0]);
+            }
         }
         $current_locale = Pluf_Translation::getLocale();
         $id = '<'.md5($this->id.md5(Pluf::f('secret_key'))).'@'.Pluf::f('mail_host', 'localhost').'>';

src/IDF/IssueComment.php

@@ -196,4 +196,9 @@ class IDF_IssueComment extends Pluf_Model
         $tmpl = new Pluf_Template('idf/issues/feedfragment.xml');
         return $tmpl->render($context);
     }
+
+    public function get_submitter_data()
+    {
+        return IDF_UserData::factory($this->get_submitter());
+    }
 }

src/IDF/IssueFile.php

@@ -128,4 +128,10 @@ class IDF_IssueFile extends Pluf_Model
     {
         @unlink(Pluf::f('upload_issue_path').'/'.$this->attachment);
     }
+
+    function isText()
+    {
+        $info = IDF_FileUtil::getMimeType($this->filename);
+        return IDF_FileUtil::isText($info);
+    }
 }

src/IDF/Key.php

@@ -22,7 +22,7 @@
 # ***** END LICENSE BLOCK ***** */
 
 /**
- * Storage of the SSH keys.
+ * Storage of the public keys (ssh or monotone).
  *
  */
 class IDF_Key extends Pluf_Model
@@ -52,7 +52,7 @@ class IDF_Key extends Pluf_Model
                             array(
                                   'type' => 'Pluf_DB_Field_Text',
                                   'blank' => false,
-                                  'verbose' => __('ssh key'),
+                                  'verbose' => __('public key'),
                                   ),
                             );
         // WARNING: Not using getSqlTable on the Pluf_User object to
@@ -75,6 +75,61 @@ class IDF_Key extends Pluf_Model
         return Pluf_Template::markSafe(Pluf_esc(substr($this->content, 0, 25)).' [...] '.Pluf_esc(substr($this->content, -55)));
     }
 
+    private function parseContent()
+    {
+        if (preg_match('#^\[pubkey ([^\]]+)\]\s*(\S+)\s*\[end\]$#', $this->content, $m)) {
+            return array('mtn', $m[1], $m[2]);
+        }
+        else if (preg_match('#^ssh\-[a-z]{3}\s(\S+)(?:\s(\S*))?$#', $this->content, $m)) {
+            if (!isset($m[2])) {
+                $m[2] = "";
+            }
+            return array('ssh', $m[2], $m[1]);
+        }
+
+        throw new Exception(__('Invalid or unknown key data detected.'));
+    }
+
+    /**
+     * Returns the type of the public key
+     *
+     * @return string 'ssh' or 'mtn'
+     */
+    function getType()
+    {
+        list($type, , ) = $this->parseContent();
+        return $type;
+    }
+
+    /**
+     * Returns the key name of the key
+     *
+     * @return string
+     */
+    function getName()
+    {
+        list(, $keyName, ) = $this->parseContent();
+        return $keyName;
+    }
+
+    /**
+     * This function should be used to calculate the key id from the
+     * public key hash for authentication purposes. This avoids clashes
+     * in case the key name is not unique across the project
+     *
+     * And yes, this is actually how monotone itself calculates the key
+     * id...
+     *
+     * @return string
+     */
+    function getMtnId()
+    {
+        list($type, $keyName, $keyData) = $this->parseContent();
+        if ($type != 'mtn')
+            throw new Exception('key is not a monotone public key');
+        return sha1($keyName.":".$keyData);
+    }
+
     function postSave($create=false)
     {
         /**
@@ -89,7 +144,7 @@ class IDF_Key extends Pluf_Model
          * [description]
          *
          * This signal allows an application to perform special
-         * operations after the saving of a SSH Key.
+         * operations after the saving of a public Key.
          *
          * [parameters]
          *
@@ -127,5 +182,4 @@ class IDF_Key extends Pluf_Model
         Pluf_Signal::send('IDF_Key::preDelete',
                           'IDF_Key', $params);
     }
-
 }

src/IDF/Middleware.php

@@ -87,11 +87,13 @@ class IDF_Middleware
                               'markdown' => 'IDF_Template_Markdown',
                               'showuser' => 'IDF_Template_ShowUser',
                               'ashowuser' => 'IDF_Template_AssignShowUser',
+                              'appversion' => 'IDF_Template_AppVersion',
                                             ));
         $params['modifiers'] = array_merge($params['modifiers'],
                                            array(
                                    'size' => 'IDF_Views_Source_PrettySize',
                                    'ssize' => 'IDF_Views_Source_PrettySizeSimple',
+                                   'shorten' => 'IDF_Views_Source_ShortenString',
                                                  ));
     }
 }
@@ -110,6 +112,8 @@ function IDF_Middleware_ContextPreProcessor($request)
                                                  $request->project);
         $c = array_merge($c, $request->rights);
     }
+    $c['usherConfigured'] = Pluf::f("mtn_usher_conf", null) !== null;
+    $c['allProjects'] = IDF_Views::getProjects($request->user);
     return $c;
 }
 

src/IDF/Migrations/14Queue.php

@@ -0,0 +1,53 @@
+<?php
+/* -*- tab-width: 4; indent-tabs-mode: nil; c-basic-offset: 4 -*- */
+/*
+# ***** BEGIN LICENSE BLOCK *****
+# This file is part of InDefero, an open source project management application.
+# Copyright (C) 2008 Céondo Ltd and contributors.
+#
+# InDefero is free software; you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation; either version 2 of the License, or
+# (at your option) any later version.
+#
+# InDefero is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write to the Free Software
+# Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA  02110-1301  USA
+#
+# ***** END LICENSE BLOCK ***** */
+
+/**
+ * Add the new IDF_Queue model.
+ *
+ */
+
+function IDF_Migrations_14Queue_up($params=null)
+{
+    $models = array(
+                    'IDF_Queue',
+                    );
+    $db = Pluf::db();
+    $schema = new Pluf_DB_Schema($db);
+    foreach ($models as $model) {
+        $schema->model = new $model();
+        $schema->createTables();
+    }
+}
+
+function IDF_Migrations_14Queue_down($params=null)
+{
+    $models = array(
+                    'IDF_Queue',
+                    );
+    $db = Pluf::db();
+    $schema = new Pluf_DB_Schema($db);
+    foreach ($models as $model) {
+        $schema->model = new $model();
+        $schema->dropTables();
+    }
+}

src/IDF/Migrations/15AddGconf.php

@@ -0,0 +1,53 @@
+<?php
+/* -*- tab-width: 4; indent-tabs-mode: nil; c-basic-offset: 4 -*- */
+/*
+# ***** BEGIN LICENSE BLOCK *****
+# This file is part of InDefero, an open source project management application.
+# Copyright (C) 2008 Céondo Ltd and contributors.
+#
+# InDefero is free software; you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation; either version 2 of the License, or
+# (at your option) any later version.
+#
+# InDefero is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write to the Free Software
+# Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA  02110-1301  USA
+#
+# ***** END LICENSE BLOCK ***** */
+
+/**
+ * Add the new IDF_Gconf model.
+ *
+ */
+
+function IDF_Migrations_15AddGconf_up($params=null)
+{
+    $models = array(
+                    'IDF_Gconf',
+                    );
+    $db = Pluf::db();
+    $schema = new Pluf_DB_Schema($db);
+    foreach ($models as $model) {
+        $schema->model = new $model();
+        $schema->createTables();
+    }
+}
+
+function IDF_Migrations_15AddGconf_down($params=null)
+{
+    $models = array(
+                    'IDF_Gconf',
+                    );
+    $db = Pluf::db();
+    $schema = new Pluf_DB_Schema($db);
+    foreach ($models as $model) {
+        $schema->model = new $model();
+        $schema->dropTables();
+    }
+}

src/IDF/Migrations/16AddUserMail.php

@@ -0,0 +1,43 @@
+<?php
+/* -*- tab-width: 4; indent-tabs-mode: nil; c-basic-offset: 4 -*- */
+/*
+# ***** BEGIN LICENSE BLOCK *****
+# This file is part of InDefero, an open source project management application.
+# Copyright (C) 2008 Céondo Ltd and contributors.
+#
+# InDefero is free software; you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation; either version 2 of the License, or
+# (at your option) any later version.
+#
+# InDefero is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write to the Free Software
+# Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA  02110-1301  USA
+#
+# ***** END LICENSE BLOCK ***** */
+
+/**
+ * Add the new IDF_Gconf model.
+ *
+ */
+
+function IDF_Migrations_16AddUserMail_up($params=null)
+{
+    $db = Pluf::db();
+    $schema = new Pluf_DB_Schema($db);
+    $schema->model = new IDF_EmailAddress();
+    $schema->createTables();
+}
+
+function IDF_Migrations_16AddUserMail_down($params=null)
+{
+    $db = Pluf::db();
+    $schema = new Pluf_DB_Schema($db);
+    $schema->model = new IDF_EmailAddress();
+    $schema->dropTables();
+}

src/IDF/Migrations/Backup.php

@@ -51,6 +51,9 @@ function IDF_Migrations_Backup_run($folder, $name=null)
                     'IDF_Review_FileComment',
                     'IDF_Key',
                     'IDF_Scm_Cache_Git',
+                    'IDF_Queue',
+                    'IDF_Gconf',
+                    'IDF_EmailAddress',
                     );
     $db = Pluf::db();
     // Now, for each table, we dump the content in json, this is a
@@ -94,6 +97,9 @@ function IDF_Migrations_Backup_restore($folder, $name)
                     'IDF_Review_FileComment',
                     'IDF_Key',
                     'IDF_Scm_Cache_Git',
+                    'IDF_Queue',
+                    'IDF_Gconf',
+                    'IDF_EmailAddress',
                     );
     $db = Pluf::db();
     $schema = new Pluf_DB_Schema($db);

src/IDF/Migrations/Install.php

@@ -48,6 +48,9 @@ function IDF_Migrations_Install_setup($params=null)
                     'IDF_Review_FileComment',
                     'IDF_Key',
                     'IDF_Scm_Cache_Git',
+                    'IDF_Queue',
+                    'IDF_Gconf',
+                    'IDF_EmailAddress',
                     );
     $db = Pluf::db();
     $schema = new Pluf_DB_Schema($db);
@@ -85,6 +88,8 @@ function IDF_Migrations_Install_teardown($params=null)
     $perm = Pluf_Permission::getFromString('IDF.project-authorized-user');
     if ($perm) $perm->delete();
     $models = array(
+                    'IDF_Gconf',
+                    'IDF_Queue',
                     'IDF_Scm_Cache_Git',
                     'IDF_Key',
                     'IDF_Review_FileComment',
@@ -103,6 +108,7 @@ function IDF_Migrations_Install_teardown($params=null)
                     'IDF_Tag',
                     'IDF_Commit',
                     'IDF_Project',
+                    'IDF_EmailAddress',
                     );
     $db = Pluf::db();
     $schema = new Pluf_DB_Schema($db);

src/IDF/Plugin/SyncGit/Cron.php

@@ -48,8 +48,13 @@ class IDF_Plugin_SyncGit_Cron
         $out = '';
         $keys = Pluf::factory('IDF_Key')->getList(array('view'=>'join_user'));
         foreach ($keys as $key) {
-            if (strlen($key->content) > 40 // minimal check
-                and preg_match('/^[a-zA-Z][a-zA-Z0-9_.-]*(@[a-zA-Z][a-zA-Z0-9.-]*)?$/', $key->login)) {
+            try {
+                $key_type = $key->getType();
+            } catch (Exception $e) {
+                // The key is a bad key, skip it
+                continue;
+            }
+            if ($key_type == 'ssh' and preg_match('/^[a-zA-Z][a-zA-Z0-9_.-]*(@[a-zA-Z][a-zA-Z0-9.-]*)?$/', $key->login)) {
                 $content = trim(str_replace(array("\n", "\r"), '', $key->content));
                 $out .= sprintf($template, $cmd, $key->login, $content)."\n";
             }
@@ -99,6 +104,7 @@ class IDF_Plugin_SyncGit_Cron
         if (count($orphans)) {
             $cmd = Pluf::f('idf_exec_cmd_prefix', '').'rm -rf '.implode(' ', $orphans);
             exec($cmd);
+            clearstatcache();
             while (list(, $project) = each($orphans)) {
                 if (is_dir($project)) {
                     throw new Exception(sprintf('Cannot remove %s directory.', $project));

src/IDF/Plugin/SyncGit/Serve.php

@@ -196,6 +196,8 @@ class IDF_Plugin_SyncGit_Serve
         if (!file_exists($fullpath)) {
             mkdir($fullpath, 0750, true);
         }
+        $out = array();
+        $res = 0;
         exec(sprintf(Pluf::f('idf_exec_cmd_prefix', '').
                      Pluf::f('git_path', 'git').' --git-dir=%s init', escapeshellarg($fullpath)), 
              $out, $res);
@@ -214,6 +216,8 @@ class IDF_Plugin_SyncGit_Serve
                                  $fullpath.'/hooks/post-update'));
             return;
         }
+        $out = array();
+        $res = 0;
         exec(sprintf(Pluf::f('idf_exec_cmd_prefix', '').'ln -s %s %s', 
                      escapeshellarg($p), 
                      escapeshellarg($fullpath.'/hooks/post-update')),
@@ -226,6 +230,24 @@ class IDF_Plugin_SyncGit_Serve
         }
         Pluf_Log::debug(array('IDF_Plugin_Git_Serve::initRepository', 
                               'Added post-update hook.', $fullpath));
+        // Configure the core.quotepath option
+        $quotepath = (Pluf::f('git_core_quotepath', true) == true) ? 'true' : 'false';
+        $out = array();
+        $res = 0;
+        exec(sprintf(Pluf::f('idf_exec_cmd_prefix', '').
+                     Pluf::f('git_path', 'git').' config -f %s/config --add core.quotepath %s',
+                     escapeshellarg($fullpath),
+                     escapeshellarg($quotepath)
+                    ),
+             $out, $res);
+        if ($res != 0) {
+            Pluf_Log::warn(array('IDF_Plugin_Git_Serve::initRepository', 
+                                 'core.quotepath configuration error.', 
+                                 $quotepath));
+            return;
+        }
+        Pluf_Log::debug(array('IDF_Plugin_Git_Serve::initRepository', 
+                              'core.quotepath configured.', $quotepath));
     }
 
     /**

src/IDF/Plugin/SyncMonotone.php

@@ -0,0 +1,830 @@
+<?php
+/* -*- tab-width: 4; indent-tabs-mode: nil; c-basic-offset: 4 -*- */
+/*
+# ***** BEGIN LICENSE BLOCK *****
+# This file is part of InDefero, an open source project management application.
+# Copyright (C) 2010 Céondo Ltd and contributors.
+#
+# InDefero is free software; you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation; either version 2 of the License, or
+# (at your option) any later version.
+#
+# InDefero is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write to the Free Software
+# Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA  02110-1301  USA
+#
+# ***** END LICENSE BLOCK ***** */
+
+/**
+ * This classes is a plugin which allows to synchronise access rights
+ * between indefero and monotone usher setups.
+ */
+class IDF_Plugin_SyncMonotone
+{
+    /**
+     * Entry point of the plugin.
+     */
+    static public function entry($signal, &$params)
+    {
+        $plug = new IDF_Plugin_SyncMonotone();
+        switch ($signal) {
+        case 'IDF_Project::created':
+            $plug->processProjectCreate($params['project']);
+            break;
+        case 'IDF_Project::membershipsUpdated':
+            $plug->processMembershipsUpdated($params['project']);
+            break;
+        case 'IDF_Project::preDelete':
+            $plug->processProjectDelete($params['project']);
+            break;
+        case 'IDF_Key::postSave':
+            $plug->processKeyCreate($params['key']);
+            break;
+        case 'IDF_Key::preDelete':
+            $plug->processKeyDelete($params['key']);
+            break;
+        case 'mtnpostpush.php::run':
+            $plug->processSyncTimeline($params['project']);
+            break;
+        }
+    }
+
+    /**
+     * Initial steps to setup a new monotone project:
+     *
+     *  1) run mtn db init to initialize a new database underknees
+     *     'mtn_repositories'
+     *  2) create a new server key in the same directory
+     *  3) create a new client key for IDF and store it in the project conf
+     *  4) setup the configuration
+     *  5) add the database as new local server in the usher configuration
+     *  6) reload the running usher instance so it acknowledges the new server
+     *
+     * The initial right setup happens in processMembershipsUpdated()
+     *
+     * @param IDF_Project
+     */
+    function processProjectCreate($project)
+    {
+        if ($project->getConf()->getVal('scm') != 'mtn') {
+            return;
+        }
+
+        if (Pluf::f('mtn_db_access', 'local') == 'local') {
+            return;
+        }
+
+        $projecttempl = Pluf::f('mtn_repositories', false);
+        if ($projecttempl === false) {
+            throw new IDF_Scm_Exception(
+                 __('"mtn_repositories" must be defined in your configuration file.')
+            );
+        }
+
+        $usher_config = Pluf::f('mtn_usher_conf', false);
+        if (!$usher_config || !is_writable($usher_config)) {
+            throw new IDF_Scm_Exception(
+                 __('"mtn_usher_conf" does not exist or is not writable.')
+            );
+        }
+
+        $mtnpostpush = realpath(dirname(__FILE__) . '/../../../scripts/mtn-post-push');
+        if (!file_exists($mtnpostpush)) {
+            throw new IDF_Scm_Exception(sprintf(
+                __('Could not find mtn-post-push script "%s".'), $mtnpostpush
+            ));
+        }
+
+        // check some static configuration files
+        $confdir = Pluf::f('mtn_confdir', false);
+        if ($confdir === false) {
+            $confdir = dirname(__FILE__).'/SyncMonotone/';
+        }
+        $confdir_contents = array(
+             'monotonerc.in',
+             'remote-automate-permissions.in',
+             'hooks.d/',
+             // this is linked and not copied to be able to update
+             // the list of read-only commands on upgrades
+             'hooks.d/indefero_authorize_remote_automate.conf',
+             'hooks.d/indefero_authorize_remote_automate.lua',
+             'hooks.d/indefero_post_push.conf.in',
+             'hooks.d/indefero_post_push.lua',
+        );
+        if (!$project->private) {
+            // this is linked and not copied to be able to update
+            // the list of read-only commands on upgrades
+            $confdir_contents[] = 'hooks.d/indefero_authorize_remote_automate.conf';
+        }
+
+        // check whether we should handle additional files in the config directory
+        $confdir_extra_contents = Pluf::f('mtn_confdir_extra', false);
+        if ($confdir_extra_contents !== false) {
+            $confdir_contents =
+                array_merge($confdir_contents, $confdir_extra_contents);
+        }
+        foreach ($confdir_contents as $content) {
+            if (!file_exists($confdir.$content)) {
+                throw new IDF_Scm_Exception(sprintf(
+                    __('The configuration file %s is missing.'), $content
+                ));
+            }
+        }
+
+        $shortname = $project->shortname;
+        $projectpath = sprintf($projecttempl, $shortname);
+        if (file_exists($projectpath)) {
+            throw new IDF_Scm_Exception(sprintf(
+                __('The project path %s already exists.'), $projectpath
+            ));
+        }
+
+        if (!mkdir($projectpath)) {
+            throw new IDF_Scm_Exception(sprintf(
+                __('The project path %s could not be created.'), $projectpath
+            ));
+        }
+
+        //
+        // step 1) create a new database
+        //
+        $dbfile = $projectpath.'/database.mtn';
+        $cmd = sprintf('db init -d %s', escapeshellarg($dbfile));
+        self::_mtn_exec($cmd);
+
+        //
+        // step 2) create a server key
+        //
+        // try to parse the key's domain part from the remote_url's host
+        // name, otherwise fall back to the configured Apache server name
+        $server = $_SERVER['SERVER_NAME'];
+        $remote_url = Pluf::f('mtn_remote_url');
+        if (($parsed = parse_url($remote_url)) !== false &&
+            !empty($parsed['host'])) {
+            $server = $parsed['host'];
+        }
+
+        $serverkey = $shortname.'-server@'.$server;
+        $cmd = sprintf('au generate_key --confdir=%s %s ""',
+            escapeshellarg($projectpath),
+            escapeshellarg($serverkey)
+        );
+        self::_mtn_exec($cmd);
+
+        //
+        // step 3) create a client key, and save it in IDF
+        //
+        $keydir = Pluf::f('tmp_folder').'/mtn-client-keys';
+        if (!file_exists($keydir)) {
+            if (!mkdir($keydir)) {
+                throw new IDF_Scm_Exception(sprintf(
+                    __('The key directory %s could not be created.'), $keydir
+                ));
+            }
+        }
+
+        $clientkey_name = $shortname.'-client@'.$server;
+        $cmd = sprintf('au generate_key --keydir=%s %s ""',
+            escapeshellarg($keydir),
+            escapeshellarg($clientkey_name)
+        );
+        $keyinfo = self::_mtn_exec($cmd);
+
+        $parsed_keyinfo = array();
+        try {
+            $parsed_keyinfo = IDF_Scm_Monotone_BasicIO::parse($keyinfo);
+        }
+        catch (Exception $e) {
+            throw new IDF_Scm_Exception(sprintf(
+                __('Could not parse key information: %s'), $e->getMessage()
+            ));
+        }
+
+        $clientkey_hash = $parsed_keyinfo[0][1]['hash'];
+        $clientkey_file = $keydir . '/' . $clientkey_name . '.' . $clientkey_hash;
+        $clientkey_data = file_get_contents($clientkey_file);
+
+        $project->getConf()->setVal('mtn_client_key_name', $clientkey_name);
+        $project->getConf()->setVal('mtn_client_key_hash', $clientkey_hash);
+        $project->getConf()->setVal('mtn_client_key_data', $clientkey_data);
+
+        // add the public client key to the server
+        $cmd = sprintf('au get_public_key --keydir=%s %s',
+            escapeshellarg($keydir),
+            escapeshellarg($clientkey_hash)
+        );
+        $clientkey_pubdata = self::_mtn_exec($cmd);
+
+        $cmd = sprintf('au put_public_key --db=%s %s',
+            escapeshellarg($dbfile),
+            escapeshellarg($clientkey_pubdata)
+        );
+        self::_mtn_exec($cmd);
+
+        //
+        // step 4) setup the configuration
+        //
+
+        // we assume that all confdir entries ending with a slash mean a
+        // directory that has to be created, that all files ending on ".in"
+        // have to be processed and copied in place and that all other files
+        // just need to be symlinked from the original location
+        foreach ($confdir_contents as $content) {
+            $filepath = $projectpath.'/'.$content;
+            if (substr($content, -1) == '/') {
+                if (!mkdir($filepath)) {
+                    throw new IDF_Scm_Exception(sprintf(
+                        __('Could not create configuration directory "%s"'), $filepath
+                    ));
+                }
+                continue;
+            }
+
+            if (substr($content, -3) != '.in') {
+                if (!symlink($confdir.$content, $filepath)) {
+                    IDF_Scm_Exception(sprintf(
+                        __('Could not create symlink "%s"'), $filepath
+                    ));
+                }
+                continue;
+            }
+
+            $filecontents = file_get_contents($confdir.'/'.$content);
+            $filecontents = str_replace(
+                array('%%MTNPOSTPUSH%%', '%%PROJECT%%', '%%MTNCLIENTKEY%%'),
+                array($mtnpostpush, $shortname, $clientkey_hash),
+                $filecontents
+            );
+
+            // remove the .in
+            $filepath = substr($filepath, 0, -3);
+            if (file_put_contents($filepath, $filecontents, LOCK_EX) === false) {
+                throw new IDF_Scm_Exception(sprintf(
+                    __('Could not write configuration file "%s"'), $filepath
+                ));
+            }
+        }
+
+        //
+        // step 5) read in and append the usher config with the new server
+        //
+        $usher_rc = file_get_contents($usher_config);
+        $parsed_config = array();
+        try {
+            $parsed_config = IDF_Scm_Monotone_BasicIO::parse($usher_rc);
+        }
+        catch (Exception $e) {
+            throw new IDF_Scm_Exception(sprintf(
+                __('Could not parse usher configuration in "%s": %s'),
+                $usher_config, $e->getMessage()
+            ));
+        }
+
+        // ensure we haven't configured a server with this name already
+        foreach ($parsed_config as $stanzas) {
+            foreach ($stanzas as $stanza_line) {
+                if ($stanza_line['key'] == 'server' &&
+                    $stanza_line['values'][0] == $shortname) {
+                    throw new IDF_Scm_Exception(sprintf(
+                        __('usher configuration already contains a server '.
+                           'entry named "%s"'),
+                        $shortname
+                    ));
+                }
+            }
+        }
+
+        $new_server = array(
+            array('key' => 'server', 'values' => array($shortname)),
+            array('key' => 'local', 'values' => array(
+                '--confdir', $projectpath,
+                '-d', $dbfile,
+                '--timestamps',
+                '--ticker=dot'
+            )),
+        );
+
+        $parsed_config[] = $new_server;
+        $usher_rc = IDF_Scm_Monotone_BasicIO::compile($parsed_config);
+
+        // FIXME: more sanity - what happens on failing writes? we do not
+        // have a backup copy of usher.conf around...
+        if (file_put_contents($usher_config, $usher_rc, LOCK_EX) === false) {
+            throw new IDF_Scm_Exception(sprintf(
+                __('Could not write usher configuration file "%s"'), $usher_config
+            ));
+        }
+
+        //
+        // step 6) reload usher to pick up the new configuration
+        //
+        IDF_Scm_Monotone_Usher::reload();
+    }
+
+    /**
+     * Updates the read / write permissions for the monotone database
+     *
+     * @param IDF_Project
+     */
+    public function processMembershipsUpdated($project)
+    {
+        if ($project->getConf()->getVal('scm') != 'mtn') {
+            return;
+        }
+
+        if (Pluf::f('mtn_db_access', 'local') == 'local') {
+            return;
+        }
+
+        $mtn = IDF_Scm_Monotone::factory($project);
+        $stdio = $mtn->getStdio();
+
+        $projectpath = self::_get_project_path($project);
+        $auth_ids    = self::_get_authorized_user_ids($project);
+        $key_ids     = array();
+        foreach ($auth_ids as $auth_id) {
+            $sql = new Pluf_SQL('user=%s', array($auth_id));
+            $keys = Pluf::factory('IDF_Key')->getList(array('filter' => $sql->gen()));
+            foreach ($keys as $key) {
+                if ($key->getType() != 'mtn')
+                    continue;
+                $stdio->exec(array('put_public_key', $key->content));
+                $key_ids[] = $key->getMtnId();
+            }
+        }
+
+        $write_permissions = implode("\n", $key_ids);
+        $rcfile = $projectpath.'/write-permissions';
+        if (file_put_contents($rcfile, $write_permissions, LOCK_EX) === false) {
+            throw new IDF_Scm_Exception(sprintf(
+                __('Could not write write-permissions file "%s"'), $rcfile
+            ));
+        }
+
+        if ($project->private) {
+            $stanza = array(
+                array('key' => 'pattern', 'values' => array('*')),
+            );
+            foreach ($key_ids as $key_id)
+            {
+                $stanza[] = array('key' => 'allow', 'values' => array($key_id));
+            }
+        }
+        else {
+            $stanza = array(
+                array('key' => 'pattern', 'values' => array('*')),
+                array('key' => 'allow', 'values' => array('*')),
+            );
+        }
+        $read_permissions = IDF_Scm_Monotone_BasicIO::compile(array($stanza));
+        $rcfile = $projectpath.'/read-permissions';
+        if (file_put_contents($rcfile, $read_permissions, LOCK_EX) === false) {
+            throw new IDF_Scm_Exception(sprintf(
+                __('Could not write read-permissions file "%s"'), $rcfile
+            ));
+        }
+
+        // link / unlink the read-only automate permissions for the project
+        $confdir = Pluf::f('mtn_confdir', false);
+        if ($confdir === false) {
+            $confdir = dirname(__FILE__).'/SyncMonotone/';
+        }
+        $file = 'hooks.d/indefero_authorize_remote_automate.conf';
+        $projectfile = $projectpath.'/'.$file;
+        $templatefile = $confdir.'/'.$file;
+
+        $serverRestartRequired = false;
+        if ($project->private && file_exists($projectfile) && is_link($projectfile)) {
+            if (!unlink($projectfile)) {
+                IDF_Scm_Exception(sprintf(
+                    __('Could not remove symlink "%s"'), $projectfile
+                ));
+            }
+            $serverRestartRequired = true;
+        } else
+        if (!$project->private && !file_exists($projectfile)) {
+            if (!symlink($templatefile, $projectfile)) {
+                throw new IDF_Scm_Exception(sprintf(
+                    __('Could not create symlink "%s"'), $projectfile
+                ));
+            }
+            $serverRestartRequired = true;
+        }
+
+        if ($serverRestartRequired) {
+            // FIXME: we should actually use stopServer() here, but this
+            // seems to be ignored when the server should be started
+            // again immediately afterwards
+            IDF_Scm_Monotone_Usher::killServer($project->shortname);
+            IDF_Scm_Monotone_Usher::startServer($project->shortname);
+        }
+    }
+
+    /**
+     * Clean up after a mtn project was deleted
+     *
+     * @param IDF_Project
+     */
+    public function processProjectDelete($project)
+    {
+        if ($project->getConf()->getVal('scm') != 'mtn') {
+            return;
+        }
+
+        if (Pluf::f('mtn_db_access', 'local') == 'local') {
+            return;
+        }
+
+        $usher_config = Pluf::f('mtn_usher_conf', false);
+        if (!$usher_config || !is_writable($usher_config)) {
+            throw new IDF_Scm_Exception(
+                 __('"mtn_usher_conf" does not exist or is not writable.')
+            );
+        }
+
+        $shortname = $project->shortname;
+        IDF_Scm_Monotone_Usher::killServer($shortname);
+
+        $projecttempl = Pluf::f('mtn_repositories', false);
+        if ($projecttempl === false) {
+            throw new IDF_Scm_Exception(
+                 __('"mtn_repositories" must be defined in your configuration file.')
+            );
+        }
+
+        $projectpath = sprintf($projecttempl, $shortname);
+        if (file_exists($projectpath)) {
+            if (!self::_delete_recursive($projectpath)) {
+                throw new IDF_Scm_Exception(sprintf(
+                    __('One or more paths underknees %s could not be deleted.'), $projectpath
+                ));
+            }
+        }
+
+        $keydir = Pluf::f('tmp_folder').'/mtn-client-keys';
+        $keyname = $project->getConf()->getVal('mtn_client_key_name', false);
+        $keyhash = $project->getConf()->getVal('mtn_client_key_hash', false);
+        if ($keyname && $keyhash &&
+            file_exists($keydir .'/'. $keyname . '.' . $keyhash)) {
+            if (!@unlink($keydir .'/'. $keyname . '.' . $keyhash)) {
+                throw new IDF_Scm_Exception(sprintf(
+                    __('Could not delete client private key %s'), $keyname
+                ));
+            }
+        }
+
+        $usher_rc = file_get_contents($usher_config);
+        $parsed_config = array();
+        try {
+            $parsed_config = IDF_Scm_Monotone_BasicIO::parse($usher_rc);
+        }
+        catch (Exception $e) {
+            throw new IDF_Scm_Exception(sprintf(
+                __('Could not parse usher configuration in "%s": %s'),
+                $usher_config, $e->getMessage()
+            ));
+        }
+
+        foreach ($parsed_config as $idx => $stanzas) {
+            foreach ($stanzas as $stanza_line) {
+                if ($stanza_line['key'] == 'server' &&
+                    $stanza_line['values'][0] == $shortname) {
+                    unset($parsed_config[$idx]);
+                    break;
+                }
+            }
+        }
+
+        $usher_rc = IDF_Scm_Monotone_BasicIO::compile($parsed_config);
+
+        // FIXME: more sanity - what happens on failing writes? we do not
+        // have a backup copy of usher.conf around...
+        if (file_put_contents($usher_config, $usher_rc, LOCK_EX) === false) {
+            throw new IDF_Scm_Exception(sprintf(
+                __('Could not write usher configuration file "%s"'), $usher_config
+            ));
+        }
+
+        IDF_Scm_Monotone_Usher::reload();
+    }
+
+    /**
+     * Adds the (monotone) key to all monotone projects of this forge
+     * where the user of the key has write access to
+     */
+    public function processKeyCreate($key)
+    {
+        if ($key->getType() != 'mtn') {
+            return;
+        }
+
+        if (Pluf::f('mtn_db_access', 'local') == 'local') {
+            return;
+        }
+
+        foreach (Pluf::factory('IDF_Project')->getList() as $project) {
+            $conf = new IDF_Conf();
+            $conf->setProject($project);
+            $scm = $conf->getVal('scm', 'mtn');
+            if ($scm != 'mtn')
+                continue;
+
+            $projectpath = self::_get_project_path($project);
+            $auth_ids    = self::_get_authorized_user_ids($project);
+            if (!in_array($key->user, $auth_ids))
+                continue;
+
+            $mtn_key_id = $key->getMtnId();
+
+            // if the project is not defined as private, all people have
+            // read access already, so we don't need to write anything
+            // and we currently do not check if read-permissions really
+            // contains
+            //      pattern "*"
+            //      allow "*"
+            // which is the default for non-private projects
+            if ($project->private == true) {
+                $read_perms = file_get_contents($projectpath.'/read-permissions');
+                $parsed_read_perms = array();
+                try {
+                    $parsed_read_perms = IDF_Scm_Monotone_BasicIO::parse($read_perms);
+                }
+                catch (Exception $e) {
+                    throw new IDF_Scm_Exception(sprintf(
+                        __('Could not parse read-permissions for project "%s": %s'),
+                        $shortname, $e->getMessage()
+                    ));
+                }
+
+                $wildcard_section = null;
+                for ($i=0; $i<count($parsed_read_perms); ++$i) {
+                    foreach ($parsed_read_perms[$i] as $stanza_line) {
+                        if ($stanza_line['key'] == 'pattern' &&
+                            $stanza_line['values'][0] == '*') {
+                            $wildcard_section =& $parsed_read_perms[$i];
+                            break;
+                        }
+                    }
+                }
+
+                if ($wildcard_section == null)
+                {
+                    $wildcard_section = array(
+                        array('key' => 'pattern', 'values' => array('*'))
+                    );
+                    $parsed_read_perms[] =& $wildcard_section;
+                }
+
+                $key_found = false;
+                foreach ($wildcard_section as $line)
+                {
+                    if ($line['key'] == 'allow' && $line['values'][0] == $mtn_key_id) {
+                        $key_found = true;
+                        break;
+                    }
+                }
+
+                if (!$key_found) {
+                    $wildcard_section[] = array(
+                        'key' => 'allow', 'values' => array($mtn_key_id)
+                    );
+                }
+
+                $read_perms = IDF_Scm_Monotone_BasicIO::compile($parsed_read_perms);
+
+                if (file_put_contents($projectpath.'/read-permissions',
+                                      $read_perms, LOCK_EX) === false) {
+                    throw new IDF_Scm_Exception(sprintf(
+                        __('Could not write read-permissions for project "%s"'), $shortname
+                    ));
+                }
+            }
+
+            $write_perms = file_get_contents($projectpath.'/write-permissions');
+            $lines = preg_split("/(\n|\r\n)/", $write_perms, -1, PREG_SPLIT_NO_EMPTY);
+            if (!in_array('*', $lines) && !in_array($mtn_key_id, $lines)) {
+                $lines[] = $mtn_key_id;
+            }
+            if (file_put_contents($projectpath.'/write-permissions',
+                                  implode("\n", $lines) . "\n", LOCK_EX) === false) {
+                throw new IDF_Scm_Exception(sprintf(
+                    __('Could not write write-permissions file for project "%s"'),
+                    $shortname
+                ));
+            }
+
+            $mtn = IDF_Scm_Monotone::factory($project);
+            $stdio = $mtn->getStdio();
+            $stdio->exec(array('put_public_key', $key->content));
+        }
+    }
+
+    /**
+     * Removes the (monotone) key from all monotone projects of this forge
+     * where the user of the key has write access to
+     */
+    public function processKeyDelete($key)
+    {
+        try {
+            if ($key->getType() != 'mtn') {
+                return;
+            }
+        } catch (Exception $e) {
+            // bad key type, skip it.
+            return;
+        }
+
+        if (Pluf::f('mtn_db_access', 'local') == 'local') {
+            return;
+        }
+
+        foreach (Pluf::factory('IDF_Project')->getList() as $project) {
+            $conf = new IDF_Conf();
+            $conf->setProject($project);
+            $scm = $conf->getVal('scm', 'mtn');
+            if ($scm != 'mtn')
+                continue;
+
+            $projectpath = self::_get_project_path($project);
+            $auth_ids    = self::_get_authorized_user_ids($project);
+            if (!in_array($key->user, $auth_ids))
+                continue;
+
+            $mtn_key_id = $key->getMtnId();
+
+            // if the project is not defined as private, all people have
+            // read access already, so we don't need to write anything
+            // and we currently do not check if read-permissions really
+            // contains
+            //      pattern "*"
+            //      allow "*"
+            // which is the default for non-private projects
+            if ($project->private) {
+                $read_perms = file_get_contents($projectpath.'/read-permissions');
+                $parsed_read_perms = array();
+                try {
+                    $parsed_read_perms = IDF_Scm_Monotone_BasicIO::parse($read_perms);
+                }
+                catch (Exception $e) {
+                    throw new IDF_Scm_Exception(sprintf(
+                        __('Could not parse read-permissions for project "%s": %s'),
+                        $shortname, $e->getMessage()
+                    ));
+                }
+
+                // while we add new keys only to an existing wild-card entry
+                // we remove dropped keys from all sections since the key
+                // should be simply unavailable for all of them
+                for ($h=0; $h<count($parsed_read_perms); ++$h) {
+                    for ($i=0; $i<count($parsed_read_perms[$h]); ++$i) {
+                        if ($parsed_read_perms[$h][$i]['key'] == 'allow' &&
+                            $parsed_read_perms[$h][$i]['values'][0] == $mtn_key_id) {
+                            unset($parsed_read_perms[$h][$i]);
+                            continue;
+                        }
+                    }
+                }
+
+                $read_perms = IDF_Scm_Monotone_BasicIO::compile($parsed_read_perms);
+
+                if (file_put_contents($projectpath.'/read-permissions',
+                                      $read_perms, LOCK_EX) === false) {
+                    throw new IDF_Scm_Exception(sprintf(
+                        __('Could not write read-permissions for project "%s"'), $shortname
+                    ));
+                }
+            }
+
+            $write_perms = file_get_contents($projectpath.'/write-permissions');
+            $lines = preg_split("/(\n|\r\n)/", $write_perms, -1, PREG_SPLIT_NO_EMPTY);
+            for ($i=0; $i<count($lines); ++$i) {
+                if ($lines[$i] == $mtn_key_id) {
+                    unset($lines[$i]);
+                    // the key should actually only exist once in the
+                    // file, but we're paranoid
+                    continue;
+                }
+            }
+            if (file_put_contents($projectpath.'/write-permissions',
+                                  implode("\n", $lines) . "\n", LOCK_EX) === false) {
+                throw new IDF_Scm_Exception(sprintf(
+                    __('Could not write write-permissions file for project "%s"'),
+                    $shortname
+                ));
+            }
+
+            $mtn = IDF_Scm_Monotone::factory($project);
+            $stdio = $mtn->getStdio();
+            // if the public key did not sign any revisions, drop it from
+            // the database as well
+            try {
+                if (strlen($stdio->exec(array('select', 'k:' . $mtn_key_id))) == 0) {
+                    $stdio->exec(array('drop_public_key', $mtn_key_id));
+                }
+            } catch (IDF_Scm_Exception $e) {
+                if (strpos($e->getMessage(), 'there is no key named') === false)
+                    throw $e;
+            }
+        }
+    }
+
+    /**
+     * Update the timeline after a push
+     *
+     */
+    public function processSyncTimeline($project_name)
+    {
+        try {
+            $project = IDF_Project::getOr404($project_name);
+        } catch (Pluf_HTTP_Error404 $e) {
+            Pluf_Log::event(array(
+                'IDF_Plugin_SyncMonotone::processSyncTimeline',
+                'Project not found.',
+                array($project_name, $params)
+            ));
+            return false; // Project not found
+        }
+
+        Pluf_Log::debug(array(
+            'IDF_Plugin_SyncMonotone::processSyncTimeline',
+            'Project found', $project_name, $project->id
+        ));
+        IDF_Scm::syncTimeline($project, true);
+        Pluf_Log::event(array(
+            'IDF_Plugin_SyncMonotone::processSyncTimeline',
+            'sync', array($project_name, $project->id)
+        ));
+    }
+
+    private static function _get_authorized_user_ids($project)
+    {
+        $mem = $project->getMembershipData();
+        $members = array_merge((array)$mem['members'],
+                               (array)$mem['owners'],
+                               (array)$mem['authorized']);
+        $userids = array();
+        foreach ($members as $member) {
+            $userids[] = $member->id;
+        }
+        return $userids;
+    }
+
+    private static function _get_project_path($project)
+    {
+        $projecttempl = Pluf::f('mtn_repositories', false);
+        if ($projecttempl === false) {
+            throw new IDF_Scm_Exception(
+                 __('"mtn_repositories" must be defined in your configuration file.')
+            );
+        }
+
+        $projectpath = sprintf($projecttempl, $project->shortname);
+        if (!file_exists($projectpath)) {
+            throw new IDF_Scm_Exception(sprintf(
+                __('The project path %s does not exists.'), $projectpath
+            ));
+        }
+        return $projectpath;
+    }
+
+    private static function _mtn_exec($cmd)
+    {
+        $fullcmd = sprintf('%s %s %s',
+            Pluf::f('idf_exec_cmd_prefix', ''),
+            Pluf::f('mtn_path', 'mtn'),
+            $cmd
+        );
+
+        $output = $return = null;
+        exec($fullcmd, $output, $return);
+        if ($return != 0) {
+            throw new IDF_Scm_Exception(sprintf(
+                __('The command "%s" could not be executed.'), $cmd
+            ));
+        }
+        return implode("\n", $output);
+    }
+
+    private static function _delete_recursive($path)
+    {
+        if (is_file($path) || is_link($path)) {
+            return @unlink($path);
+        }
+
+        if (is_dir($path)) {
+            $scan = glob(rtrim($path, '/') . '/*');
+            $status = 0;
+            foreach ($scan as $subpath) {
+                $status |= self::_delete_recursive($subpath);
+            }
+            $status |= rmdir($path);
+            return $status;
+        }
+    }
+}

src/IDF/Plugin/SyncMonotone/hooks.d/indefero_authorize_remote_automate.conf

@@ -0,0 +1,10 @@
+ARA_safe_commands = {
+   "get_corresponding_path", "get_content_changed", "tags", "branches",
+   "common_ancestors", "packet_for_fdelta", "packet_for_fdata",
+   "packets_for_certs", "packet_for_rdata", "get_manifest_of",
+   "get_revision", "select", "graph", "children", "parents", "roots",
+   "leaves", "ancestry_difference", "toposort", "erase_ancestors",
+   "descendents", "ancestors", "heads", "get_file_of", "get_file",
+   "interface_version", "get_attributes", "content_diff",
+   "file_merge", "show_conflicts", "certs", "keys", "get_extended_manifest_of"
+}

src/IDF/Plugin/SyncMonotone/hooks.d/indefero_authorize_remote_automate.lua

@@ -0,0 +1,88 @@
+-- ***** BEGIN LICENSE BLOCK *****
+-- This file is part of InDefero, an open source project management application.
+-- Copyright (C) 2011 Céondo Ltd and contributors.
+-- Copyright (C) 2010 Thomas Keller <me@thomaskeller.biz>
+--                    Richard Levitte <richard@levitte.org>
+--
+-- InDefero is free software; you can redistribute it and/or modify
+-- it under the terms of the GNU General Public License as published by
+-- the Free Software Foundation; either version 2 of the License, or
+-- (at your option) any later version.
+--
+-- InDefero is distributed in the hope that it will be useful,
+-- but WITHOUT ANY WARRANTY; without even the implied warranty of
+-- MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+-- GNU General Public License for more details.
+--
+-- You should have received a copy of the GNU General Public License
+-- along with this program; if not, write to the Free Software
+-- Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA  02110-1301  USA
+--
+-- ***** END LICENSE BLOCK *****
+
+--
+-- This script reads key identities from a file "remote-automate-permissions"
+-- in the configuration directory and permits those authenticating with one
+-- of those keys to perform dangerous (read/write) remote automate operations.
+-- The format of the file is very simple, one key identity on every line.
+-- Lines starting with # are ignore, as well as empty lines.
+--
+-- It's possible to configure this script to allow the performance of some
+-- remote automate commands anonymously, through the variable
+-- ARA_safe_commands, which has to be a table of commands as strings.
+-- One example configuration, taken from the setup at code.monotone.ca, could
+-- be this:
+--
+-- ARA_safe_commands = {
+--    "get_corresponding_path", "get_content_changed", "tags", "branches",
+--    "common_ancestors", "packet_for_fdelta", "packet_for_fdata",
+--    "packets_for_certs", "packet_for_rdata", "get_manifest_of",
+--    "get_revision", "select", "graph", "children", "parents", "roots",
+--    "leaves", "ancestry_difference", "toposort", "erase_ancestors",
+--    "descendents", "ancestors", "heads", "get_file_of", "get_file",
+--    "interface_version", "get_attributes", "content_diff",
+--    "file_merge", "show_conflicts", "certs", "keys", "get_extended_manifest_of"
+-- }
+--
+do
+   local _safe_commands = {}
+   if ARA_safe_commands then
+      _safe_commands = ARA_safe_commands
+   end
+
+   local _save_get_remote_automate_permitted = get_remote_automate_permitted
+   function get_remote_automate_permitted(key_identity, command, options)
+      local permfile =
+	 io.open(get_confdir() .. "/remote-automate-permissions", "r")
+      if (permfile == nil) then
+        return false
+      end
+
+      -- See if the incoming key matches any of the key identities or
+      -- patterns found in the permissions file.
+      local matches = false
+      local line = permfile:read()
+      while (not matches and line ~= nil) do
+        if not globish_match("#*", line) then
+          local _, _, ln = string.find(line, "%s*([^%s]*)%s*")
+          if ln == "*" then matches = true end
+          if ln == key_identity.id then matches = true end
+          if globish_match(ln, key_identity.name) then matches = true end
+          line = permfile:read()
+	    end
+      end
+      io.close(permfile)
+      if matches then return true end
+
+      -- No matching key found, let's see if the command matches one the
+      -- admin allowed to be performed anonymously
+      for _,v in ipairs(_safe_commands) do
+        if (v == command[1]) then
+          return true
+        end
+      end
+
+      -- No matches found anywhere, then don't permit this operation
+      return false
+   end
+end

src/IDF/Plugin/SyncMonotone/hooks.d/indefero_post_push.conf.in

@@ -0,0 +1,2 @@
+IDF_project = "%%PROJECT%%"
+IDF_push_script = "%%MTNPOSTPUSH%%"

src/IDF/Plugin/SyncMonotone/hooks.d/indefero_post_push.lua

@@ -0,0 +1,58 @@
+-- ***** BEGIN LICENSE BLOCK *****
+-- This file is part of InDefero, an open source project management application.
+-- Copyright (C) 2011 Céondo Ltd and contributors.
+--
+-- InDefero is free software; you can redistribute it and/or modify
+-- it under the terms of the GNU General Public License as published by
+-- the Free Software Foundation; either version 2 of the License, or
+-- (at your option) any later version.
+--
+-- InDefero is distributed in the hope that it will be useful,
+-- but WITHOUT ANY WARRANTY; without even the implied warranty of
+-- MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+-- GNU General Public License for more details.
+--
+-- You should have received a copy of the GNU General Public License
+-- along with this program; if not, write to the Free Software
+-- Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA  02110-1301  USA
+--
+-- ***** END LICENSE BLOCK *****
+
+--
+-- let IDF know of new arriving revisions to fill its timeline
+--
+_idf_revs = {}
+push_hook_functions(
+   {
+      start =
+	 function (session_id)
+	    _idf_revs[session_id] = {}
+	    return "continue",nil
+	 end,
+      revision_received =
+	 function (new_id, revision, certs, session_id)
+	    table.insert(_idf_revs[session_id], new_id)
+	    return "continue",nil
+	 end,
+      ["end"] =
+	 function (session_id, ...)
+	    if table.getn(_idf_revs[session_id]) == 0 then
+	       return "continue",nil
+	    end
+
+	    local pin,pout,pid = spawn_pipe(IDF_push_script, IDF_project);
+	    if pid == -1 then
+	       print("could not execute " .. IDF_push_script)
+	       return "continue",nil
+	    end
+
+	    for _,r in ipairs(_idf_revs[session_id]) do
+	       pin:write(r .. "\n")
+	    end
+	    pin:close()
+
+	    wait(pid)
+	    return "continue",nil
+	 end
+   })
+

src/IDF/Plugin/SyncMonotone/monotonerc.in

@@ -0,0 +1,30 @@
+-- ***** BEGIN LICENSE BLOCK *****
+-- This file is part of InDefero, an open source project management application.
+-- Copyright (C) 2011 Céondo Ltd and contributors.
+--
+-- InDefero is free software; you can redistribute it and/or modify
+-- it under the terms of the GNU General Public License as published by
+-- the Free Software Foundation; either version 2 of the License, or
+-- (at your option) any later version.
+--
+-- InDefero is distributed in the hope that it will be useful,
+-- but WITHOUT ANY WARRANTY; without even the implied warranty of
+-- MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+-- GNU General Public License for more details.
+--
+-- You should have received a copy of the GNU General Public License
+-- along with this program; if not, write to the Free Software
+-- Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA  02110-1301  USA
+--
+-- ***** END LICENSE BLOCK *****
+
+---- Load local hooks if they exist.
+-- The way this is supposed to work is that hooks.d can contain symbolic
+-- links to lua scripts.  These links MUST have the extension .lua
+-- If the script needs some configuration, a corresponding file with
+-- the extension .conf is the right spot.
+----
+-- First load the configuration of the hooks, if applicable
+includedirpattern(get_confdir() .. "/hooks.d/","*.conf")
+-- Then load the hooks themselves
+includedirpattern(get_confdir() .. "/hooks.d/","*.lua")

src/IDF/Plugin/SyncMonotone/remote-automate-permissions.in

@@ -0,0 +1 @@
+%%MTNCLIENTKEY%%

src/IDF/Plugin/SyncSvn.php

@@ -87,6 +87,36 @@ class IDF_Plugin_SyncSvn
                        escapeshellarg($svn_path.'/'.$shortname));
         $cmd = Pluf::f('idf_exec_cmd_prefix', '').$cmd;
         $ll = exec($cmd, $output, $return);
+        if ($return != 0) {
+            Pluf_Log::error(array('IDF_Plugin_SyncSvn::processSvnCreate', 
+                                  'Error', 
+                                  array('path' => $svn_path.'/'.$shortname,
+                                        'output' => $output)));
+            return;
+        }
+        $p = realpath(dirname(__FILE__).'/../../../scripts/svn-post-commit');
+        exec(sprintf(Pluf::f('idf_exec_cmd_prefix', '').'ln -s %s %s', 
+                     escapeshellarg($p), 
+                     escapeshellarg($svn_path.'/'.$shortname.'/hooks/post-commit')),
+             $out, $res);
+        if ($res != 0) {
+            Pluf_Log::warn(array('IDF_Plugin_SyncSvn::processSvnCreate', 
+                                 'post-commit hook creation error.', 
+                                 $svn_path.'/'.$shortname.'/hooks/post-commit'));
+            return;
+        }
+        $p = realpath(dirname(__FILE__).'/../../../scripts/svn-post-revprop-change');
+        exec(sprintf(Pluf::f('idf_exec_cmd_prefix', '').'ln -s %s %s', 
+                     escapeshellarg($p), 
+                     escapeshellarg($svn_path.'/'.$shortname.'/hooks/post-revprop-change')),
+             $out, $res);
+        if ($res != 0) {
+            Pluf_Log::warn(array('IDF_Plugin_SyncSvn::processSvnCreate', 
+                                 'post-revprop-change hook creation error.', 
+                                 $svn_path.'/'.$shortname.'/hooks/post-revprop-change'));
+            return;
+        }
+
         return ($return == 0);
     }
 

src/IDF/Precondition.php

@@ -190,7 +190,12 @@ class IDF_Precondition
             return true; // Again need authentication error
         }
         $request->user = $users[0];
+        
+        // Don't try to load projects rights access if we are not in one
+        if ($request->query !== "/api/") {
             IDF_Middleware::setRights($request);
+        }
+            
         return true;
     }
 

src/IDF/Project.php

@@ -366,12 +366,13 @@ class IDF_Project extends Pluf_Model
     public function getRepositorySize($force=false)
     {
         $last_eval = $this->getConf()->getVal('repository_size_check_date', 0);
-        if (!$force and $last_eval > time()-86400) {
+        if (Pluf::f('idf_no_size_check', false) or
+            (!$force and $last_eval > time()-172800)) {
             return $this->getConf()->getVal('repository_size', -1);
         }
+        $this->getConf()->setVal('repository_size_check_date', time());
         $scm = IDF_Scm::get($this);
         $this->getConf()->setVal('repository_size', $scm->getRepositorySize());
-        $this->getConf()->setVal('repository_size_check_date', time());
         return $this->getConf()->getVal('repository_size', -1);
     }
 
@@ -381,15 +382,16 @@ class IDF_Project extends Pluf_Model
      * This will return the right url based on the user.
      *
      * @param Pluf_User The user (null)
+     * @param string    A specific commit to access
      */
-    public function getSourceAccessUrl($user=null)
+    public function getSourceAccessUrl($user=null, $commit=null)
     {
         $right = $this->getConf()->getVal('source_access_rights', 'all');
         if (($user == null or $user->isAnonymous())
             and  $right == 'all' and !$this->private) {
-            return $this->getRemoteAccessUrl();
+            return $this->getRemoteAccessUrl($commit);
         }
-        return $this->getWriteRemoteAccessUrl($user);
+        return $this->getWriteRemoteAccessUrl($user, $commit);
     }
 
 
@@ -397,15 +399,17 @@ class IDF_Project extends Pluf_Model
      * Get the remote access url to the repository.
      *
      * This will always return the anonymous access url.
+     *
+     * @param string    A specific commit to access
      */
-    public function getRemoteAccessUrl()
+    public function getRemoteAccessUrl($commit=null)
     {
         $conf = $this->getConf();
         $scm = $conf->getVal('scm', 'git');
         $scms = Pluf::f('allowed_scm');
         Pluf::loadClass($scms[$scm]);
         return call_user_func(array($scms[$scm], 'getAnonymousAccessUrl'),
-                              $this);
+                              $this, $commit);
     }
 
     /**
@@ -414,14 +418,27 @@ class IDF_Project extends Pluf_Model
      * Some SCM have a remote access URL to write which is not the
      * same as the one to read. For example, you do a checkout with
      * git-daemon and push with SSH.
+     *
+     * @param string    A specific commit to access
      */
-    public function getWriteRemoteAccessUrl($user)
+    public function getWriteRemoteAccessUrl($user,$commit=null)
     {
         $conf = $this->getConf();
         $scm = $conf->getVal('scm', 'git');
         $scms = Pluf::f('allowed_scm');
         return call_user_func(array($scms[$scm], 'getAuthAccessUrl'),
-                              $this, $user);
+                              $this, $user, $commit);
+    }
+
+    /**
+     * Get the post commit hook key.
+     *
+     * The goal is to get something predictable but from which one
+     * cannot reverse find the secret key.
+     */
+    public function getPostCommitHookKey()
+    {
+        return md5($this->id.sha1(Pluf::f('secret_key')).$this->shortname);
     }
 
     /**
@@ -435,7 +452,8 @@ class IDF_Project extends Pluf_Model
         $roots = array(
                        'git' => 'master',
                        'svn' => 'HEAD',
-                       'mercurial' => 'tip'
+                       'mercurial' => 'tip',
+                       'mtn' => 'h:'.$conf->getVal('mtn_master_branch', '*'),
                        );
         $scm = $conf->getVal('scm', 'git');
         return $roots[$scm];
@@ -617,7 +635,7 @@ class IDF_Project extends Pluf_Model
         Pluf_Signal::send('IDF_Project::preDelete',
                           'IDF_Project', $params);
         $what = array('IDF_Upload', 'IDF_Review', 'IDF_Issue',
-                      'IDF_WikiPage', 'IDF_Commit',
+                      'IDF_WikiPage', 'IDF_Commit', 'IDF_Tag',
                       );
         foreach ($what as $m) {
             foreach (Pluf::factory($m)->getList(array('filter' => 'project='.(int)$this->id)) as $item) {

src/IDF/Queue.php

@@ -0,0 +1,222 @@
+<?php
+/* -*- tab-width: 4; indent-tabs-mode: nil; c-basic-offset: 4 -*- */
+/*
+# ***** BEGIN LICENSE BLOCK *****
+# This file is part of InDefero, an open source project management application.
+# Copyright (C) 2008 Céondo Ltd and contributors.
+#
+# InDefero is free software; you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation; either version 2 of the License, or
+# (at your option) any later version.
+#
+# InDefero is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+n# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write to the Free Software
+# Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA  02110-1301  USA
+#
+# ***** END LICENSE BLOCK ***** */
+
+
+/**
+ * Queue system for the management of asynchronous operations.
+ *
+ * Anybody can add an item to the queue and any application can
+ * register itself to process an item from the queue.
+ *
+ * An item in the queue is considered as fully processed when all the
+ * handlers have processed it successfully.
+ *
+ * To push a new item in the queue:
+ *
+ * <code>
+ * $item = new IDF_Queue();
+ * $item->type = 'new_commit';
+ * $item->payload = array('what', 'ever', array('data'));
+ * $item->create();
+ * </code>
+ *
+ * To process one item from the queue, you first need to register an
+ * handler, by adding the following in your relations.php file before
+ * the return statement or in your config file.
+ *
+ * <code>
+ * Pluf_Signal::connect('IDF_Queue::processItem', 
+ *                       array('YourApp_Class', 'processItem'));
+ * </code>
+ *
+ * The processItem method will be called with two arguments, the first
+ * is the name of the signal ('IDF_Queue::processItem') and the second
+ * is an array with:
+ *
+ * <code>
+ * array('item' => $item,
+ *       'res' => array('OtherApp_Class::handler' => false,
+ *                      'FooApp_Class::processItem' => true));
+ * </code>
+ *
+ * When you process an item, you need first to check if the type is
+ * corresponding to what you want to work with, then you need to check
+ * in 'res' if you have not already processed successfully the item,
+ * that is the key 'YourApp_Class::processItem' must be set to true,
+ * and then you can process the item. At the end of your processing,
+ * you need to modify by reference the 'res' key to add your status.
+ *
+ * All the data except for the type is in the payload, this makes the
+ * queue flexible to manage many different kind of tasks.
+ *
+ */
+class IDF_Queue extends Pluf_Model
+{
+    public $_model = __CLASS__;
+
+    function init()
+    {
+        $this->_a['table'] = 'idf_queue';
+        $this->_a['model'] = __CLASS__;
+        $this->_a['cols'] = array(
+                             // It is mandatory to have an "id" column.
+                            'id' =>
+                            array(
+                                  'type' => 'Pluf_DB_Field_Sequence',
+                                  'blank' => true, 
+                                  ),
+                            'status' => 
+                            array(
+                                  'type' => 'Pluf_DB_Field_Integer',
+                                  'blank' => false,
+                                  'choices' => array(
+                                                     'pending' => 0,
+                                                     'in_progress' => 1,
+                                                     'need_retry' => 2,
+                                                     'done' => 3,
+                                                     'error' => 4,
+                                                     ),
+                                  'default' => 0,
+                                  ),
+                            'trials' =>
+                            array(
+                                  'type' => 'Pluf_DB_Field_Integer',
+                                  'default' => 0,
+                                  ),
+                            'type' =>
+                            array(
+                                  'type' => 'Pluf_DB_Field_Varchar',
+                                  'blank' => false,
+                                  'size' => 50,
+                                  ),
+                            'payload' =>
+                            array(
+                                  'type' => 'Pluf_DB_Field_Serialized',
+                                  'blank' => false,
+                                  ),
+                            'results' =>
+                            array(
+                                  'type' => 'Pluf_DB_Field_Serialized',
+                                  'blank' => false,
+                                  ),
+                            'lasttry_dtime' =>
+                            array(
+                                  'type' => 'Pluf_DB_Field_Datetime',
+                                  'blank' => true,
+                                  ),
+                            'creation_dtime' =>
+                            array(
+                                  'type' => 'Pluf_DB_Field_Datetime',
+                                  'blank' => true,
+                                  ),
+                            );
+    }
+
+    function preSave($create=false)
+    {
+        if ($create) {
+            $this->creation_dtime = gmdate('Y-m-d H:i:s');
+            $this->lasttry_dtime = gmdate('Y-m-d H:i:s');
+            $this->results = array();
+            $this->trials = 0;
+            $this->status = 0;
+        }
+    }
+
+    /**
+     * The current item is going to be processed.
+     */
+    function processItem()
+    {
+        /**
+         * [signal]
+         *
+         * IDF_Queue::processItem
+         *
+         * [sender]
+         *
+         * IDF_Queue
+         *
+         * [description]
+         *
+         * This signal allows an application to run an asynchronous
+         * job. The handler gets the queue item and the results from
+         * the previous run. If the handler key is not set, then the
+         * job was not run. If set it can be either true (already done)
+         * or false (error at last run).
+         *
+         * [parameters]
+         *
+         * array('item' => $item, 'res' => $res)
+         *
+         */
+        $params = array('item' => $this, 'res' => $this->results);
+        Pluf_Signal::send('IDF_Queue::processItem',
+                          'IDF_Queue', $params);
+        $this->status = 3; // Success
+        foreach ($params['res'] as $handler=>$ok) {
+            if (!$ok) {
+                $this->status = 2; // Set to need retry
+                $this->trials += 1;
+                break;
+            }
+        }
+        $this->results = $params['res'];
+        $this->lasttry_dtime = gmdate('Y-m-d H:i:s');
+        $this->update();
+    }
+
+    /** 
+     * Parse the queue.
+     *
+     * It is a signal handler to just hook itself at the right time in
+     * the cron job performing the maintainance work.
+     *
+     * The processing relies on the fact that no other processing jobs
+     * must run at the same time. That is, your cron job must use a
+     * lock file or something like to not run in parallel.
+     *
+     * The processing is simple, first get 500 queue items, mark them
+     * as being processed and for each of them call the processItem()
+     * method which will trigger another event for processing.
+     *
+     * If you are processing more than 500 items per batch, you need
+     * to switch to a different solution.
+     *
+     */
+    public static function process($sender, &$params)
+    {
+        $where = 'status=0 OR status=2';
+        $items = Pluf::factory('IDF_Queue')->getList(array('filter'=>$where,
+                                                           'nb'=> 500));
+        Pluf_Log::event(array('IDF_Queue::process', $items->count()));
+        foreach ($items as $item) {
+            $item->status = 1;
+            $item->update();
+        }
+        foreach ($items as $item) {
+            $item->status = 1;
+            $item->processItem();
+        }
+    }
+}

src/IDF/Review/Comment.php

@@ -221,4 +221,9 @@ class IDF_Review_Comment extends Pluf_Model
         }
         Pluf_Translation::loadSetLocale($current_locale);
     }
+
+    public function get_submitter_data()
+    {
+        return IDF_UserData::factory($this->get_submitter());
+    }
 }

src/IDF/Review/Patch.php

@@ -197,14 +197,17 @@ class IDF_Review_Patch extends Pluf_Model
                                                      );
         $tmpl = new Pluf_Template('idf/review/review-created-email.txt');
         $text_email = $tmpl->render($context);
+        $addresses = explode(';',$conf->getVal('review_notification_email'));
+        foreach ($addresses as $address) {
             $email = new Pluf_Mail(Pluf::f('from_email'), 
-                               $conf->getVal('review_notification_email'),
+                                   $address,
                                    sprintf(__('New Code Review %s - %s (%s)'),
                                            $this->get_review()->id, 
                                            $this->get_review()->summary, 
                                            $this->get_review()->get_project()->shortname));
             $email->addTextMessage($text_email);
             $email->sendMail();
+        }
         Pluf_Translation::loadSetLocale($current_locale);
     }
 }

src/IDF/Scm.php

@@ -166,13 +166,28 @@ class IDF_Scm
         throw new Pluf_Exception_NotImplemented();
     }
 
+    const REVISION_VALID = 0;
+    const REVISION_INVALID = 1;
+    const REVISION_AMBIGUOUS = 2;
+
     /**
-     * Check if a revision or commit is valid.
+     * Check if a revision or commit is valid, invalid or ambiguous.
      *
      * @param string Revision or commit
-     * @return bool 
+     * @return int One of REVISION_VALID, REVISION_INVALID or REVISION_AMBIGIOUS
      */
-    public function isValidRevision($rev)
+    public function validateRevision($rev)
+    {
+        throw new Pluf_Exception_NotImplemented();
+    }
+
+    /**
+     * Returns an array of single commit objects for ambiguous commit identifiers
+     *
+     * @param string Ambiguous commit identifier
+     * @return array of objects
+     */
+    public function disambiguateRevision($commit)
     {
         throw new Pluf_Exception_NotImplemented();
     }
@@ -301,6 +316,34 @@ class IDF_Scm
         throw new Pluf_Exception_NotImplemented();
     }
 
+    /**
+     * Returns all recorded changes which lead to the particular commit
+     * or revision.
+     *
+     * Example output:
+     *
+     * stdClass object {
+     *  'additions' => array('path/to/file', 'path/to/directory', ...),
+     *  'deletions' => array('path/to/file', 'path/to/directory', ...),
+     *  'renames' => array('old/path/to/file' => 'new/path/to/file', ...)
+     *  'patches' => array('path/to/file', ...),
+     *  'properties' => array('path/to/file' => array(
+     *              'propname' => 'propvalue', 'deletedprop' => null, ...)
+     *              ),
+     *      ...)
+     * }
+     *
+     * Each member of the returned object is mandatory, but may contain
+     * an empty array if no changes were recorded.
+     *
+     * @param string    A commit identifier
+     * @return object with arrays of individual changes
+     */
+    public function getChanges($commit)
+    {
+        throw new Pluf_Exception_NotImplemented();
+    }
+
     /**
      * Get latest changes.
      *
@@ -378,13 +421,28 @@ class IDF_Scm
     }
 
     /**
-     * Generate the command to create a zip archive at a given commit.
+     * Given a changelog parsed node, returns extra data.
+     *
+     * For example, if the node is a commit object from git, it will a
+     * stdClass object with the parents array. The extra value could
+     * then be the parent(s) commit(s).
+     *
+     * @param stdClass Commit object/Parse object
+     * @return array Extra properties
+     */
+    public function getExtraProperties($obj)
+    {
+        return array();
+    }
+
+    /**
+     * Generate a zip archive at a given commit, wrapped in a HTTP response, suitable for pushing to client.
      *
      * @param string Commit
      * @param string Prefix ('repository/')
-     * @return string Command
+     * @return Pluf_HTTP_Response The HTTP Response containing the zip archive
      */
-    public function getArchiveCommand($commit, $prefix='repository/')
+    public function getArchiveStream($commit, $prefix='repository/')
     {
         throw new Pluf_Exception_NotImplemented();
     }
@@ -415,5 +473,14 @@ class IDF_Scm
     {
         return str_replace('%2F', '/', rawurlencode($path));
     }
+
+    /**
+     * Returns the number of slashes and preceeding path components
+     * that should be stripped from paths in the SCM's diff output
+     */
+    public function getDiffPathStripLevel()
+    {
+        return 0;
+    }
 }
 

src/IDF/Scm/Cache/Git.php

@@ -55,7 +55,9 @@ class IDF_Scm_Cache_Git extends Pluf_Model
             $cache->project = $this->_project;
             $cache->githash = $blob->hash;
             $blob->title = IDF_Commit::toUTF8($blob->title);
-            $cache->content = $blob->date.chr(31).$blob->author.chr(31).$blob->title;
+            $cache->content = IDF_Commit::toUTF8($blob->date) . chr(31)
+                . IDF_Commit::toUTF8($blob->author) . chr(31)
+                . IDF_Commit::toUTF8($blob->title);
             $sql = new Pluf_SQL('project=%s AND githash=%s',
                                 array($this->_project->id, $blob->hash));
             if (0 == Pluf::factory(__CLASS__)->getCount(array('filter' => $sql->gen()))) {
@@ -85,6 +87,8 @@ class IDF_Scm_Cache_Git extends Pluf_Model
                             array($this->_project->id));
         foreach (Pluf::factory(__CLASS__)->getList(array('filter' => $sql->gen())) as $blob) {
             $tmp = explode(chr(31), $blob->content, 3);
+            // sometimes the title might be empty
+            if (!isset($tmp[2])) $tmp[2] = '';
 
             $res[$blob->githash] = (object) array(
                                                   'hash' => $blob->githash,

src/IDF/Scm/Git.php

@@ -27,7 +27,7 @@
  */
 class IDF_Scm_Git extends IDF_Scm
 {
-    public $mediumtree_fmt = 'commit %H%nAuthor: %an <%ae>%nTree: %T%nDate: %ai%n%n%s%n%n%b';
+    public $mediumtree_fmt = 'commit %H%nAuthor: %an <%ae>%nTree: %T%nParents: %P%nDate: %ai%n%n%s%n%n%b';
 
     /* ============================================== *
      *                                                *
@@ -41,6 +41,60 @@ class IDF_Scm_Git extends IDF_Scm
         $this->project = $project;
     }
 
+    /**
+     * @see IDF_Scm::getChanges()
+     *
+     * Git command output is like :
+     * M       doc/Guide utilisateur/Manuel_distrib.tex
+     * M       doc/Guide utilisateur/Manuel_intro.tex
+     * M       doc/Guide utilisateur/Manuel_libpegase_exemples.tex
+     * M       doc/Guide utilisateur/Manuel_page1_version.tex
+     * A       doc/Guide utilisateur/images/ftp-nautilus.png
+     * M       doc/Guide utilisateur/textes/log_boot_PEGASE.txt
+     *
+     * Status letters mean : Added (A), Deleted (D), Modified (M), Renamed (R)
+     */
+    public function getChanges($commit)
+    {
+        $cmd = sprintf('GIT_DIR=%s '.Pluf::f('git_path', 'git').' show %s --name-status --pretty="format:" --diff-filter="[A|D|M|R]" -M',
+                   escapeshellarg($this->repo),
+                   escapeshellarg($commit));
+        $out = array();
+        $cmd = Pluf::f('idf_exec_cmd_prefix', '').$cmd;
+        self::exec('IDF_Scm_Git::getChanges', $cmd, $out);
+
+        $return = (object) array(
+            'additions'  => array(),
+            'deletions'  => array(),
+            'renames'    => array(),
+            'patches'    => array(),
+            'properties' => array(),
+        );
+
+        foreach ($out as $line) {
+            $line = trim($line);
+            if ($line != '') {
+                $action = $line[0];
+
+                if ($action == 'A') {
+                    $filename = trim(substr($line, 1));
+                    $return->additions[] = $filename;
+                } else if ($action == 'D') {
+                    $filename = trim(substr($line, 1));
+                    $return->deletions[] = $filename;
+                } else if ($action == 'M') {
+                    $filename = trim(substr($line, 1));
+                    $return->patches[] = $filename;
+                } else if ($action == 'R') {
+                    $matches = split ("\t", $line);
+                    $return->renames[$matches[1]] = $matches[2];
+                }
+            }
+        }
+
+        return $return;
+    }
+
     public function getRepositorySize()
     {
         if (!file_exists($this->repo)) {
@@ -113,7 +167,37 @@ class IDF_Scm_Git extends IDF_Scm
      */
     public function inBranches($commit, $path)
     {
-        return $this->_inObject($commit, 'branch');
+        if (isset($this->cache['inBranches'][$commit])) {
+            return $this->cache['inBranches'][$commit];
+        }
+
+        $cmd = Pluf::f('idf_exec_cmd_prefix', '')
+            .sprintf('GIT_DIR=%s %s branch --contains %s',
+                     escapeshellarg($this->repo),
+                     Pluf::f('git_path', 'git'),
+                     escapeshellarg($commit));
+        self::exec('IDF_Scm_Git::inBranches', $cmd, $out, $return);
+        if (0 != $return) {
+            throw new IDF_Scm_Exception(sprintf($this->error_tpl,
+                                                $cmd, $return,
+                                                implode("\n", $out)));
+        }
+
+        $res = array();
+        foreach ($out as $line) {
+            $res[] = substr($line, 2);
+        }
+
+        $this->cache['inBranches'][$commit] = $res;
+        return $res;
+    }
+
+    /**
+     * Will find the parents if available.
+     */
+    public function getExtraProperties($obj)
+    {
+        return (isset($obj->parents)) ? array('parents' => $obj->parents) : array();
     }
 
     /**
@@ -125,7 +209,7 @@ class IDF_Scm_Git extends IDF_Scm
             return $this->cache['tags'];
         }
         $cmd = Pluf::f('idf_exec_cmd_prefix', '')
-            .sprintf('GIT_DIR=%s %s tag',
+            .sprintf('GIT_DIR=%s %s for-each-ref --format="%%(objectname) %%(refname)" refs/tags',
                      escapeshellarg($this->repo),
                      Pluf::f('git_path', 'git'));
         self::exec('IDF_Scm_Git::getTags', $cmd, $out, $return);
@@ -134,15 +218,15 @@ class IDF_Scm_Git extends IDF_Scm
                                                 $cmd, $return,
                                                 implode("\n", $out)));
         }
+        rsort($out);
         $res = array();
         foreach ($out as $b) {
-            if (false !== strpos($b, '/')) {
-                $res[$this->getCommit($b)->commit] = $b;
-            } else {
-                $res[$b] = '';
-            }
+            $elts = explode(' ', $b, 2);
+            $tag = substr(trim($elts[1]), 10);  // Remove refs/tags/ prefix
+            $res[$tag] = '';
         }
         $this->cache['tags'] = $res;
+        
         return $res;
     }
 
@@ -151,35 +235,36 @@ class IDF_Scm_Git extends IDF_Scm
      **/
     public function inTags($commit, $path)
     {
-        return $this->_inObject($commit, 'tag');
+        if (isset($this->cache['inTags'][$commit])) {
+            return $this->cache['inTags'][$commit];
         }
 
-    /**
-     * Returns in which branches or tags a commit is.
-     *
-     * @param string Commit
-     * @param string Object's type: 'branch' or 'tag'.
-     * @return array
-     */
-    private function _inObject($commit, $object)
-    {
-        $object = strtolower($object);
-        if ('branch' === $object) {
-            $objects = $this->getBranches();
-        } else if ('tag' === $object) {
-            $objects = $this->getTags();
-        } else {
-            throw new InvalidArgumentException(sprintf(__('Invalid value for the parameter %1$s: %2$s. Use %3$s.'),
-                                                       '$object',
-                                                       $object,
-                                                       '\'branch\' or \'tag\''));
+        $cmd = Pluf::f('idf_exec_cmd_prefix', '')
+            .sprintf('GIT_DIR=%s %s tag --contains %s',
+                     escapeshellarg($this->repo),
+                     Pluf::f('git_path', 'git'),
+                     escapeshellarg($commit));
+        self::exec('IDF_Scm_Git::inTags', $cmd, $out, $return);
+        // `git tag` gained the `--contains` option in 1.6.2, earlier
+        // versions report a bad usage error (129) which we ignore here
+        if (129 == $return) {
+            $this->cache['inTags'][$commit] = array();
+            return array();
         }
-        unset($object);
-        $result = array();
-        if (array_key_exists($commit, $objects)) {
-            $result[] = $commit;
+        // any other error should of course get noted
+        if (0 != $return) {
+            throw new IDF_Scm_Exception(sprintf($this->error_tpl,
+                                                $cmd, $return,
+                                                implode("\n", $out)));
         }
-        return $result;
+
+        $res = array();
+        foreach ($out as $line) {
+            $res[] = $line;
+        }
+
+        $this->cache['inTags'][$commit] = $res;
+        return $res;
     }
 
     /**
@@ -260,23 +345,29 @@ class IDF_Scm_Git extends IDF_Scm
         if (!preg_match('/<(.*)>/', $author, $match)) {
             return null;
         }
-        foreach (array('email', 'login') as $what) {
-            $sql = new Pluf_SQL($what.'=%s', array($match[1]));
+        $sql = new Pluf_SQL('login=%s', array($match[1]));
         $users = Pluf::factory('Pluf_User')->getList(array('filter'=>$sql->gen()));
         if ($users->count() > 0) {
             return $users[0];
         }
-        }
-        return null;
+        return Pluf::factory('IDF_EmailAddress')->get_user_for_email_address($match[1]);
     }
 
-    public static function getAnonymousAccessUrl($project)
+    public static function getAnonymousAccessUrl($project, $commit=null)
     {
         return sprintf(Pluf::f('git_remote_url'), $project->shortname);
     }
 
-    public static function getAuthAccessUrl($project, $user)
+    public static function getAuthAccessUrl($project, $user, $commit=null)
     {
+        // if the user haven't registred a public ssh key,
+        // he can't use the write url which use the SSH authentification
+        if ($user != null) {
+            $keys = $user->get_idf_key_list();
+            if (count ($keys) == 0)
+                return self::getAnonymousAccessUrl($project);
+        }
+
         return sprintf(Pluf::f('git_write_remote_url'), $project->shortname);
     }
 
@@ -293,10 +384,12 @@ class IDF_Scm_Git extends IDF_Scm
     }
 
 
-    public function isValidRevision($commit)
+    public function validateRevision($commit)
     {
         $type = $this->testHash($commit);
-        return ('commit' == $type || 'tag' == $type);
+        if ('commit' == $type || 'tag' == $type)
+            return IDF_Scm::REVISION_VALID;
+        return IDF_Scm::REVISION_INVALID;
     }
 
     /**
@@ -426,11 +519,13 @@ class IDF_Scm_Git extends IDF_Scm
                 }
             }
             $out = self::parseLog($log);
-            $out[0]->changes = implode("\n", $change);
+            $out[0]->diff = implode("\n", $change);
         } else {
             $out = self::parseLog($out);
-            $out[0]->changes = '';
+            $out[0]->diff = '';
         }
+
+        $out[0]->branch = implode(', ', $this->inBranches($out[0]->commit, null));
         return $out[0];
     }
 
@@ -503,6 +598,9 @@ class IDF_Scm_Git extends IDF_Scm
                     $c['full_message'] = trim($c['full_message']);
                     $c['full_message'] = IDF_Commit::toUTF8($c['full_message']);
                     $c['title'] = IDF_Commit::toUTF8($c['title']);
+                    if (isset($c['parents'])) {
+                        $c['parents'] = explode(' ', trim($c['parents']));
+                    }
                     $res[] = (object) $c;
                 }
                 $c = array();
@@ -538,17 +636,29 @@ class IDF_Scm_Git extends IDF_Scm
         $c['full_message'] = !empty($c['full_message']) ? trim($c['full_message']) : '';
         $c['full_message'] = IDF_Commit::toUTF8($c['full_message']);
         $c['title'] = IDF_Commit::toUTF8($c['title']);
+        if (isset($c['parents'])) {
+            $c['parents'] = explode(' ', trim($c['parents']));
+        }
         $res[] = (object) $c;
         return $res;
     }
 
-    public function getArchiveCommand($commit, $prefix='repository/')
+    public function getArchiveStream($commit, $prefix='repository/')
     {
-        return sprintf(Pluf::f('idf_exec_cmd_prefix', '').
+        $cmd = sprintf(Pluf::f('idf_exec_cmd_prefix', '').
                        'GIT_DIR=%s '.Pluf::f('git_path', 'git').' archive --format=zip --prefix=%s %s',
                        escapeshellarg($this->repo),
                        escapeshellarg($prefix),
                        escapeshellarg($commit));
+        return new Pluf_HTTP_Response_CommandPassThru($cmd, 'application/x-zip');
+    }
+
+    /**
+     * @see IDF_Scm::getDiffPathStripLevel()
+     */
+    public function getDiffPathStripLevel()
+    {
+        return 1;
     }
 
     /*

src/IDF/Scm/Mercurial.php

@@ -27,10 +27,13 @@
  */
 class IDF_Scm_Mercurial extends IDF_Scm
 {
+    protected $hg_log_template;
+
     public function __construct($repo, $project=null)
     {
         $this->repo = $repo;
         $this->project = $project;
+        $this->hg_log_template = "'".'changeset: {rev}:{node|short}\nauthor: {author}\ndate: {date|isodate}\nfiles: {files}\n{desc}\n'."'";
     }
 
     public function getRepositorySize()
@@ -67,9 +70,7 @@ class IDF_Scm_Mercurial extends IDF_Scm
         if (!preg_match('/<(.*)>/', $author, $match)) {
             return null;
         }
-        $sql = new Pluf_SQL('email=%s', array($match[1]));
-        $users = Pluf::factory('Pluf_User')->getList(array('filter'=>$sql->gen()));
-        return ($users->count() > 0) ? $users[0] : null;
+        return Pluf::factory('IDF_EmailAddress')->get_user_for_email_address($match[1]);
     }
 
     public function getMainBranch()
@@ -77,24 +78,29 @@ class IDF_Scm_Mercurial extends IDF_Scm
         return 'tip';
     }
 
-    public static function getAnonymousAccessUrl($project)
+    public static function getAnonymousAccessUrl($project, $commit=null)
     {
         return sprintf(Pluf::f('mercurial_remote_url'), $project->shortname);
     }
 
-    public static function getAuthAccessUrl($project, $user)
+    public static function getAuthAccessUrl($project, $user, $commit=null)
     {
         return sprintf(Pluf::f('mercurial_remote_url'), $project->shortname);
     }
 
-    public function isValidRevision($rev)
+    public function validateRevision($rev)
     {
         $cmd = sprintf(Pluf::f('hg_path', 'hg').' log -R %s -r %s',
                        escapeshellarg($this->repo),
                        escapeshellarg($rev));
         $cmd = Pluf::f('idf_exec_cmd_prefix', '').$cmd;
-        self::exec('IDF_Scm_Mercurial::isValidRevision', $cmd, $out, $ret);
-        return ($ret == 0) && (count($out) > 0);
+        self::exec('IDF_Scm_Mercurial::validateRevision', $cmd, $out, $ret);
+
+        // FIXME: apparently a given hg revision can also be ambigious -
+        //        handle this case here sometime
+        if ($ret == 0 && count($out) > 0)
+            return IDF_Scm::REVISION_VALID;
+        return IDF_Scm::REVISION_INVALID;
     }
 
     /**
@@ -330,13 +336,17 @@ class IDF_Scm_Mercurial extends IDF_Scm
      */
     public function getCommit($commit, $getdiff=false)
     {
-        if (!$this->isValidRevision($commit)) {
+        if ($this->validateRevision($commit) != IDF_Scm::REVISION_VALID) {
             return false;
         }
-        $tmpl = ($getdiff) ? 
-            Pluf::f('hg_path', 'hg').' log -p -r %s -R %s' : Pluf::f('hg_path', 'hg').' log -r %s -R %s';
+        $tmpl = ($getdiff)
+            ? Pluf::f('hg_path', 'hg').' log -p -r %s -R %s --template %s'
+            : Pluf::f('hg_path', 'hg').' log -r %s -R %s --template %s';
         $cmd = sprintf($tmpl,
-                       escapeshellarg($commit), escapeshellarg($this->repo));
+                       escapeshellarg($commit),
+                       escapeshellarg($this->repo),
+                       $this->hg_log_template);
+
         $out = array();
         $cmd = Pluf::f('idf_exec_cmd_prefix', '').$cmd;
         self::exec('IDF_Scm_Mercurial::getCommit', $cmd, $out);
@@ -353,8 +363,8 @@ class IDF_Scm_Mercurial extends IDF_Scm
                 $log[] = $line;
             }
         }
-        $out = self::parseLog($log, 6);
-        $out[0]->changes = implode("\n", $change);
+        $out = self::parseLog($log, 4);
+        $out[0]->diff = implode("\n", $change);
         return $out[0];
     }
 
@@ -378,11 +388,11 @@ class IDF_Scm_Mercurial extends IDF_Scm
      */
     public function getChangeLog($commit='tip', $n=10)
     {
-        $cmd = sprintf(Pluf::f('hg_path', 'hg').' log -R %s -l%s ', escapeshellarg($this->repo), $n, $commit);
+        $cmd = sprintf(Pluf::f('hg_path', 'hg').' log -R %s -l%s --template %s', escapeshellarg($this->repo), $n, $this->hg_log_template, $commit);
         $out = array();
         $cmd = Pluf::f('idf_exec_cmd_prefix', '').$cmd;
         self::exec('IDF_Scm_Mercurial::getChangeLog', $cmd, $out);
-        return self::parseLog($out, 6);
+        return self::parseLog($out, 4);
     }
 
     /**
@@ -418,12 +428,14 @@ class IDF_Scm_Mercurial extends IDF_Scm
                 continue;
             }
             $match = array();
-            if (preg_match('/(\S+)\s*:\s*(.*)/', $line, $match)) {
+            if (preg_match('/^(\S+):\s*(.*)/', $line, $match)) {
                 $match[1] = strtolower($match[1]);
                 if ($match[1] == 'user') {
                     $c['author'] = $match[2];
                 } elseif ($match[1] == 'summary') {
                     $c['title'] = $match[2];
+                } elseif ($match[1] == 'branch') {
+                    $c['branch'] = $match[2];
                 } else {
                     $c[$match[1]] = trim($match[2]);
                 }
@@ -438,23 +450,33 @@ class IDF_Scm_Mercurial extends IDF_Scm
             }
         }
         $c['tree'] = !empty($c['commit']) ? trim($c['commit']) : '';
+        $c['branch'] = empty($c['branch']) ? 'default' : $c['branch'];
         $c['full_message'] = !empty($c['full_message']) ? trim($c['full_message']) : '';
         $res[] = (object) $c;
         return $res;
     }
 
     /**
-     * Generate the command to create a zip archive at a given commit.
+     * Generate a zip archive at a given commit.
      *
      * @param string Commit
      * @param string Prefix ('git-repo-dump')
-     * @return string Command
+     * @return Pluf_HTTP_Response The HTTP response containing the zip archive
      */
-    public function getArchiveCommand($commit, $prefix='')
+    public function getArchiveStream($commit, $prefix='')
     {
-        return sprintf(Pluf::f('idf_exec_cmd_prefix', '').
+        $cmd = sprintf(Pluf::f('idf_exec_cmd_prefix', '').
                        Pluf::f('hg_path', 'hg').' archive --type=zip -R %s -r %s -',
                        escapeshellarg($this->repo),
                        escapeshellarg($commit));
+        return new Pluf_HTTP_Response_CommandPassThru($cmd, 'application/x-zip');
+    }
+
+    /**
+     * @see IDF_Scm::getDiffPathStripLevel()
+     */
+    public function getDiffPathStripLevel()
+    {
+        return 1;
     }
 }

src/IDF/Scm/Monotone.php

@@ -0,0 +1,796 @@
+<?php
+/* -*- tab-width: 4; indent-tabs-mode: nil; c-basic-offset: 4 -*- */
+/*
+# ***** BEGIN LICENSE BLOCK *****
+# This file is part of InDefero, an open source project management application.
+# Copyright (C) 2010 Céondo Ltd and contributors.
+#
+# InDefero is free software; you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation; either version 2 of the License, or
+# (at your option) any later version.
+#
+# InDefero is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write to the Free Software
+# Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA  02110-1301  USA
+#
+# ***** END LICENSE BLOCK ***** */
+
+/**
+ * Monotone scm class
+ *
+ * @author Thomas Keller <me@thomaskeller.biz>
+ */
+class IDF_Scm_Monotone extends IDF_Scm
+{
+    /** the minimum supported interface version */
+    public static $MIN_INTERFACE_VERSION = 12.0;
+
+    private $stdio;
+
+    private static $instances = array();
+
+    /**
+     * @see IDF_Scm::__construct()
+     */
+    public function __construct($project)
+    {
+        $this->project = $project;
+        $this->stdio = new IDF_Scm_Monotone_Stdio($project);
+    }
+
+    /**
+     * Returns the stdio instance in use
+     *
+     * @return IDF_Scm_Monotone_Stdio
+     */
+    public function getStdio()
+    {
+        return $this->stdio;
+    }
+
+    /**
+     * @see IDF_Scm::getRepositorySize()
+     */
+    public function getRepositorySize()
+    {
+        // FIXME: this obviously won't work with remote databases - upstream
+        // needs to implement mtn db info in automate at first
+        $repo = sprintf(Pluf::f('mtn_repositories'), $this->project->shortname);
+        if (!file_exists($repo)) {
+            return 0;
+        }
+
+        $cmd = Pluf::f('idf_exec_cmd_prefix', '').'du -sk '
+            .escapeshellarg($repo);
+        $out = explode(' ',
+                       self::shell_exec('IDF_Scm_Monotone::getRepositorySize', $cmd),
+                       2);
+        return (int) $out[0]*1024;
+    }
+
+    /**
+     * @see IDF_Scm::isAvailable()
+     */
+    public function isAvailable()
+    {
+        try
+        {
+            $out = $this->stdio->exec(array('interface_version'));
+            return floatval($out) >= self::$MIN_INTERFACE_VERSION;
+        }
+        catch (IDF_Scm_Exception $e) {}
+
+        return false;
+    }
+
+    /**
+     * @see IDF_Scm::getBranches()
+     */
+    public function getBranches()
+    {
+        if (isset($this->cache['branches'])) {
+            return $this->cache['branches'];
+        }
+        // FIXME: we could / should introduce handling of suspended
+        // (i.e. dead) branches here by hiding them from the user's eye...
+        $out = $this->stdio->exec(array('branches'));
+
+        // note: we could expand each branch with one of its head revisions
+        // here, but these would soon become bogus anyway and we cannot
+        // map multiple head revisions here either, so we just use the
+        // selector as placeholder
+        $res = array();
+        foreach (preg_split("/\n/", $out, -1, PREG_SPLIT_NO_EMPTY) as $b) {
+            $res["h:$b"] = $b;
+        }
+
+        $this->cache['branches'] = $res;
+        return $res;
+    }
+
+    /**
+     * monotone has no concept of a "main" branch, so just return
+     * the configured one. Ensure however that we can select revisions
+     * with it at all.
+     *
+     * @see IDF_Scm::getMainBranch()
+     */
+    public function getMainBranch()
+    {
+        $conf = $this->project->getConf();
+        if (false === ($branch = $conf->getVal('mtn_master_branch', false))
+            || empty($branch)) {
+            $branch = "*";
+        }
+
+        return $branch;
+    }
+
+    /**
+     * @see IDF_Scm::getArchiveStream
+     */
+    public function getArchiveStream($commit, $prefix='repository/')
+    {
+        $revs = $this->_resolveSelector($commit);
+        // sanity: this should actually not happen, because the
+        // revision is validated before already
+        if (count($revs) == 0) {
+            return new Pluf_HTTP_Response_NotFound();
+        }
+        return new IDF_Scm_Monotone_ZipRender($this->stdio, $revs[0]);
+    }
+
+    /**
+     * expands a selector or a partial revision id to zero, one or
+     * multiple 40 byte revision ids
+     *
+     * @param string $selector
+     * @return array
+     */
+    private function _resolveSelector($selector)
+    {
+        $out = $this->stdio->exec(array('select', $selector));
+        return preg_split("/\n/", $out, -1, PREG_SPLIT_NO_EMPTY);
+    }
+
+    /**
+     * Queries the certs for a given revision and returns them in an
+     * associative array array("branch" => array("branch1", ...), ...)
+     *
+     * @param string
+     * @param array
+     */
+    private function _getCerts($rev)
+    {
+        $cache = Pluf_Cache::factory();
+        $cachekey = 'mtn-plugin-certs-for-rev-' . $rev;
+        $certs = $cache->get($cachekey);
+
+        if ($certs === null) {
+            $out = $this->stdio->exec(array('certs', $rev));
+
+            $stanzas = IDF_Scm_Monotone_BasicIO::parse($out);
+            $certs = array();
+            foreach ($stanzas as $stanza) {
+                $certname = null;
+                foreach ($stanza as $stanzaline) {
+                    // luckily, name always comes before value
+                    if ($stanzaline['key'] == 'name') {
+                        $certname = $stanzaline['values'][0];
+                        continue;
+                    }
+
+                    if ($stanzaline['key'] == 'value') {
+                        if (!array_key_exists($certname, $certs)) {
+                            $certs[$certname] = array();
+                        }
+
+                        $certs[$certname][] = $stanzaline['values'][0];
+                        break;
+                    }
+                }
+            }
+            $cache->set($cachekey, $certs);
+        }
+
+        return $certs;
+    }
+
+    /**
+     * Returns unique certificate values for the given revs and the specific
+     * cert name, optionally prefixed with $prefix
+     *
+     * @param array
+     * @param string
+     * @param string
+     * @return array
+     */
+    private function _getUniqueCertValuesFor($revs, $certName, $prefix)
+    {
+        $certValues = array();
+        foreach ($revs as $rev) {
+            $certs = $this->_getCerts($rev);
+            if (!array_key_exists($certName, $certs))
+                continue;
+            foreach ($certs[$certName] as $certValue) {
+                $certValues[] = "$prefix$certValue";
+            }
+        }
+        return array_unique($certValues);
+    }
+
+    /**
+     * @see IDF_Scm::inBranches()
+     */
+    public function inBranches($commit, $path)
+    {
+        $revs = $this->_resolveSelector($commit);
+        if (count($revs) == 0) return array();
+        return $this->_getUniqueCertValuesFor($revs, 'branch', 'h:');
+    }
+
+    /**
+     * @see IDF_Scm::getTags()
+     */
+    public function getTags()
+    {
+        if (isset($this->cache['tags'])) {
+            return $this->cache['tags'];
+        }
+
+        $out = $this->stdio->exec(array('tags'));
+
+        $tags = array();
+        $stanzas = IDF_Scm_Monotone_BasicIO::parse($out);
+        foreach ($stanzas as $stanza) {
+            $tagname = null;
+            foreach ($stanza as $stanzaline) {
+                // revision comes directly after the tag stanza
+                if ($stanzaline['key'] == 'tag') {
+                    $tagname = $stanzaline['values'][0];
+                    continue;
+                }
+                if ($stanzaline['key'] == 'revision') {
+                    // FIXME: warn if multiple revisions have
+                    // equally named tags
+                    if (!array_key_exists("t:$tagname", $tags)) {
+                        $tags["t:$tagname"] = $tagname;
+                    }
+                    break;
+                }
+            }
+        }
+
+        $this->cache['tags'] = $tags;
+        return $tags;
+    }
+
+    /**
+     * @see IDF_Scm::inTags()
+     */
+    public function inTags($commit, $path)
+    {
+        $revs = $this->_resolveSelector($commit);
+        if (count($revs) == 0) return array();
+        return $this->_getUniqueCertValuesFor($revs, 'tag', 't:');
+    }
+
+    /**
+     * Takes a single stanza coming from an extended manifest output
+     * and converts it into a file structure used by IDF
+     *
+     * @param string $forceBasedir  If given then the element's path is checked
+     *                              to be directly beneath the given directory.
+     *                              If not, null is returned and the parsing is
+     *                              aborted.
+     * @return array | null
+     */
+    private function _fillFileEntry(array $manifestEntry, $forceBasedir = null)
+    {
+        $fullpath = $manifestEntry[0]['values'][0];
+        $filename = basename($fullpath);
+        $dirname = dirname($fullpath);
+        $dirname = $dirname == '.' ? '' : $dirname;
+
+        if ($forceBasedir !== null && $forceBasedir != $dirname) {
+            return null;
+        }
+
+        $file = array();
+        $file['file'] = $filename;
+        $file['fullpath'] = $fullpath;
+        $file['efullpath'] = self::smartEncode($fullpath);
+
+        $wanted_mark = '';
+        if ($manifestEntry[0]['key'] == 'dir') {
+            $file['type'] = 'tree';
+            $file['size'] = 0;
+            $wanted_mark = 'path_mark';
+        }
+        else {
+            $file['type'] = 'blob';
+            $file['hash'] = $manifestEntry[1]['hash'];
+            $size = 0;
+            foreach ($manifestEntry as $line) {
+                if ($line['key'] == 'size') {
+                    $size = $line['values'][0];
+                    break;
+                }
+            }
+            $file['size'] = $size;
+            $wanted_mark = 'content_mark';
+        }
+
+        $rev_mark = null;
+        foreach ($manifestEntry as $line) {
+            if ($line['key'] == $wanted_mark) {
+                $rev_mark = $line['hash'];
+                break;
+            }
+        }
+
+        if ($rev_mark !== null) {
+            $file['rev'] = $rev_mark;
+            $certs = $this->_getCerts($rev_mark);
+
+            // FIXME: this assumes that author, date and changelog are always given
+            $file['author'] = implode(", ", $certs['author']);
+
+            $dates = array();
+            foreach ($certs['date'] as $date)
+                $dates[] = date('Y-m-d H:i:s', strtotime($date));
+            $file['date'] = implode(', ', $dates);
+            $combinedChangelog = implode("\n---\n", $certs['changelog']);
+            $split = preg_split("/[\n\r]/", $combinedChangelog, 2);
+            // FIXME: the complete log message is currently not used in the
+            // tree view (the same is true for the other SCM implementations)
+            // but we _should_ really use or at least return that here
+            // in case we want to do fancy stuff like described in
+            // issue 492
+            $file['log'] =  $split[0];
+        }
+
+        return $file;
+    }
+
+    /**
+     * @see IDF_Scm::getTree()
+     */
+    public function getTree($commit, $folder='/', $branch=null)
+    {
+        $revs = $this->_resolveSelector($commit);
+        if (count($revs) == 0) {
+            return array();
+        }
+
+        $out = $this->stdio->exec(array(
+            'get_extended_manifest_of', $revs[0]
+        ));
+
+        $files = array();
+        $stanzas = IDF_Scm_Monotone_BasicIO::parse($out);
+        $folder = $folder == '/' || empty($folder) ? '' : $folder;
+
+        foreach ($stanzas as $stanza) {
+            if ($stanza[0]['key'] == 'format_version')
+                continue;
+
+            $file = $this->_fillFileEntry($stanza, $folder);
+            if ($file === null)
+                continue;
+
+            $files[] = (object) $file;
+        }
+        return $files;
+    }
+
+    /**
+     * @see IDF_Scm::findAuthor()
+     */
+    public function findAuthor($author)
+    {
+        // We extract anything which looks like an email.
+        $match = array();
+        if (!preg_match('/([^ ]+@[^ ]+)/', $author, $match)) {
+            return null;
+        }
+        $sql = new Pluf_SQL('login=%s', array($match[1]));
+        $users = Pluf::factory('Pluf_User')->getList(array('filter'=>$sql->gen()));
+        if ($users->count() > 0) {
+            return $users[0];
+        }
+        return Pluf::factory('IDF_EmailAddress')->get_user_for_email_address($match[1]);
+    }
+
+    /**
+     * @see IDF_Scm::getAnonymousAccessUrl()
+     */
+    public static function getAnonymousAccessUrl($project, $commit = null)
+    {
+        $scm = IDF_Scm::get($project);
+        $branch = $scm->getMainBranch();
+
+        if (!empty($commit)) {
+            $revs = $scm->_resolveSelector($commit);
+            if (count($revs) > 0) {
+                $certs = $scm->_getCerts($revs[0]);
+                // for the very seldom case that a revision
+                // has no branch certificate
+                if (!array_key_exists('branch', $certs)) {
+                    $branch = '*';
+                }
+                else
+                {
+                    $branch = $certs['branch'][0];
+                }
+            }
+        }
+
+        $remote_url = Pluf::f('mtn_remote_url', '');
+        if (empty($remote_url)) {
+            return '';
+        }
+
+        return sprintf($remote_url, $project->shortname).'?'.$branch;
+    }
+
+    /**
+     * @see IDF_Scm::getAuthAccessUrl()
+     */
+    public static function getAuthAccessUrl($project, $user, $commit = null)
+    {
+        $url = self::getAnonymousAccessUrl($project, $commit);
+        return preg_replace("#^ssh://#", "ssh://$user@", $url);
+    }
+
+    /**
+     * Returns this object correctly initialized for the project.
+     *
+     * @param IDF_Project
+     * @return IDF_Scm_Monotone
+     */
+    public static function factory($project)
+    {
+        if (!array_key_exists($project->shortname, self::$instances)) {
+            self::$instances[$project->shortname] =
+                new IDF_Scm_Monotone($project);
+        }
+        return self::$instances[$project->shortname];
+    }
+
+    /**
+     * @see IDF_Scm::validateRevision()
+     */
+    public function validateRevision($commit)
+    {
+        $revs = $this->_resolveSelector($commit);
+        if (count($revs) == 0)
+            return IDF_Scm::REVISION_INVALID;
+
+        if (count($revs) > 1)
+            return IDF_Scm::REVISION_AMBIGUOUS;
+
+        return IDF_Scm::REVISION_VALID;
+    }
+
+    /**
+     * @see IDF_Scm::disambiguateRevision
+     */
+    public function disambiguateRevision($commit)
+    {
+        $revs = $this->_resolveSelector($commit);
+
+        $out = array();
+        foreach ($revs as $rev)
+        {
+            $certs = $this->_getCerts($rev);
+
+            $log = array();
+            $log['author'] = implode(', ', $certs['author']);
+
+            $log['branch'] = implode(', ', $certs['branch']);
+
+            $dates = array();
+            foreach ($certs['date'] as $date)
+                $dates[] = date('Y-m-d H:i:s', strtotime($date));
+            $log['date'] = implode(', ', $dates);
+
+            $combinedChangelog = implode("\n---\n", $certs['changelog']);
+            $split = preg_split("/[\n\r]/", $combinedChangelog, 2);
+            $log['title'] = $split[0];
+            $log['full_message'] = (isset($split[1])) ? trim($split[1]) : '';
+
+            $log['commit'] = $rev;
+
+            $out[] = (object)$log;
+        }
+
+        return $out;
+    }
+
+    /**
+     * @see IDF_Scm::getPathInfo()
+     */
+    public function getPathInfo($file, $commit = null)
+    {
+        if ($commit === null) {
+            $commit = 'h:' . $this->getMainBranch();
+        }
+
+        $revs = $this->_resolveSelector($commit);
+        if (count($revs) == 0)
+            return false;
+
+        $out = $this->stdio->exec(array(
+            'get_extended_manifest_of', $revs[0]
+        ));
+
+        $files = array();
+        $stanzas = IDF_Scm_Monotone_BasicIO::parse($out);
+
+        foreach ($stanzas as $stanza) {
+            if ($stanza[0]['key'] == 'format_version')
+                continue;
+
+            if ($stanza[0]['values'][0] != $file)
+                continue;
+
+            $file = $this->_fillFileEntry($stanza);
+            return (object) $file;
+        }
+        return false;
+    }
+
+    /**
+     * @see IDF_Scm::getFile()
+     */
+    public function getFile($def, $cmd_only=false)
+    {
+        // this won't work with remote databases
+        if ($cmd_only) {
+            throw new Pluf_Exception_NotImplemented();
+        }
+
+        return $this->stdio->exec(array('get_file', $def->hash));
+    }
+
+    /**
+     * Returns the differences between two revisions as unified diff
+     *
+     * @param string    The target of the diff
+     * @param string    The source of the diff, if not given, the first
+     *                  parent of the target is used
+     * @return string
+     */
+    private function _getDiff($target, $source = null)
+    {
+        if (empty($source)) {
+            $source = "p:$target";
+        }
+
+        // FIXME: add real support for merge revisions here which have
+        // two distinct diff sets
+        $targets = $this->_resolveSelector($target);
+        $sources = $this->_resolveSelector($source);
+
+        if (count($targets) == 0 || count($sources) == 0) {
+            return '';
+        }
+
+        // if target contains a root revision, we cannot produce a diff
+        if (empty($sources[0])) {
+            return '';
+        }
+
+        return $this->stdio->exec(
+            array('content_diff'),
+            array('r' => array($sources[0], $targets[0]))
+        );
+    }
+
+    /**
+     * @see IDF_Scm::getChanges()
+     */
+    public function getChanges($commit)
+    {
+        $revs = $this->_resolveSelector($commit);
+        if (count($revs) == 0)
+            return null;
+
+        $revision = $revs[0];
+        $out = $this->stdio->exec(array('get_revision', $revision));
+        $stanzas = IDF_Scm_Monotone_BasicIO::parse($out);
+
+        $return = (object) array(
+            'additions'  => array(),
+            'deletions'  => array(),
+            'renames'    => array(),
+            'patches'    => array(),
+            'properties' => array(),
+        );
+
+        foreach ($stanzas as $stanza) {
+            if ($stanza[0]['key'] == 'format_version' ||
+                $stanza[0]['key'] == 'old_revision' ||
+                $stanza[0]['key'] == 'new_manifest')
+                continue;
+
+            if ($stanza[0]['key'] == 'add_file' ||
+                $stanza[0]['key'] == 'add_dir') {
+                $return->additions[] = $stanza[0]['values'][0];
+                continue;
+            }
+
+            if ($stanza[0]['key'] == 'delete') {
+                $return->deletions[] = $stanza[0]['values'][0];
+                continue;
+            }
+
+            if ($stanza[0]['key'] == 'rename') {
+                $return->renames[$stanza[0]['values'][0]] =
+                    $stanza[1]['values'][0];
+                continue;
+            }
+
+            if ($stanza[0]['key'] == 'patch') {
+                $return->patches[] = $stanza[0]['values'][0];
+                continue;
+            }
+
+            if ($stanza[0]['key'] == 'clear' ||
+                $stanza[0]['key'] == 'set') {
+
+                $filename = $stanza[0]['values'][0];
+                if (!array_key_exists($filename, $return->properties)) {
+                    $return->properties[$filename] = array();
+                }
+                $key = $stanza[1]['values'][0];
+                $value = null;
+                if (isset($stanza[2])) {
+                    $value = $stanza[2]['values'][0];
+                }
+                $return->properties[$filename][$key] = $value;
+                continue;
+            }
+        }
+
+        return $return;
+    }
+
+    /**
+     * @see IDF_Scm::getCommit()
+     */
+    public function getCommit($commit, $getdiff=false)
+    {
+        $revs = $this->_resolveSelector($commit);
+        if (count($revs) == 0)
+            return array();
+
+        $res = array();
+
+        $parents = $this->stdio->exec(array('parents', $revs[0]));
+        $res['parents'] = preg_split("/\n/", $parents, -1, PREG_SPLIT_NO_EMPTY);
+        
+        $certs = $this->_getCerts($revs[0]);        
+        // FIXME: this assumes that author, date and changelog are always given
+        $res['author'] = implode(', ', $certs['author']);
+
+        $dates = array();
+        foreach ($certs['date'] as $date)
+            $dates[] = date('Y-m-d H:i:s', strtotime($date));
+        $res['date'] = implode(', ', $dates);
+
+        $combinedChangelog = implode("\n---\n", $certs['changelog']);
+        $split = preg_split("/[\n\r]/", $combinedChangelog, 2);
+        $res['title'] = $split[0];
+        $res['full_message'] = (isset($split[1])) ? trim($split[1]) : '';
+
+        $res['branch'] = implode(', ', $certs['branch']);
+        $res['commit'] = $revs[0];
+
+        $res['diff'] = ($getdiff) ? $this->_getDiff($revs[0]) : '';
+
+        return (object) $res;
+    }
+
+    /**
+     * @see IDF_Scm::getExtraProperties
+     */
+    public function getExtraProperties($obj)
+    {
+        return (isset($obj->parents)) ? array('parents' => $obj->parents) : array();
+    }
+
+    /**
+     * @see IDF_Scm::isCommitLarge()
+     */
+    public function isCommitLarge($commit=null)
+    {
+        if (empty($commit)) {
+            $commit = 'h:'.$this->getMainBranch();
+        }
+
+        $revs = $this->_resolveSelector($commit);
+        if (count($revs) == 0)
+            return false;
+
+        $out = $this->stdio->exec(array(
+            'get_revision', $revs[0]
+        ));
+
+        $newAndPatchedFiles = 0;
+        $stanzas = IDF_Scm_Monotone_BasicIO::parse($out);
+
+        foreach ($stanzas as $stanza) {
+            if ($stanza[0]['key'] == 'patch' || $stanza[0]['key'] == 'add_file')
+                $newAndPatchedFiles++;
+        }
+
+        return $newAndPatchedFiles > 100;
+    }
+
+    /**
+     * @see IDF_Scm::getChangeLog()
+     */
+    public function getChangeLog($commit=null, $n=10)
+    {
+        $horizont = $this->_resolveSelector($commit);
+        $initialBranches = array();
+        $logs = array();
+
+        while (!empty($horizont) && $n > 0) {
+            if (count($horizont) > 1) {
+                $out = $this->stdio->exec(array('toposort') + $horizont);
+                $horizont = preg_split("/\n/", $out, -1, PREG_SPLIT_NO_EMPTY);
+            }
+
+            $rev = array_shift($horizont);
+            $certs = $this->_getCerts($rev);
+
+            // read in the initial branches we should follow
+            if (count($initialBranches) == 0) {
+                if (!isset($certs['branch'])) {
+                    // this revision has no branch cert, we cannot start logging
+                    // from this revision
+                    continue;
+                }
+                $initialBranches = $certs['branch'];
+            }
+
+            // only add it to our log if it is on one of the initial branches
+            // ignore revisions without any branch certificate
+            if (count(array_intersect($initialBranches, (array)@$certs['branch'])) > 0) {
+                --$n;
+
+                $log = array();
+                $log['author'] = implode(', ', $certs['author']);
+
+                $dates = array();
+                foreach ($certs['date'] as $date)
+                    $dates[] = date('Y-m-d H:i:s', strtotime($date));
+                $log['date'] = implode(', ', $dates);
+
+                $combinedChangelog = implode("\n---\n", $certs['changelog']);
+                $split = preg_split("/[\n\r]/", $combinedChangelog, 2);
+                $log['title'] = $split[0];
+                $log['full_message'] = (isset($split[1])) ? trim($split[1]) : '';
+
+                $log['commit'] = $rev;
+
+                $logs[] = (object)$log;
+
+                $out = $this->stdio->exec(array('parents', $rev));
+                $horizont += preg_split("/\n/", $out, -1, PREG_SPLIT_NO_EMPTY);
+            }
+        }
+
+        return $logs;
+    }
+}
+

src/IDF/Scm/Monotone/BasicIO.php

@@ -0,0 +1,174 @@
+<?php
+/* -*- tab-width: 4; indent-tabs-mode: nil; c-basic-offset: 4 -*- */
+/*
+# ***** BEGIN LICENSE BLOCK *****
+# This file is part of InDefero, an open source project management application.
+# Copyright (C) 2010 Céondo Ltd and contributors.
+#
+# InDefero is free software; you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation; either version 2 of the License, or
+# (at your option) any later version.
+#
+# InDefero is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write to the Free Software
+# Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA  02110-1301  USA
+#
+# ***** END LICENSE BLOCK ***** */
+
+/**
+ * Utility class to parse and compile basic_io stanzas
+ *
+ * @author Thomas Keller <me@thomaskeller.biz>
+ */
+class IDF_Scm_Monotone_BasicIO
+{
+    /**
+     * Parses monotone's basic_io format
+     *
+     * @param string $in
+     * @return array of arrays
+     */
+    public static function parse($in)
+    {
+        $pos = 0;
+        $stanzas = array();
+        $length = strlen($in);
+
+        while ($pos < $length) {
+            $stanza = array();
+            while ($pos < $length) {
+                if ($in[$pos] == "\n") break;
+
+                $stanzaLine = array('key' => '', 'values' => array(), 'hash' => null);
+                while ($pos < $length) {
+                    $ch = $in[$pos];
+                    if ($ch == '"' || $ch == '[') break;
+                    ++$pos;
+                    if ($ch == ' ') continue;
+                    $stanzaLine['key'] .= $ch;
+                }
+
+                // symbol w/o a value list
+                if ($pos >= $length || $in[$pos] == "\n") break;
+ 
+                if ($in[$pos] == '[') {
+                    unset($stanzaLine['values']);
+                    ++$pos; // opening square bracket
+                    $stanzaLine['hash'] = substr($in, $pos, 40);
+                    $pos += 40;
+                    ++$pos; // closing square bracket
+                }
+                else
+                {
+                    unset($stanzaLine['hash']);
+                    $valCount = 0;
+                    // if hashs and plain values are encountered in the same
+                    // value list, we add the hash values as simple values as well
+                    while ($in[$pos] == '"' || $in[$pos] == '[') {
+                        $isHashValue = $in[$pos] == '[';
+                        ++$pos; // opening quote / bracket
+                        $stanzaLine['values'][$valCount] = '';
+                        while ($pos < $length) {
+                            $ch = $in[$pos]; $pr = $in[$pos-1];
+                            if (($isHashValue && $ch == ']')
+                                ||(!$isHashValue && $ch == '"' && $pr != '\\'))
+                                 break;
+                            ++$pos;
+                            $stanzaLine['values'][$valCount] .= $ch;
+                        }
+                        ++$pos; // closing quote
+
+                        if (!$isHashValue) {
+                            $stanzaLine['values'][$valCount] = str_replace(
+                                array("\\\\", "\\\""),
+                                array("\\", "\""),
+                                $stanzaLine['values'][$valCount]
+                            );
+                        }
+
+                        if ($pos >= $length)
+                            break;
+
+                        if ($in[$pos] == ' ') {
+                            ++$pos; // space
+                            ++$valCount;
+                        }
+                    }
+                }
+
+                $stanza[] = $stanzaLine;
+                ++$pos; // newline
+            }
+            $stanzas[] = $stanza;
+            ++$pos; // newline
+        }
+        return $stanzas;
+    }
+
+    /**
+     * Compiles monotone's basicio format
+     *
+     * @param array $in Array of arrays
+     * @return string
+     */
+    public static function compile($in)
+    {
+        $out = "";
+        $first = true;
+        foreach ((array)$in as $sx => $stanza) {
+            if ($first)
+                $first = false;
+            else
+                $out .= "\n";
+
+            $maxkeylength = 0;
+            foreach ((array)$stanza as $lx => $line) {
+                if (!array_key_exists('key', $line)) {
+                    throw new IDF_Scm_Exception(
+                        '"key" not found in basicio stanza '.$sx.', line '.$lx
+                    );
+                }
+                $maxkeylength = max($maxkeylength, strlen($line['key']));
+            }
+
+            foreach ((array)$stanza as $lx => $line) {
+                $out .= str_pad($line['key'], $maxkeylength, ' ', STR_PAD_LEFT);
+
+                if (array_key_exists('hash', $line)) {
+                    $out .= ' ['.$line['hash'].']';
+                } else
+                if (array_key_exists('values', $line)) {
+                    if (!is_array($line['values']) || count($line['values']) == 0) {
+                        throw new IDF_Scm_Exception(
+                            '"values" must be an array of a size >= 1 '.
+                            'in basicio stanza '.$sx.', line '.$lx
+                        );
+                    }
+                    foreach ($line['values'] as $value) {
+                        $out .= ' "'.str_replace(
+                             array("\\", "\""),
+                             array("\\\\", "\\\""),
+                             $value).'"';
+                    }
+                }
+                else
+                {
+                    throw new IDF_Scm_Exception(
+                        'neither "hash" nor "values" found in basicio '.
+                        'stanza '.$sx.', line '.$lx
+                    );
+                }
+
+                $out .= "\n";
+            }
+        }
+        return $out;
+    }
+}
+

src/IDF/Scm/Monotone/Stdio.php

@@ -0,0 +1,403 @@
+<?php
+/* -*- tab-width: 4; indent-tabs-mode: nil; c-basic-offset: 4 -*- */
+/*
+# ***** BEGIN LICENSE BLOCK *****
+# This file is part of InDefero, an open source project management application.
+# Copyright (C) 2010 Céondo Ltd and contributors.
+#
+# InDefero is free software; you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation; either version 2 of the License, or
+# (at your option) any later version.
+#
+# InDefero is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write to the Free Software
+# Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA  02110-1301  USA
+#
+# ***** END LICENSE BLOCK ***** */
+
+/**
+ * Monotone stdio class
+ *
+ * Connects to a monotone process and executes commands via its
+ * stdio interface
+ *
+ * @author Thomas Keller <me@thomaskeller.biz>
+ */
+class IDF_Scm_Monotone_Stdio
+{
+    /** this is the most recent STDIO version. The number is output
+        at the protocol start. Older versions of monotone (prior 0.47)
+        do not output it and are therefor incompatible */
+    public static $SUPPORTED_STDIO_VERSION = 2;
+
+    private $project;
+    private $proc;
+    private $pipes;
+    private $oob;
+    private $cmdnum;
+    private $lastcmd;
+
+    /**
+     * Constructor - starts the stdio process
+     *
+     * @param IDF_Project
+     */
+    public function __construct(IDF_Project $project)
+    {
+        $this->project = $project;
+        $this->start();
+    }
+
+    /**
+     * Destructor - stops the stdio process
+     */
+    public function __destruct()
+    {
+        $this->stop();
+    }
+
+    /**
+     * Returns a string with additional options which are passed to
+     * an mtn instance connecting to remote databases
+     *
+     * @return string
+     */
+    public function _getAuthOptions()
+    {
+        $prjconf = $this->project->getConf();
+        $name = $prjconf->getVal('mtn_client_key_name', false);
+        $hash = $prjconf->getVal('mtn_client_key_hash', false);
+
+        if (!$name || !$hash) {
+            throw new IDF_Scm_Exception(sprintf(
+                __('Monotone client key name or hash not in project conf.')
+            ));
+        }
+
+        $keydir = Pluf::f('tmp_folder').'/mtn-client-keys';
+        if (!file_exists($keydir)) {
+            if (!mkdir($keydir)) {
+                throw new IDF_Scm_Exception(sprintf(
+                    __('The key directory %s could not be created.'), $keydir
+                ));
+            }
+        }
+
+        // in case somebody cleaned out the cache, we restore the key here
+        $keyfile = $keydir . '/' . $name .'.'. $hash;
+        if (!file_exists($keyfile)) {
+            $data = $prjconf->getVal('mtn_client_key_data');
+            if (!file_put_contents($keyfile, $data, LOCK_EX)) {
+                throw new IDF_Scm_Exception(sprintf(
+                    __('Could not write client key "%s"'), $keyfile
+                ));
+            }
+        }
+
+        return sprintf('--keydir=%s --key=%s ',
+               escapeshellarg($keydir),
+               escapeshellarg($hash)
+        );
+    }
+
+    /**
+     * Starts the stdio process and resets the command counter
+     */
+    public function start()
+    {
+        if (is_resource($this->proc))
+            $this->stop();
+
+        $remote_db_access = Pluf::f('mtn_db_access', 'remote') == 'remote';
+
+        $cmd = Pluf::f('idf_exec_cmd_prefix', '') .
+               Pluf::f('mtn_path', 'mtn') . ' ';
+
+        $opts = Pluf::f('mtn_opts', array());
+        foreach ($opts as $opt) {
+            $cmd .= sprintf('%s ', escapeshellarg($opt));
+        }
+
+        if ($remote_db_access) {
+            $cmd .= $this->_getAuthOptions();
+            $host = sprintf(Pluf::f('mtn_remote_url'), $this->project->shortname);
+            $cmd .= sprintf('automate remote_stdio %s', escapeshellarg($host));
+        }
+        else
+        {
+            $repo = sprintf(Pluf::f('mtn_repositories'), $this->project->shortname);
+            if (!file_exists($repo)) {
+                throw new IDF_Scm_Exception(
+                    "repository file '$repo' does not exist"
+                );
+            }
+            $cmd .= sprintf('--db %s automate stdio', escapeshellarg($repo));
+        }
+
+        $descriptors = array(
+            0 => array('pipe', 'r'),
+            1 => array('pipe', 'w'),
+            2 => array('pipe', 'w'),
+        );
+
+        $env = array('LANG' => 'en_US.UTF-8');
+        $this->proc = proc_open($cmd, $descriptors, $this->pipes,
+                                null, $env);
+
+        if (!is_resource($this->proc)) {
+            throw new IDF_Scm_Exception('could not start stdio process');
+        }
+
+        $this->_checkVersion();
+
+        $this->cmdnum = -1;
+    }
+
+    /**
+     * Stops the stdio process and closes all pipes
+     */
+    public function stop()
+    {
+        if (!is_resource($this->proc))
+            return;
+
+        fclose($this->pipes[0]);
+        fclose($this->pipes[1]);
+        fclose($this->pipes[2]);
+
+        proc_close($this->proc);
+        $this->proc = null;
+    }
+
+    /**
+     * select()'s on stdout and returns true as soon as we got new
+     * data to read, false if the select() timed out
+     *
+     * @return boolean
+     * @throws IDF_Scm_Exception
+     */
+    private function _waitForReadyRead()
+    {
+        if (!is_resource($this->pipes[1]))
+            return false;
+
+        $read = array($this->pipes[1], $this->pipes[2]);
+        $write = $except = null;
+        $streamsChanged = stream_select(
+            $read, $write, $except, 0, 20000
+        );
+
+        if ($streamsChanged === false) {
+            throw new IDF_Scm_Exception(
+                'Could not select() on read pipe'
+            );
+        }
+
+        if ($streamsChanged == 0) {
+            return false;
+        }
+
+        return true;
+    }
+
+    /**
+     * Checks the version of the used stdio protocol
+     *
+     * @throws IDF_Scm_Exception
+     */
+    private function _checkVersion()
+    {
+        $this->_waitForReadyRead();
+
+        $version = fgets($this->pipes[1]);
+        if ($version === false) {
+            throw new IDF_Scm_Exception(
+                "Could not determine stdio version, stderr is:\n".
+                $this->_readStderr()
+            );
+        }
+
+        if (!preg_match('/^format-version: (\d+)$/', $version, $m) ||
+            $m[1] != self::$SUPPORTED_STDIO_VERSION)
+        {
+            throw new IDF_Scm_Exception(
+                'stdio format version mismatch, expected "'.
+                self::$SUPPORTED_STDIO_VERSION.'", got "'.@$m[1].'"'
+            );
+        }
+
+        fgets($this->pipes[1]);
+    }
+
+    /**
+     * Writes a command to stdio
+     *
+     * @param array
+     * @param array
+     * @throws IDF_Scm_Exception
+     */
+    private function _write(array $args, array $options = array())
+    {
+        $cmd = '';
+        if (count($options) > 0) {
+            $cmd = 'o';
+            foreach ($options as $k => $vals) {
+                if (!is_array($vals))
+                    $vals = array($vals);
+
+                foreach ($vals as $v) {
+                    $cmd .= strlen((string)$k) . ':' . (string)$k;
+                    $cmd .= strlen((string)$v) . ':' . (string)$v;
+                }
+            }
+            $cmd .= 'e ';
+        }
+
+        $cmd .= 'l';
+        foreach ($args as $arg) {
+            $cmd .= strlen((string)$arg) . ':' . (string)$arg;
+        }
+        $cmd .= "e\n";
+
+        if (!fwrite($this->pipes[0], $cmd)) {
+            throw new IDF_Scm_Exception("could not write '$cmd' to process");
+        }
+
+        $this->lastcmd = $cmd;
+        $this->cmdnum++;
+    }
+
+    /**
+     * Reads all output from stderr and returns it
+     *
+     * @return string
+     */
+    private function _readStderr()
+    {
+        $err = "";
+        while (($line = fgets($this->pipes[2])) !== false) {
+            $err .= $line;
+        }
+        return empty($err) ? '<empty>' : $err;
+    }
+
+    /**
+     * Reads the last output from the stdio process, parses and returns it
+     *
+     * @return string
+     * @throws IDF_Scm_Exception
+     */
+    private function _readStdout()
+    {
+        $this->oob = array('w' => array(),
+                           'p' => array(),
+                           't' => array(),
+                           'e' => array());
+
+        $output = "";
+        $errcode = 0;
+
+        while (true) {
+            if (!$this->_waitForReadyRead())
+                continue;
+
+            $data = array(0,"",0);
+            $idx = 0;
+            while (true) {
+                $c = fgetc($this->pipes[1]);
+                if ($c === false) {
+                    throw new IDF_Scm_Exception(
+                        "No data on stdin, stderr is:\n".
+                        $this->_readStderr()
+                    );
+                }
+
+                if ($c == ':') {
+                    if ($idx == 2)
+                        break;
+
+                    ++$idx;
+                    continue;
+                }
+
+                if (is_numeric($c))
+                    $data[$idx] = $data[$idx] * 10 + $c;
+                else
+                    $data[$idx] .= $c;
+            }
+
+            // sanity
+            if ($this->cmdnum != $data[0]) {
+                throw new IDF_Scm_Exception(
+                    'command numbers out of sync; expected '.
+                    $this->cmdnum .', got '. $data[0]
+                );
+            }
+
+            $toRead = $data[2];
+            $buffer = "";
+            while ($toRead > 0) {
+                $buffer .= fread($this->pipes[1], $toRead);
+                $toRead = $data[2] - strlen($buffer);
+            }
+
+            switch ($data[1]) {
+                case 'w':
+                case 'p':
+                case 't':
+                case 'e':
+                    $this->oob[$data[1]][] = $buffer;
+                    continue;
+                case 'm':
+                    $output .= $buffer;
+                    continue;
+                case 'l':
+                    $errcode = $buffer;
+                    break 2;
+            }
+        }
+
+        if ($errcode != 0) {
+            throw new IDF_Scm_Exception(
+                "command '{$this->lastcmd}' returned error code $errcode: ".
+                implode(' ', $this->oob['e'])
+            );
+        }
+
+        return $output;
+    }
+
+    /**
+     * Executes a command over stdio and returns its result
+     *
+     * @param array Array of arguments
+     * @param array Array of options as key-value pairs. Multiple options
+     *              can be defined in sub-arrays, like
+     *              "r" => array("123...", "456...")
+     * @return string
+     */
+    public function exec(array $args, array $options = array())
+    {
+        $this->_write($args, $options);
+        return $this->_readStdout();
+    }
+
+    /**
+     * Returns the last out-of-band output for a previously executed
+     * command as associative array with 'e' (error), 'w' (warning),
+     * 'p' (progress) and 't' (ticker, unparsed) as keys
+     *
+     * @return array
+     */
+    public function getLastOutOfBandOutput()
+    {
+        return $this->oob;
+    }
+}
+

src/IDF/Scm/Monotone/Usher.php

@@ -0,0 +1,269 @@
+<?php
+/* -*- tab-width: 4; indent-tabs-mode: nil; c-basic-offset: 4 -*- */
+/*
+# ***** BEGIN LICENSE BLOCK *****
+# This file is part of InDefero, an open source project management application.
+# Copyright (C) 2010 Céondo Ltd and contributors.
+#
+# InDefero is free software; you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation; either version 2 of the License, or
+# (at your option) any later version.
+#
+# InDefero is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write to the Free Software
+# Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA  02110-1301  USA
+#
+# ***** END LICENSE BLOCK ***** */
+
+require_once(dirname(__FILE__) . "/BasicIO.php");
+
+/**
+ * Connects with the admininistrative interface of usher,
+ * the monotone proxy. This class contains only static methods because
+ * there is really no state to keep between each invocation, as usher
+ * closes the connection after every command.
+ *
+ * @author Thomas Keller <me@thomaskeller.biz>
+ */
+class IDF_Scm_Monotone_Usher
+{
+    /**
+     * Without giving a specific state, returns an array of all servers.
+     * When a state is given, the array contains only servers which are
+     * in the given state.
+     *
+     * @param string $state One of REMOTE, ACTIVE, WAITING, SLEEPING,
+     *                      STOPPING, STOPPED, SHUTTINGDOWN or SHUTDOWN
+     * @return array
+     */
+    public static function getServerList($state = null)
+    {
+        $conn = self::_triggerCommand('LIST '.$state);
+        if ($conn == 'none')
+            return array();
+
+        return preg_split('/[ ]/', $conn);
+    }
+
+    /**
+     * Returns an array of all open connections to the given server, or to
+     * any server if no server is specified.
+     * If there are no connections to list, an empty array is returned.
+     *
+     * Example:
+     *    array("server1" => array(
+     *              array("address" => "192.168.1.0", "port" => "13456"),
+     *              ...
+     *          ),
+     *          "server2" => ...
+     *    )
+     *
+     * @param string $server
+     * @return array
+     */
+    public static function getConnectionList($server = null)
+    {
+        $conn = self::_triggerCommand('LISTCONNECTIONS '.$server);
+        if ($conn == 'none')
+            return array();
+
+        $single_conns = preg_split('/[ ]/', $conn);
+        $ret = array();
+        foreach ($single_conns as $conn) {
+            preg_match('/\((\w+)\)([^:]+):(\d+)/', $conn, $matches);
+            $ret[$matches[1]][] = (object)array(
+                'server'    => $matches[1],
+                'address'   => $matches[2],
+                'port'      => $matches[3],
+            );
+        }
+
+        if ($server !== null) {
+            if (array_key_exists($server, $ret))
+                return $ret[$server];
+            return array();
+        }
+
+        return $ret;
+    }
+
+    /**
+     * Get the status of a particular server, or of the usher as a whole if
+     * no server is specified.
+     *
+     * @param string $server
+     * @return One of REMOTE, SLEEPING, STOPPING, STOPPED for servers or
+     *         ACTIVE, WAITING, SHUTTINGDOWN or SHUTDOWN for usher itself
+     */
+    public static function getStatus($server = null)
+    {
+        return self::_triggerCommand('STATUS '.$server);
+    }
+
+    /**
+     * Looks up the name of the server that would be used for an incoming
+     * connection having the given host and pattern.
+     *
+     * @param string $host      Host
+     * @param string $pattern   Branch pattern
+     * @return server name
+     * @throws IDF_Scm_Exception
+     */
+    public static function matchServer($host, $pattern)
+    {
+        $ret = self::_triggerCommand('MATCH '.$host.' '.$pattern);
+        if (preg_match('/^OK: (.+)/', $ret, $m))
+            return $m[1];
+        preg_match('/^ERROR: (.+)/', $ret, $m);
+        throw new IDF_Scm_Exception('could not match server: '.$m[1]);
+    }
+
+    /**
+     * Prevent the given local server from receiving further connections,
+     * and stop it once all connections are closed. The return value will
+     * be the new status of that server: ACTIVE local servers will become
+     * STOPPING, and WAITING and SLEEPING serveres become STOPPED.
+     * Servers in other states are not affected.
+     *
+     * @param string $server
+     * @return string State of the server after the command
+     */
+    public static function stopServer($server)
+    {
+        return self::_triggerCommand("STOP $server");
+    }
+
+    /**
+     * Allow a STOPPED or STOPPING server to receive connections again.
+     * The return value is the new status of that server: STOPPING servers
+     * become ACTIVE, and STOPPED servers become SLEEPING. Servers in other
+     * states are not affected.
+     *
+     * @param string $server
+     * @return string State of the server after the command
+     */
+    public static function startServer($server)
+    {
+        return self::_triggerCommand('START '.$server);
+    }
+
+    /**
+     * Immediately kill the given local server, dropping any open connections,
+     * and prevent is from receiving new connections and restarting. The named
+     * server will immediately change to state STOPPED.
+     *
+     * @param string $server
+     * @return bool True if successful
+     */
+    public static function killServer($server)
+    {
+        return self::_triggerCommand('KILL_NOW '.$server) == 'ok';
+    }
+
+    /**
+     * Do not accept new connections for any servers, local or remote.
+     *
+     * @return bool True if successful
+     */
+    public static function shutDown()
+    {
+        return self::_triggerCommand('SHUTDOWN') == 'ok';
+    }
+
+    /**
+     * Begin accepting connections after a SHUTDOWN.
+     *
+     * @return bool True if successful
+     */
+    public static function startUp()
+    {
+        return self::_triggerCommand('STARTUP') == 'ok';
+    }
+
+    /**
+     * Reload the config file, the same as sending SIGHUP.
+     *
+     * @return bool True if successful (after the configuration was reloaded)
+     */
+    public static function reload()
+    {
+        return self::_triggerCommand('RELOAD') == 'ok';
+    }
+
+    private static function _triggerCommand($cmd)
+    {
+        $uc = Pluf::f('mtn_usher_conf', false);
+        if (!$uc || !is_readable($uc)) {
+            throw new IDF_Scm_Exception(
+                '"mtn_usher_conf" is not configured or not readable'
+            );
+        }
+
+        $parsed_config =
+            IDF_Scm_Monotone_BasicIO::parse(file_get_contents($uc));
+        $host = $port = $user = $pass = null;
+        foreach ($parsed_config as $stanza) {
+            foreach ($stanza as $line) {
+                if ($line['key'] == 'adminaddr') {
+                    list($host, $port) = explode(":", @$line['values'][0]);
+                    break;
+                }
+                if ($line['key'] == 'userpass') {
+                    $user = @$line['values'][0];
+                    $pass = @$line['values'][1];
+                }
+            }
+        }
+
+        if (empty($host)) {
+            throw new IDF_Scm_Exception('usher host is empty');
+        }
+        if (!preg_match('/^\d+$/', $port))
+        {
+            throw new IDF_Scm_Exception('usher port is invalid');
+        }
+
+        if (empty($user)) {
+            throw new IDF_Scm_Exception('usher user is empty');
+        }
+
+        if (empty($pass)) {
+            throw new IDF_Scm_Exception('usher pass is empty');
+        }
+
+        $sock = @fsockopen($host, $port, $errno, $errstr);
+        if (!$sock) {
+            throw new IDF_Scm_Exception(
+                "could not connect to usher: $errstr ($errno)"
+            );
+        }
+
+        fwrite($sock, 'USERPASS '.$user.' '.$pass."\n");
+        if (feof($sock)) {
+            throw new IDF_Scm_Exception(
+                'usher closed the connection - this should not happen'
+            );
+        }
+
+        fwrite($sock, $cmd."\n");
+        $out = '';
+        while (!feof($sock)) {
+            $out .= fgets($sock);
+        }
+        fclose($sock);
+        $out = rtrim($out);
+
+        if ($out == 'unknown command') {
+            throw new IDF_Scm_Exception('unknown command: '.$cmd);
+        }
+
+        return $out;
+    }
+}
+

src/IDF/Scm/Monotone/ZipRender.php

@@ -0,0 +1,78 @@
+<?php
+/* -*- tab-width: 4; indent-tabs-mode: nil; c-basic-offset: 4 -*- */
+/*
+# ***** BEGIN LICENSE BLOCK *****
+# This file is part of InDefero, an open source project management application.
+# Copyright (C) 2010 Céondo Ltd and contributors.
+#
+# Plume Framework is free software; you can redistribute it and/or modify
+# it under the terms of the GNU Lesser General Public License as published by
+# the Free Software Foundation; either version 2.1 of the License, or
+# (at your option) any later version.
+#
+# Plume Framework is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU Lesser General Public License for more details.
+#
+# You should have received a copy of the GNU Lesser General Public License
+# along with this program; if not, write to the Free Software
+# Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA  02110-1301  USA
+#
+# ***** END LICENSE BLOCK ***** */
+
+require_once(IDF_PATH.'/../contrib/zipstream-php-0.2.2/zipstream.php');
+
+/**
+ * Special response object to output 
+ *
+ * The Content-Length will not be set as it is not possible to predict it.
+ *
+ * Note: The ZipArchive version 0.2.2 has been patched in-tree with this
+ *       patch http://pastebin.ca/1977584 to avoid a couple of PHP notices
+ *
+ */
+class IDF_Scm_Monotone_ZipRender extends Pluf_HTTP_Response
+{
+    /**
+     * The revision argument must be a safe string!
+     *
+     * @param Object stdio context
+     * @param string revision
+     * @param string Mimetype (null)
+     */
+
+    private $stdio = null;
+    private $revision = null;
+
+    function __construct($stdio, $revision)
+    {
+        parent::__construct($revision, 'application/x-zip');
+        $this->stdio = $stdio;
+        $this->revision = $revision;
+    }
+
+    /**
+     * Render a response object.
+     */
+    function render($output_body=true)
+    {
+        $this->outputHeaders();
+
+        if ($output_body) {
+            $manifest = $this->stdio->exec(array('get_manifest_of', $this->revision));
+            $stanzas = IDF_Scm_Monotone_BasicIO::parse($manifest);
+
+            $zip = new ZipStream();
+
+            foreach ($stanzas as $stanza) {
+                if ($stanza[0]['key'] != 'file')
+                    continue;
+                $content = $this->stdio->exec(array('get_file', $stanza[1]['hash']));
+                $zip->add_file($stanza[0]['values'][0], $content);
+            }
+
+            $zip->finish();
+        }
+    }
+}

src/IDF/Scm/Svn.php

@@ -48,6 +48,25 @@ class IDF_Scm_Svn extends IDF_Scm
 
     public function isAvailable()
     {
+        $cmd = sprintf(Pluf::f('svn_path', 'svn').' info --xml --username=%s --password=%s %s',
+                       escapeshellarg($this->username),
+                       escapeshellarg($this->password),
+                       escapeshellarg($this->repo));
+        $cmd = Pluf::f('idf_exec_cmd_prefix', '').$cmd;
+        $xmlInfo = self::shell_exec('IDF_Scm_Svn::isAvailable', $cmd);
+
+        try {
+            $xml = simplexml_load_string($xmlInfo);
+        }
+        catch (Exception $e) {
+            return false;
+        }
+        if (!isset($xml->entry->commit['revision'])) {
+            return false;
+        }
+        if (0 == (int)$xml->entry->commit['revision']) {
+            return false;
+        }
         return true;
     }
 
@@ -80,9 +99,10 @@ class IDF_Scm_Svn extends IDF_Scm
      * Returns the URL of the subversion repository.
      *
      * @param IDF_Project
+     * @param string
      * @return string URL
      */
-    public static function getAnonymousAccessUrl($project)
+    public static function getAnonymousAccessUrl($project,$commit=null)
     {
         $conf = $project->getConf();
         if (false !== ($url=$conf->getVal('svn_remote_url', false))
@@ -97,9 +117,10 @@ class IDF_Scm_Svn extends IDF_Scm
      * Returns the URL of the subversion repository.
      *
      * @param IDF_Project
+     * @param string
      * @return string URL
      */
-    public static function getAuthAccessUrl($project, $user)
+    public static function getAuthAccessUrl($project, $user, $commit=null)
     {
         $conf = $project->getConf();
         if (false !== ($url=$conf->getVal('svn_remote_url', false))
@@ -136,19 +157,23 @@ class IDF_Scm_Svn extends IDF_Scm
     /**
      * Subversion revisions are either a number or 'HEAD'.
      */
-    public function isValidRevision($rev)
+    public function validateRevision($rev)
     {
         if ($rev == 'HEAD') {
-            return true;
+            return IDF_Scm::REVISION_VALID;
         }
+
         $cmd = sprintf(Pluf::f('svn_path', 'svn').' info --username=%s --password=%s %s@%s',
                        escapeshellarg($this->username),
                        escapeshellarg($this->password),
                        escapeshellarg($this->repo),
                        escapeshellarg($rev));
         $cmd = Pluf::f('idf_exec_cmd_prefix', '').$cmd;
-        self::exec('IDF_Scm_Svn::isValidRevision', $cmd, $out, $ret);
-        return (0 == $ret);
+        self::exec('IDF_Scm_Svn::validateRevision', $cmd, $out, $ret);
+
+        if ($ret == 0)
+            return IDF_Scm::REVISION_VALID;
+        return IDF_Scm::REVISION_INVALID;
     }
 
 
@@ -241,8 +266,13 @@ class IDF_Scm_Svn extends IDF_Scm
                        escapeshellarg($this->repo),
                        escapeshellarg($rev));
         $cmd = Pluf::f('idf_exec_cmd_prefix', '').$cmd;
+        try {
             $xml = simplexml_load_string(self::shell_exec('IDF_Scm_Svn::getCommitMessage', $cmd));
             $this->cache['commitmess'][$rev] = (string) $xml->logentry->msg;
+        }
+        catch (Exception $e) {
+            $this->cache['commitmess'][$rev] = '';
+        }
         return $this->cache['commitmess'][$rev];
     }
 
@@ -392,7 +422,7 @@ class IDF_Scm_Svn extends IDF_Scm
      */
     public function getCommit($commit, $getdiff=false)
     {
-        if (!$this->isValidRevision($commit)) {
+        if ($this->validateRevision($commit) != IDF_Scm::REVISION_VALID) {
             return false;
         }
         $res = array();
@@ -408,8 +438,12 @@ class IDF_Scm_Svn extends IDF_Scm
         $res['date'] = gmdate('Y-m-d H:i:s', strtotime((string) $xml->logentry->date));
         $res['title'] = (string) $xml->logentry->msg;
         $res['commit'] = (string) $xml->logentry['revision'];
-        $res['changes'] = ($getdiff) ? $this->getDiff($commit) : '';
+        $res['parents'] = $xml->logentry['revision'] > 1
+            ? array((string) $xml->logentry['revision'] - 1)
+            : array();
+        $res['diff'] = ($getdiff) ? $this->getDiff($commit) : '';
         $res['tree'] = '';
+        $res['branch'] = '';
         return (object) $res;
     }
 

src/IDF/Template.php

@@ -0,0 +1,51 @@
+<?php
+/* -*- tab-width: 4; indent-tabs-mode: nil; c-basic-offset: 4 -*- */
+/*
+# ***** BEGIN LICENSE BLOCK *****
+# This file is part of InDefero, an open source project management application.
+# Copyright (C) 2011 Céondo Ltd and contributors.
+#
+# InDefero is free software; you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation; either version 2 of the License, or
+# (at your option) any later version.
+#
+# InDefero is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write to the Free Software
+# Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA  02110-1301  USA
+#
+# ***** END LICENSE BLOCK ***** */
+
+/**
+ * PHP sets the backtrack limit quite low, so some (harder to analyze) regexes may fail
+ * unexpectedly on large inputs or weird cornercases (see issue 618). Unfortunately this
+ * fix does not always work and the execution time gets bigger the bigger we set the limit,
+ * so in case PCRE fails to analyze the input string and preg_replace(_callback) returns NULL,
+ * we at least return the input string unaltered.
+ *
+ * @param $pattern  The pattern
+ * @param $mixed    Callback or replacement string
+ * @param $input    The input
+ * @return The output
+ */
+function IDF_Template_safePregReplace($pattern, $mixed, $input)
+{
+    $pcre_backtrack_limit = ini_get('pcre.backtrack_limit');
+    ini_set('pcre.backtrack_limit', 10000000);
+   
+    if (is_string($mixed) && !function_exists($mixed))
+        $output = preg_replace($pattern, $mixed, $input);
+    else
+        $output = preg_replace_callback($pattern, $mixed, $input);
+
+    if ($output === null)
+        $output = $input;
+
+    ini_set('pcre.backtrack_limit', $pcre_backtrack_limit);
+    return $output;
+}

src/IDF/Template/AppVersion.php

@@ -0,0 +1,61 @@
+<?php
+/* -*- tab-width: 4; indent-tabs-mode: nil; c-basic-offset: 4 -*- */
+/*
+# ***** BEGIN LICENSE BLOCK *****
+# This file is part of InDefero, an open source project management application.
+# Copyright (C) 2011 Céondo Ltd and contributors.
+#
+# InDefero is free software; you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation; either version 2 of the License, or
+# (at your option) any later version.
+#
+# InDefero is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write to the Free Software
+# Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA  02110-1301  USA
+#
+# ***** END LICENSE BLOCK ***** */
+
+/**
+ * AppVersion tag.
+ *
+ * Renders two meta tags that include the application's version and revision
+ */
+class IDF_Template_AppVersion extends Pluf_Template_Tag
+{
+    function start($file = 'IDF/version.php')
+    {
+        if (!Pluf::fileExists($file)) {
+            return;
+        }
+
+        $info = include_once($file);
+        if (!is_array($info)) {
+            return;
+        }
+
+        if (array_key_exists('version', $info)) {
+            echo '<meta name="indefero-version" content="'.$info['version'].'" />'."\n";
+        }
+
+        if (array_key_exists('revision', $info)) {
+            if (strpos($info['revision'], '$') !== false) {
+                $info['revision'] = 'unknown';
+                $cmd = Pluf::f('idf_exec_cmd_prefix', '').
+                       Pluf::f('git_path', 'git').
+                       ' log -1 --format=%H';
+
+                if (IDF_Scm::exec('IDF_Template_AppVersion::start', $cmd, $output)) {
+                    $info['revision'] = trim(@$output[0]);
+                }
+            }
+            echo '<meta name="indefero-revision" content="'.$info['revision'].'" />'."\n";
+        }
+    }
+}
+

src/IDF/Template/IssueComment.php

@@ -22,6 +22,7 @@
 # ***** END LICENSE BLOCK ***** */
 
 Pluf::loadFunction('Pluf_HTTP_URL_urlForView');
+Pluf::loadFunction('IDF_Template_safePregReplace');
 
 /**
  * Make the links to issues and commits.
@@ -39,21 +40,25 @@ class IDF_Template_IssueComment extends Pluf_Template_Tag
         $this->scm = IDF_Scm::get($request->project);
         if ($esc) $text = Pluf_esc($text);
         if ($autolink) {
-            $text = preg_replace('#([a-z]+://[^\s\(\)]+)#i',
+            $text = IDF_Template_safePregReplace('#([a-z]+://[^\s\(\)]+)#i',
                                                  '<a href="\1">\1</a>', $text);
         }
         if ($request->rights['hasIssuesAccess']) {
-            $text = preg_replace_callback('#((?:issue|bug|ticket)(s)?\s+|\s+\#)(\d+)(\#ic\d+)?(?(2)((?:[, \w]+(?:\s+\#)?)?\d+(?:\#ic\d+)?){0,})#im',
+            $text = IDF_Template_safePregReplace('#((?:issue|bug|ticket)(s)?\s+|\s+\#)(\d+)(\#ic\d+)?(?(2)((?:[, \w]+(?:\s+\#)?)?\d+(?:\#ic\d+)?){0,})#im',
                                                  array($this, 'callbackIssues'), $text);
         }
         if ($request->rights['hasReviewAccess']) {
-            $text = preg_replace_callback('#(reviews?\s+)(\d+(?:(?:\s+and|\s+or|,)\s+\d+)*)\b#i',
+            $text = IDF_Template_safePregReplace('#(reviews?\s+)(\d+(?:(?:\s+and|\s+or|,)\s+\d+)*)\b#i',
                                                  array($this, 'callbackReviews'), $text);
         }
         if ($request->rights['hasSourceAccess']) {
-            $text = preg_replace_callback('#(commits?\s+)([0-9a-f]{1,40}(?:(?:\s+and|\s+or|,)\s+[0-9a-f]{1,40})*)\b#i',
+            $verbs = array('added', 'fixed', 'reverted', 'changed', 'removed');
+            $nouns = array('commit', 'commits', 'revision', 'revisions', 'rev', 'revs');
+            $prefix = implode(' in|', $verbs).' in' . '|'.
+                      implode('|', $nouns);
+            $text = IDF_Template_safePregReplace('#((?:'.$prefix.')(?:\s+r?))([0-9a-f]{1,40}((?:\s+and|\s+or|,)\s+r?[0-9a-f]{1,40})*)\b#i',
                                                  array($this, 'callbackCommits'), $text);
-            $text = preg_replace_callback('#(src:)([^\s\(\)\\\\]+(?:(\\\\)\s+[^\s\(\)\\\\]+){0,})+#im',
+            $text = IDF_Template_safePregReplace('=(src:)([^\s@#,\(\)\\\\]+(?:(\\\\)[\s@#][^\s@#,\(\)\\\\]+){0,})+(?:\@([^\s#,]+))(?:#(\d+))?=im',
                                                  array($this, 'callbackSource'), $text);
         }
         if ($wordwrap) $text = Pluf_Text::wrapHtml($text, 69, "\n");
@@ -90,7 +95,7 @@ class IDF_Template_IssueComment extends Pluf_Template_Tag
             }
             return $m[0]; // not existing issue.
         }
-        return preg_replace_callback('#(\#)?(\d+)(\#ic\d+)?#',
+        return IDF_Template_safePregReplace('#(\#)?(\d+)(\#ic\d+)?#',
                                             array($this, 'callbackIssue'),
                                             $m[0]);
     }
@@ -122,15 +127,12 @@ class IDF_Template_IssueComment extends Pluf_Template_Tag
     function callbackCommits($m)
     {
         $keyword = rtrim($m[1]);
-        if ('commits' === $keyword) {
-            // Multiple commits like 'commits 6e030e6, a25bfc1 and
-            // 3c094f8'.
-            return $m[1].preg_replace_callback('#\b[0-9a-f]{4,40}\b#i', array($this, 'callbackCommit'), $m[2]);
-        } else if ('commit' === $keyword) {
+        if (empty($m[3])) {
             // Single commit like 'commit 6e030e6'.
             return $m[1].call_user_func(array($this, 'callbackCommit'), array($m[2]));
         }
-        return $m[0];
+        // Multiple commits like 'commits 6e030e6, a25bfc1 and 3c094f8'.
+        return $m[1].IDF_Template_safePregReplace('#\b[0-9a-f]{1,40}\b#i', array($this, 'callbackCommit'), $m[2]);
     }
 
     /**
@@ -162,7 +164,7 @@ class IDF_Template_IssueComment extends Pluf_Template_Tag
     {
         $keyword = rtrim($m[1]);
         if ('reviews' === $keyword) {
-            return $m[1].preg_replace_callback('#\b(\d+)\b#i', array($this, 'callbackReview'), $m[2]);
+            return $m[1].IDF_Template_safePregReplace('#\b(\d+)\b#i', array($this, 'callbackReview'), $m[2]);
         } else if ('review' === $keyword) {
             return $m[1].call_user_func(array($this, 'callbackReview'), array('', $m[2]));
         }
@@ -189,18 +191,39 @@ class IDF_Template_IssueComment extends Pluf_Template_Tag
 
     function callbackSource($m)
     {
-        if (!$this->scm->isAvailable()) return $m[0];
+        if (!$this->scm->isAvailable())
+            return $m[0];
+        $commit = null;
+        if (!empty($m[4])) {
+            if (!$this->scm->getCommit($m[4])) {
+                return $m[0];
+            }
+            $commit = $m[4];
+        }
         $file = $m[2];
-        if (!empty($m[3])) $file = str_replace($m[3], '', $file);
-        $request_file_info = $this->scm->getPathInfo($file);
+        if (!empty($m[3]))
+            $file = str_replace($m[3], '', $file);
+        $linktext = $file;
+        if (!empty($commit))
+            $linktext .= '@'.$commit;
+        $request_file_info = $this->scm->getPathInfo($file, $commit);
         if (!$request_file_info) {
             return $m[0];
         }
-        if ($request_file_info->type != 'tree') {
-            return $m[1].'<a href="'.Pluf_HTTP_URL_urlForView('IDF_Views_Source::tree', array($this->project->shortname, $this->scm->getMainBranch(), $file)).'">'.$file.'</a>';
-        }
+        if ($request_file_info->type == 'tree') {
             return $m[0];
         }
+        $link = Pluf_HTTP_URL_urlForView('IDF_Views_Source::tree', array(
+            $this->project->shortname,
+            $commit == null ? $this->scm->getMainBranch() : $commit,
+            $file
+        ));
+        if (!empty($m[5])) {
+            $link .= '#L'.$m[5];
+            $linktext .= '#'.$m[5];
+        }
+        return $m[1].'<a href="'.$link.'">'.$linktext.'</a>';
+    }
 
     /**
      * Generate the link to an issue.

src/IDF/Template/Markdown.php

@@ -22,6 +22,7 @@
 # ***** END LICENSE BLOCK ***** */
 
 Pluf::loadFunction('Pluf_Text_MarkDown_parse');
+Pluf::loadFunction('IDF_Template_safePregReplace');
 
 /**
  * Make the links to issues and commits.
@@ -42,29 +43,36 @@ class IDF_Template_Markdown extends Pluf_Template_Tag
         // Replace [[[path/to/file.mdtext, commit]]] with embedding
         // the content of the file into the wki page
         if ($this->request->rights['hasSourceAccess']) {
-            $text = preg_replace_callback('#\[\[\[([^\,]+)(?:, ([^/]+))?\]\]\]#im',
+            $text = IDF_Template_safePregReplace('#\[\[\[([^\,]+)(?:, ([^/]+))?\]\]\]#im',
                                                  array($this, 'callbackEmbeddedDoc'),
                                                  $text);
         }
-        // Replace [[PageName]] with corresponding link to the page.
-        $text = preg_replace_callback('#\[\[([A-Za-z0-9\-]+)\]\]#im',
+        // Replace [Page]([[PageName]]) with corresponding link to the page, with link text being Page.
+        $text = IDF_Template_safePregReplace('#\[([^\]]+)\]\(\[\[([A-Za-z0-9\-]+)\]\]\)#im',
                                              array($this, 'callbackWikiPage'),
                                              $text);
+        // Replace [[PageName]] with corresponding link to the page.
+        $text = IDF_Template_safePregReplace('#\[\[([A-Za-z0-9\-]+)\]\]#im',
+					     array($this, 'callbackWikiPageNoName'),
+					     $text);
         $filter = new IDF_Template_MarkdownPrefilter();
         echo $filter->go(Pluf_Text_MarkDown_parse($text));
     }
 
+    function callbackWikiPageNoName($m)
+    {
+        $m[2] = $m[1]; //Set the link text to be the same as the page name.
+        return $this->callbackWikiPage($m);
+    }
+
     function callbackWikiPage($m)
     {
         $sql = new Pluf_SQL('project=%s AND title=%s',
-                            array($this->project->id, $m[1]));
+                            array($this->project->id, $m[2]));
         $pages = Pluf::factory('IDF_WikiPage')->getList(array('filter'=>$sql->gen()));
-        if ($pages->count() != 1 and !$this->request->rights['hasWikiAccess']) {
-            return $m[0];
-        }
         if ($pages->count() != 1 and $this->request->rights['hasWikiAccess']
             and !$this->request->user->isAnonymous()) {
-            return '<img style="vertical-align: text-bottom;" alt=" " src="'.Pluf::f('url_media').'/idf/img/add.png" /><a href="'.Pluf_HTTP_URL_urlForView('IDF_Views_Wiki::create', array($this->project->shortname), array('name'=>$m[1])).'" title="'.__('Create this documentation page').'">'.$m[1].'</a>';
+            return '<img style="vertical-align: text-bottom;" alt=" " src="'.Pluf::f('url_media').'/idf/img/add.png" /><a href="'.Pluf_HTTP_URL_urlForView('IDF_Views_Wiki::create', array($this->project->shortname), array('name'=>$m[2])).'" title="'.__('Create this documentation page').'">'.$m[1].'</a>';
         }
         if (!$this->request->rights['hasWikiAccess'] or $pages->count() == 0) {
             return $m[1];
@@ -75,6 +83,9 @@ class IDF_Template_Markdown extends Pluf_Template_Tag
     function callbackEmbeddedDoc($m)
     {
         $scm = IDF_Scm::get($this->request->project);
+        if (!$scm->isAvailable()) {
+            return $m[0];
+        }
         $view_source = new IDF_Views_Source();
         $match = array('dummy', $this->request->project->shortname);
         $match[] = (isset($m[2])) ? $m[2] : $scm->getMainBranch();
@@ -86,7 +97,7 @@ class IDF_Template_Markdown extends Pluf_Template_Tag
         $info = pathinfo($m[1]);
         $fileinfo = array($res->headers['Content-Type'], $m[1],
                           isset($info['extension']) ? $info['extension'] : 'bin');
-        if (!IDF_Views_Source::isText($fileinfo)) {
+        if (!IDF_FileUtil::isText($fileinfo)) {
             return $m[0];
         }
         return $res->content;

src/IDF/Template/MarkdownPrefilter.php

@@ -99,6 +99,7 @@ class IDF_Template_MarkdownPrefilter extends Pluf_Text_HTML_Filter
                             'caption' => array(),
                             'code' => array(),
                             'dd' => array(),
+                            'del' => array('cite', 'class', 'datetime', 'dir', 'id', 'title'),
                             'div' => array('align', 'class'),
                             'dl' => array(),
                             'dt' => array(),
@@ -112,6 +113,7 @@ class IDF_Template_MarkdownPrefilter extends Pluf_Text_HTML_Filter
                             'hr' => array(),
                             'i' => array(),
                             'img' => array('src', 'class', 'alt', 'height', 'width', 'style'),
+                            'ins' => array('cite', 'class', 'datetime', 'dir', 'id', 'title'),
                             'li' => array(),
                             'ol' => array(),
                             'p' => array('align', 'class'),
@@ -151,7 +153,9 @@ class IDF_Template_MarkdownPrefilter extends Pluf_Text_HTML_Filter
                                  'blockquote',
                                  'pre',
                                  'iframe',
-                                 'h1', 'h2', 'h3', 'address'
+                                 'h1', 'h2', 'h3', 'address',
+                                 'del',
+                                 'ins',
                                  );
     // attributes which should be checked for valid protocols
     public $protocol_attributes = array(
@@ -164,6 +168,7 @@ class IDF_Template_MarkdownPrefilter extends Pluf_Text_HTML_Filter
                                       'https',
                                       'ftp',
                                       'mailto',
+                                      'irc'
                                       );
     // tags which should be removed if they contain no content
     // (e.g. "<b></b>" or "<b />")
@@ -174,5 +179,7 @@ class IDF_Template_MarkdownPrefilter extends Pluf_Text_HTML_Filter
                                   'caption',
                                   'li',
                                   'span',
+                                  'del',
+                                  'ins',
                                   );
 }

src/IDF/Tests/TestDiff.php

@@ -32,29 +32,6 @@ class IDF_Tests_TestDiff extends UnitTestCase
         parent::__construct('Test the diff parser.');
     }
 
-    public function testGetFile()
-    {
-        $lines = array(
-                       'diff --git a/src/IDF/Form/Register.php b/src/IDF/Form/Register.php',
-                       'diff --git a/src/IDF/Form/RegisterConfirmation.php b/src/IDF/Form/RegisterConfirmation.php',
-                       'diff --git a/src/IDF/Form/RegisterInputKey.php b/src/IDF/Form/RegisterInputKey.php',
-                       'diff --git a/src/IDF/Views.php b/src/IDF/Views.php',
-                       'diff --git a/src/IDF/conf/views.php b/src/IDF/conf/views.php',
-                       );
-        $files = array(
-                       'src/IDF/Form/Register.php',
-                       'src/IDF/Form/RegisterConfirmation.php',
-                       'src/IDF/Form/RegisterInputKey.php',
-                       'src/IDF/Views.php',
-                       'src/IDF/conf/views.php',
-                       );
-        $i = 0;
-        foreach ($lines as $line) {
-            $this->assertEqual($files[$i], IDF_Diff::getFile($line));
-            $i++;
-        }
-    }
-
     public function testBinaryDiff()
     {
         $diff_content = file_get_contents(dirname(__FILE__).'/test-diff.diff');

src/IDF/Tests/TestFileUtil.php

@@ -0,0 +1,47 @@
+<?php
+/* -*- tab-width: 4; indent-tabs-mode: nil; c-basic-offset: 4 -*- */
+/*
+# ***** BEGIN LICENSE BLOCK *****
+# This file is part of InDefero, an open source project management application.
+# Copyright (C) 2008 Céondo Ltd and contributors.
+#
+# InDefero is free software; you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation; either version 2 of the License, or
+# (at your option) any later version.
+#
+# InDefero is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write to the Free Software
+# Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA  02110-1301  USA
+#
+# ***** END LICENSE BLOCK ***** */
+
+/**
+ * Tests some of the FileUtils
+ */
+class IDF_Tests_TestFileUtil extends UnitTestCase 
+{
+ 
+    public function __construct() 
+    {
+        parent::__construct('Test the file utils.');
+    }
+
+    public function testGetMimeType()
+    {
+        $files = array(
+                       'whatever.php' => 'application/x-httpd-php',
+                       'whatever.pht' => 'application/x-httpd-php',
+                       'README' => 'text/plain',
+                       );
+        foreach ($files as $file => $mime) {
+            $m = IDF_Views_Source::getMimeType($file);
+            $this->assertEqual($mime, $m[0]);
+        }
+    }
+}

src/IDF/Tests/TestMonotone.php

@@ -0,0 +1,239 @@
+<?php
+/* -*- tab-width: 4; indent-tabs-mode: nil; c-basic-offset: 4 -*- */
+/*
+# ***** BEGIN LICENSE BLOCK *****
+# This file is part of InDefero, an open source project management application.
+# Copyright (C) 2010 Céondo Ltd and contributors.
+#
+# InDefero is free software; you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation; either version 2 of the License, or
+# (at your option) any later version.
+#
+# InDefero is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write to the Free Software
+# Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA  02110-1301  USA
+#
+# ***** END LICENSE BLOCK ***** */
+
+require_once("simpletest/autorun.php");
+
+/**
+ * Test the monotone class.
+ */
+class IDF_Tests_TestMonotone extends UnitTestCase
+{
+    private $tmpdir, $dbfile, $mtnInstance;
+
+    private function mtnCall($args, $stdin = null, $dir = null)
+    {
+        // if you have an SSH agent running for key caching,
+        // please disable it
+        $cmdline = array("mtn",
+                        "--confdir", $this->tmpdir,
+                        "--db", $this->dbfile,
+                        "--norc",
+                        "--timestamps");
+
+        $cmdline = array_merge($cmdline, $args);
+
+        $descriptorspec = array(
+           0 => array("pipe", "r"),
+           1 => array("pipe", "w"),
+           2 => array("file", "{$this->tmpdir}/mtn-errors", "a")
+        );
+
+        $pipes = array();
+        $dir = !empty($dir) ? $dir : $this->tmpdir;
+        $process = proc_open(implode(" ", $cmdline),
+                             $descriptorspec,
+                             $pipes,
+                             $dir);
+
+        if (!is_resource($process)) {
+            throw new Exception("could not create process");
+        }
+
+        if (!empty($stdin)) {
+            fwrite($pipes[0], $stdin);
+            fclose($pipes[0]);
+        }
+
+        $stdout = stream_get_contents($pipes[1]);
+        fclose($pipes[1]);
+
+        $ret = proc_close($process);
+        if ($ret != 0) {
+            throw new Exception(
+                "call ended with a non-zero error code (complete cmdline was: ".
+                implode(" ", $cmdline).")"
+            );
+        }
+
+        return $stdout;
+    }
+
+    public function __construct()
+    {
+        parent::__construct("Test the monotone class.");
+
+        $this->tmpdir = sys_get_temp_dir() . "/mtn-test";
+        $this->dbfile = "{$this->tmpdir}/test.mtn";
+
+        set_include_path(get_include_path() . ":../../../pluf-master/src");
+        require_once("Pluf.php");
+
+        Pluf::start(dirname(__FILE__)."/../conf/idf.php");
+
+        // Pluf::f() mocking
+        $GLOBALS['_PX_config']['mtn_repositories'] = "{$this->tmpdir}/%s.mtn";
+    }
+
+    private static function deleteRecursive($dirname)
+    {
+        if (is_dir($dirname))
+            $dir_handle=opendir($dirname);
+
+        while ($file = readdir($dir_handle)) {
+            if ($file!="." && $file!="..") {
+                if (!is_dir($dirname."/".$file)) {
+                    unlink ($dirname."/".$file);
+                    continue;
+                }
+                self::deleteRecursive($dirname."/".$file);
+            }
+        }
+
+        closedir($dir_handle);
+        rmdir($dirname);
+
+        return true;
+    }
+
+    public function setUp()
+    {
+        if (is_dir($this->tmpdir)) {
+            self::deleteRecursive($this->tmpdir);
+        }
+
+        mkdir($this->tmpdir);
+
+        $this->mtnCall(array("db", "init"));
+
+        $this->mtnCall(array("genkey", "test@test.de"), "\n\n");
+
+        $workspaceRoot = "{$this->tmpdir}/test-workspace";
+        mkdir($workspaceRoot);
+
+        $this->mtnCall(array("setup", "-b", "testbranch", "."), null, $workspaceRoot);
+
+        file_put_contents("$workspaceRoot/foo", "blubber");
+        $this->mtnCall(array("add", "foo"), null, $workspaceRoot);
+
+        $this->mtnCall(array("commit", "-m", "initial"), null, $workspaceRoot);
+
+        file_put_contents("$workspaceRoot/bar", "blafoo");
+        mkdir("$workspaceRoot/subdir");
+        file_put_contents("$workspaceRoot/subdir/bla", "blabla");
+        $this->mtnCall(array("add", "-R", "--unknown"), null, $workspaceRoot);
+
+        $this->mtnCall(array("commit", "-m", "second"), null, $workspaceRoot);
+
+        $rev = $this->mtnCall(array("au", "get_base_revision_id"), null, $workspaceRoot);
+        $this->mtnCall(array("tag", rtrim($rev), "release-1.0"));
+
+        $project = new IDF_Project();
+        $project->shortname = "test";
+        $this->mtnInstance = new IDF_Scm_Monotone($project);
+    }
+
+    public function testIsAvailable()
+    {
+        $this->assertTrue($this->mtnInstance->isAvailable());
+    }
+
+    public function testGetBranches()
+    {
+        $branches = $this->mtnInstance->getBranches();
+        $this->assertEqual(1, count($branches));
+        list($key, $value) = each($branches);
+        $this->assertEqual("h:testbranch", $key);
+        $this->assertEqual("testbranch", $value);
+    }
+
+    public function testGetTags()
+    {
+        $tags = $this->mtnInstance->getTags();
+        $this->assertEqual(1, count($tags));
+        list($key, $value) = each($tags);
+        $this->assertEqual("t:release-1.0", $key);
+        $this->assertEqual("release-1.0", $value);
+    }
+
+    public function testInBranches()
+    {
+        $revOut = $this->mtnCall(array("au", "select", "b:testbranch"));
+        $revs = preg_split('/\n/', $revOut, -1, PREG_SPLIT_NO_EMPTY);
+
+        $branches = $this->mtnInstance->inBranches($revs[0], null);
+        $this->assertEqual(1, count($branches));
+        $this->assertEqual("h:testbranch", $branches[0]);
+
+        $branches = $this->mtnInstance->inBranches("t:release-1.0", null);
+        $this->assertEqual(1, count($branches));
+        $this->assertEqual("h:testbranch", $branches[0]);
+    }
+
+    public function testInTags()
+    {
+        $rev = $this->mtnCall(array("au", "select", "t:release-1.0"));
+        $tags = $this->mtnInstance->inTags(rtrim($rev), null);
+        $this->assertEqual(1, count($tags));
+        $this->assertEqual("t:release-1.0", $tags[0]);
+
+        // pick the first (root) revisions in this database
+        $rev = $this->mtnCall(array("au", "roots"));
+        $tags = $this->mtnInstance->inTags(rtrim($rev), null);
+        $this->assertEqual(0, count($tags));
+    }
+
+    public function testGetTree()
+    {
+        $files = $this->mtnInstance->getTree("t:release-1.0");
+        $this->assertEqual(3, count($files));
+
+        $this->assertEqual("bar", $files[0]->file);
+        $this->assertEqual("blob", $files[0]->type);
+        $this->assertEqual(6, $files[0]->size); // "blafoo"
+        $this->assertEqual("second\n", $files[0]->log);
+
+        $this->assertEqual("foo", $files[1]->file);
+        $this->assertEqual("blob", $files[1]->type);
+        $this->assertEqual(7, $files[1]->size); // "blubber"
+        $this->assertEqual("initial\n", $files[1]->log);
+
+        $this->assertEqual("subdir", $files[2]->file);
+        $this->assertEqual("tree", $files[2]->type);
+        $this->assertEqual(0, $files[2]->size);
+
+        $files = $this->mtnInstance->getTree("t:release-1.0", "subdir");
+        $this->assertEqual(1, count($files));
+
+        $this->assertEqual("bla", $files[0]->file);
+        $this->assertEqual("subdir/bla", $files[0]->fullpath);
+        $this->assertEqual("blob", $files[0]->type);
+        $this->assertEqual(6, $files[0]->size); // "blabla"
+        $this->assertEqual("second\n", $files[0]->log);
+    }
+
+    public function testIsValidRevision()
+    {
+        $this->assertTrue($this->mtnInstance->isValidRevision("t:release-1.0"));
+        $this->assertFalse($this->mtnInstance->isValidRevision("abcdef12345"));
+    }
+}

src/IDF/Tests/TestSource.php

@@ -32,19 +32,6 @@ class IDF_Tests_TestSource extends UnitTestCase
         parent::__construct('Test the source class.');
     }
 
-    public function testGetMimeType()
-    {
-        $files = array(
-                       'whatever.php' => 'application/x-httpd-php',
-                       'whatever.pht' => 'application/x-httpd-php',
-                       'README' => 'text/plain',
-                       );
-        foreach ($files as $file => $mime) {
-            $m = IDF_Views_Source::getMimeType($file);
-            $this->assertEqual($mime, $m[0]);
-        }
-    }
-
     public function testRegexCommit()
     {
         $regex = '#^/p/([\-\w]+)/source/tree/([^\/]+)/(.*)$#';

src/IDF/Upload.php

@@ -237,14 +237,16 @@ class IDF_Upload extends Pluf_Model
                   ));
         $tmpl = new Pluf_Template('idf/downloads/download-created-email.txt');
         $text_email = $tmpl->render($context);
+        $addresses = explode(',', $conf->getVal('downloads_notification_email'));
+        foreach ($addresses as $address) {
             $email = new Pluf_Mail(Pluf::f('from_email'),
-                               $conf->getVal('downloads_notification_email'),
+                                   $address,
                                    sprintf(__('New download - %s (%s)'),
                                            $this->summary,
                                            $this->get_project()->shortname));
             $email->addTextMessage($text_email);
             $email->sendMail();
-
+        }
         Pluf_Translation::loadSetLocale($current_locale);
     }
 }

src/IDF/UserData.php

@@ -0,0 +1,59 @@
+<?php
+/* -*- tab-width: 4; indent-tabs-mode: nil; c-basic-offset: 4 -*- */
+/*
+# ***** BEGIN LICENSE BLOCK *****
+# This file is part of InDefero, an open source project management application.
+# Copyright (C) 2008 Céondo Ltd and contributors.
+#
+# InDefero is free software; you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation; either version 2 of the License, or
+# (at your option) any later version.
+#
+# InDefero is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program; if not, write to the Free Software
+# Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA  02110-1301  USA
+#
+# ***** END LICENSE BLOCK ***** */
+
+/**
+ * Thin wrapper around the general purpose Gconf data driver
+ * to model a userdata object as key value store
+ */
+class IDF_UserData extends IDF_Gconf
+{
+    /** columns for the underlying model for which we do not want to
+        override __get and __set */
+    private static $protectedVars =
+        array('id', 'model_class', 'model_id', 'vkey', 'vdesc');
+
+    function __set($key, $value)
+    {
+        if (in_array($key, self::$protectedVars))
+        {
+            parent::__set($key, $value);
+            return;
+        }
+        $this->setVal($key, $value);
+    }
+
+    function __get($key)
+    {
+        if (in_array($key, self::$protectedVars))
+            return parent::__get($key);
+        return $this->getVal($key, null);
+    }
+
+    public static function factory($user)
+    {
+        $conf = new IDF_UserData();
+        $conf->setModel((object) array('_model'=>'IDF_UserData', 'id' => $user->id));
+        $conf->initCache();
+        return $conf;
+    }
+}