# Quantitative shape analysis with weighted covariance estimates for increased statistical efficiency

- Hossein Ragheb
^{1}Email author, - Neil A Thacker
^{1}, - Paul A Bromiley
^{1}, - Diethard Tautz
^{2}and - Anja C Schunke
^{2}

**10**:16

**DOI: **10.1186/1742-9994-10-16

© Ragheb et al.; licensee BioMed Central Ltd. 2013

**Received: **20 December 2012

**Accepted: **19 March 2013

**Published: **2 April 2013

## Abstract

### Background

The introduction and statistical formalisation of landmark-based methods for analysing biological shape has made a major impact on comparative morphometric analyses. However, a satisfactory solution for including information from 2D/3D shapes represented by ‘semi-landmarks’ alongside well-defined landmarks into the analyses is still missing. Also, there has not been an integration of a statistical treatment of measurement error in the current approaches.

### Results

We propose a procedure based upon the description of landmarks with measurement covariance, which extends statistical linear modelling processes to semi-landmarks for further analysis. Our formulation is based upon a self consistent approach to the construction of likelihood-based parameter estimation and includes corrections for parameter bias, induced by the degrees of freedom within the linear model. The method has been implemented and tested on measurements from 2D fly wing, 2D mouse mandible and 3D mouse skull data. We use these data to explore possible advantages and disadvantages over the use of standard Procrustes/PCA analysis via a combination of Monte-Carlo studies and quantitative statistical tests. In the process we show how appropriate weighting provides not only greater stability but also more efficient use of the available landmark data. The set of new landmarks generated in our procedure (‘ghost points’) can then be used in any further downstream statistical analysis.

### Conclusions

Our approach provides a consistent way of including different forms of landmarks into an analysis and reduces instabilities due to poorly defined points. Our results suggest that the method has the potential to be utilised for the analysis of 2D/3D data, and in particular, for the inclusion of information from surfaces represented by multiple landmark points.

## Introduction

The introduction of geometric morphometrics has laid the foundations for a quantitative description of shapes and shape differences, thus revolutionising the century old quest for comparing anatomical features of organisms [1]. It is now also increasingly used to link quantitative descriptions of shape with developmental processes and associated genetic factors [2]. This process generally involves the construction of a parametric model based upon exemplar biological shape specimens, and the most popular of these are linear models. These are used to quantify and predict the correlations in shape variation between and within species. The objectives of this paper are to improve the statistical efficiency of analysis techniques used in the genetic interpretation of shape variation (morphometrics) and to broaden the scope of problems which can be tackled with shape analysis tools. In particular we believe that much shape data is not suitable for use in current approaches, and ‘semi-landmarks’ (those poorly localised in one direction and the majority of measurements for smooth 3D shape) cannot be appropriately utilised [3, 4].

Over a decade during the 70’s, bio-mathematical and biometrical aspects of biological shape studies were treated separately. This early work was later criticised during the 80’s by Bookstein [5], Goodall [6] and Kendall [7]. Later, Bookstein [8] worked towards converging notations from Goodall, Kendall and himself, for the biometric analysis of landmark data in a bio-mathematically interpretable framework of shape. As a consequence of these efforts, the standard method for analysis of variation in landmark position is generally regarded as ‘Procrustes’. It comprises a least-squares alignment of a set of landmark features to a mean shape, and this is often followed by eigenvector analysis of the linear correlations in variation around that mean. While the technique is now very popular the approach has several limitations with regard to the types of variation with which it can deal. One of these limitations is due to the assumption associated with taking least-squares differences and eigenvector summaries of distributions. Though many regard these as simply definitional, and in particular associated with ‘shape’, any statistical interpretation suggests that data are measures with homogeneous noise. On the other hand, the Mantel test [9, 10] has sometimes been used as an alternative to Procrustes distance to compute correlation between distance matrices (usually symmetric). Though many papers have been published in this area, we are aware of no work in this, or any related, area of point distribution modelling that has provided a framework to allow data to be analysed according to a measurement process.

Although landmarks are generally carefully chosen in order to allow accurate measurements of position within the image, problems will occur if ‘semi-landmarks’, measured from smooth curves or surfaces and only accurately localised in one dimension, are input to the analysis. Landmarks with a high degree of variability can act as outliers in the alignment stage, generating correlated compensating shifts and rotations of the other points. As PCA aims to describe the main sources of variation, high levels of such correlated movement will then necessarily contaminate the extraction of eigenvectors [11]. This contamination cannot be considered a generic variation, as it has occurred purely due to the uncertainty in the measurement. This in turn follows from the subjective definition of the landmark leading to the view that problems can be avoided via appropriate definition. The mathematical concept of homology (and mapping) underlies many of the considerations behind much theoretical work that is described with the mathematical formalisms of isomorphism. Because of such restrictions on the definition of landmarks, semi-landmarks were introduced [12] in order to allow inclusion of other points which are not homologous among the specimens. By this we mean that a unique corresponding location can not be defined. Measurement at these locations must be regularised by a constraint, such as bending energy [12, 13], in order to recover the information missing due to the nature of local structure.

From a statistical perspective a homology (in this context) must be augmented by distributions indicative of the extent to which a correspondence can be established. The standard way to deal with inappropriate weighting of data in a least-squares fit is to generalise the least-squares cost to a Mahalanobis distance, computed using measurement covariances. By avoiding the requirement of specifying a unique homologous location, this has the advantage of accommodating varying precision in measured data without having to try to re-create missing data. There have been several attempts in the literature to include measurement errors for landmark points. For example, Fitzpatrick et al. [14] worked on the relationship between localisation error and registration error in rigid-body, point-based registration. Chui and Rangarajan [15] proposed a general framework for non-rigid point matching, where outliers are effectively rejected. Rohlf and Slice [16], and Walker [17] investigated how to estimate measurement covariances in forms. However, Richtsmeier et al. [18], Adams et al. [1] and Rohlf [19] all stated that further research was needed in this area. Also, Walker [17] and Lele [20] concluded that generalised Procrustes analysis (GPA) estimators of the variance-covariance matrix are flawed. Despite the fact that some biologists have noticed these problems, they seem to know of no available alternatives and continue to use GPA to estimate covariances [21].

Text books [22] state that using weighted Procrustes does not lead to a Kendall’s shape space. Claiming that “statistical analysis cannot employ parametric models”, they suggested that resampling-based methods must be used instead. Another reason for rejecting the idea of a weighted Procrustes was said to be a “lack of clear criteria for determining appropriate weighting of semi-landmarks”. These criticisms can only really be interpreted once a method for weighting is specified. Goodall [23] suggested a method in which the same covariance was used for all landmarks. By this we mean there was no separate description of the perturbation of individual landmarks. It has been noted that such a matrix is inestimable [24]. Goodall himself acknowledged that “as a model of measurement error this is a drawback, as the direction of greatest variation may vary considerably between landmarks”. Despite this problem, later work [25] generalised this idea to a Bayesian framework. We believe that it makes sense instead to suggest an approach which can support the process of landmark location as measurement, with a covariance describing the localisation of each landmark separately (see [26, 27] for example). Specifically, Rohr et al. [26] used covariance matrices in a Mahalanobis distance form for non-isotropic data, where covariances were estimated from image data through landmark localisation, i.e. using grey-value information from local pixels around each landmark for matching an image area/volume structure to another through optimisation of a cost function. The minimal localisation uncertainty for each point were estimated using the Cramer-Rao Bound (CRB). Also, smoothness was included as the second term in their functional and controlled using a regularisation parameter. To our knowledge, they have been the first to provide a relatively comprehensive approach for incorporating anisotropic covariances into image registration using splines. However, here we only deal with pre-defined landmark data and, unlike their method (and our recently published method [28]), do not attempt to extract landmarks and their corresponding covariances from image data. Specifically, in [28], we have applied smoothing to local edge data (where information is) prior to optimisation in order to remove the effects of spatial noise and obtain meaningful CRB estimates. However in our current study, the only input data fed to our method are a number of shapes represented by fixed landmark points. Hence, we do not take into account any information about the local structure surrounding each landmark. This way, the task of covariance estimation may be seen even more challenging. We are aware that in biological studies it is now commonly accepted that for point-based shapes, extra information about the local/global pixels in the image plane/volume (for 2D/3D data) is usually available using modern imaging equipment. However, here our observation is that geometric morphometrics should originally be capable of dealing with the study of 2D/3D forms [18] even for non-biological data or cases where information about the local structure around each landmark is missing or difficult to access or process. It is worth mentioning here that one reason why Procrustes still is popular is that apart from the forms (shapes) represented by landmark points it does not require any further data such as images from which the points have been originated. Hence, even though the datasets we use in our experiments are biological and one could also feed in the image data, in this study we chose to start the process from pre-defined landmarks only. Ideally, covariances extracted from image data (using other methods such as ours [28]) could be fed to our current method and be used, for instance, as initial estimates. This is however a subject for future investigation.

There have been further publications on anisotropic weighting, for instance in [29, 30]. Mathematically, these methods are all equivalent to our approach, in that they use a Mahalanobis distance based upon anisotropic distributions of individual points. However, they do not have a well-defined mechanism for the estimation of these distributions. This is a key issue when applying these ideas to shape samples. Our work provides such a mechanism while incorporating corrections for estimation bias [7]. The basic concept can be implemented via a standard technique used in pattern recognition, often referred to as whitening [31]. For instance, in the context of shape analysis, the whitening transform and shape de-correlation were used as a preprocessing step in PCA/ICA analysis [32, 33]. However, there is a difference between using whitening methods to model the signal variation of data (as used in these papers) and using the same technique to better construct a likelihood function that accounts for correlation in measured data (as we do here). Recently, the technique has been applied to the within group biological covariances [34], but again not to the process of noise on measurements. Here, we shall investigate possible generalisations of Procrustes along these lines, and the different ways such a measurement covariance may be estimated. As a key issue here is the computability of these covariances, the stability of the resulting analysis is an important question for investigation. The theory presented here can thus be classified in the same category as both Procrustes based shape analysis [35] and active shape models [36]. The main difference, however, being that our model is for a realisable system and self-consistent estimation of the associated model parameters.

There has been an ongoing discussion in the biology literature regarding appropriate ways to deal with non-homologous landmarks (points defined on smooth curves and surfaces) during statistical analysis. For instance, Klingenberg [37] has objected to Polly’s conclusions [38] regarding the benefits of existing homology-free approaches. He believes that these approaches all depend critically on some sense of homology since they are not really free of assumptions about the correspondence of parts. Oxnard and O’Higgins [39] have recommended that it is biology that has to inform morphometrics in planning the landmark configuration (mainly mathematical landmarks, i.e. those computed using geometric constraints based on the neighbouring true landmarks) in relation to the hypothesis available. The approach to dealing with semi-landmarks in the morphometric analysis of shape currently seems to be divided between two alternatives, both of which aim to adjust the position of these landmarks by optimising a specific metric, before constructing a linear model of variation about the mean. These metrics are bending energy (BE) and Procrustes distance (PD) [3]. Arguments for and against these approaches are based upon specific examples in biology. Although evidence has been reported of utility [40], Slice [41] has stated that the application of the BE approach to biomedical and anthropological problems has been minimal. Vignon and Pierre [4], and Prez et al. [42] have shown concern regarding the observation that different methods for handling semi-landmarks could result in different conclusions in a discriminant analysis study. Gomez-Robles et al. [43] have examined the advantages and disadvantages of different novel methods in geometric morphometric analyses including homology-free approaches, landmark-based approaches, and combinations of both techniques.

Comparison between results from shape analysis and genetics is an important research topic in evolutionary biology. For instance, Frederich et al. [44] have attempted to estimate the statistical correlation between morphological, genetic and geographical distances. We offer an alternative shape analysis method that tackles the existing problem in the literature, so that well defined comparisons become statistically valid and informative.

## Methods

Suppose that there are *K* shapes in our data-set and each shape vector **w**_{
k
} contains *N* landmark points, i.e. **w**_{
k
}=[*w*_{1x},*w*_{1y},*w*_{2x},*w*_{2y},...,*w*_{
N
x
},*w*_{
N
y
}]_{
k
} for the case of 2D data. We then apply a scale *s*_{
k
}, a rotation *R*_{
k
} and a translation **t**_{
k
} to the original data to get an aligned version of the data called **z**_{
k
}, where **z**_{
k
}=[*z*_{1x},*z*_{1y},*z*_{2x},*z*_{2y},...,*z*_{
N
x
},*z*_{
N
y
}]_{
k
} and **z**_{
k
}=*s*_{
k
}*R*_{
k
}(**w**_{
k
}−**t**_{
k
}).

The mathematical description of the model so far can accommodate any value of scale or orientation for the definition of mean model. We therefore define the orientation of mean shape so that the line between a specified pair of points is horizontal. This also has the benefit that initial estimates of alignment for sample *k* can be set according to the relative positions of these points. We also use the average distance between these same landmarks to rescale the mean shape at each iteration so that scale remains numerically defined.

*C*. This is a tri-diagonal matrix, the diagonal line of which contains data for individual landmarks. Outside of the 2×2 covariances, the off diagonal elements of

*C*are zero, i.e. there are no correlations between landmarks. The use of a fixed data covariance cancels out when taking the weighted mean, to regenerate the conventional formula for the mean;

where **m**=[*m*_{1x},*m*_{1y},*m*_{2x},*m*_{2y},...,*m*_{
N
x
},*m*_{
N
y
}]. This definition for mean shape has previously been shown to provide unbiased estimates using Monte-Carlo re-sampling studies [19], which is to be expected for a valid likelihood estimate of parameters.

The points **z**_{
k
} do not have uniform independent noise distributions, which is one of the assumptions for the application of PCA. However, this property can be obtained via a whitening transformation. Although transformation of data can be considered as a new space, it can also be interpreted as an affine re-projection. The points obtained by applying a whitening transformation are referred to here as ‘ghost points’. Ghost points are accordingly defined in the original coordinate system and, being scaled projections relative to the shape centroid, are an alternative way to summarise the original measurement relative to the observable structure. This is an important philosophical issue for those who believe that the original co-ordinate system is somehow more meaningful as a description of biological variation than any linear re-projection (see Discussions). The process amplifies the spatial variation in directions which are well measured relative to those which are not so that the resulting locations have isotropic errors (as required). In turn, this allows accurately measured structure to be encoded in the most significant eigenvectors (those with largest eigenvalues) of the linear model. We transform **z**_{
k
} to ghost points **g**_{
k
} using the matrix *W* so that ${\mathbf{g}}_{\mathit{k}}^{\mathit{T}}=\mathit{W}{({\mathbf{z}}_{\mathit{k}}-\mathbf{m})}^{\mathit{T}}$.

*C*

^{−1}, i.e.

*C*

^{−1}=

*U*

^{ T }

*V*

*U*, and making it equivalent to

*W*

^{ T }

*I*

*W*, we find that the required whitening matrix is

*W*=

*V*

^{1/2}

*U*. Application of PCA to

**g**

_{ k }follows for construction of the shape covariance, giving the eigenvectors

**e**

_{ j }and eigenvalues

*μ*

_{ j }for the whitened space of ghost points as those which minimise the unexplained variance for fixed

*J*<

*N*, where

*J*is the number of eigenvectors used in the model. Hence, for any specific shape example

*k*, linear factors

*λ*

_{ j k }=

**e**

_{ j }.

**g**

_{ k }can be computed to best approximate

**z**

_{ k }with the model ${\mathbf{z}}_{\mathit{k}}^{\mathit{\prime}}$;

^{a}. Using this argument, if we wish to align to the mean shape we should use a covariance that is consistent with the distribution around the model. In order to find the best

*R*

_{ k },

**t**

_{ k },

*s*

_{ k }parameters for each

*k*, we minimise a Mahalanobis distance which is given by

This is simply the likelihood estimate for the location of the shape given the linear model and the assumed measurement covariances and can be interpreted directly as a *χ*^{2} statistic. By replacing *C* with *I* and ${\mathbf{z}}_{\mathit{k}}^{\mathit{\prime}}$ with **m** this reduces to the least-squares function for standard Procrustes. We can therefore interpret this as a generalisation of the standard approach. However, we do not wish to generalise further by using for example PPCA (probabilistic principal component analysis) [45], as an additional assumption of a Gaussian distribution over derived variables is generally invalidated in morphometric data sets.

**z**

_{ k }. By setting the initial estimates of the measurement covariance

*C*to an identity matrix, these parameters are given by the Procrustes result. We can therefore use Procrustes to set up the initial transformation estimates. To reach the best possible alignment using our new method (anisotropic

*C*), we iteratively re-estimate

*R*

_{ k },

**t**

_{ k }and

*s*

_{ k }using the assumed

**e**

_{ j },

**m**,

*C*

^{−1}and

*W*

^{−1}. This gives us a new

**z**

_{ k }, and so a new

**m**and

*F*for construction of

**e**

_{ j }. For fixed covariances, convergence can be monitored via construction of the total likelihood $log\left(\mathit{P}\right)\phantom{\rule{.5em}{0ex}}=\phantom{\rule{.5em}{0ex}}\sum _{\mathit{k}=1}^{\mathit{K}}log\left({\mathit{P}}_{\mathit{k}}\right)$. One may use the final estimates of

**z**

_{ k }and ${\mathbf{z}}_{\mathit{k}}^{\mathit{\prime}}$ to construct the sample covariance;

For a well defined likelihood method this covariance should be consistent with the assumed distribution *C*. However, the use of free parameters during alignment and model construction introduces biases that must be addressed in an iterative analysis in order to avoid instabilities, which will now be described.

### Covariance correction

*C*, the use of free parameters during model fitting reduces the sample covariance obtained from residuals. This mechanism is precisely that identified in [7], whereby the observable variation in any single shape sample is reduced onto a manifold in 2

*N*−4 dimensions for a 2D shape defined for

*N*points. This has generally been considered as a bias in the overall data distribution rather than being associated specifically with a statistical estimation error (as here). A possible outcome of this is the over weighting of landmarks leading to a runaway convergence on one landmark, during iterative estimation of

*C*. However, this bias effect is estimable and therefore correctable, as will be illustrated by Monte-Carlo simulation (below). For a single scale parameter associated with an approximate linear vector

**f**we can use error propagation to estimate the expected average reduction Δ in the covariance for each 2×2 landmark component of the matrix arising from errors in parameter estimates Δ

_{ n }

*C*as

*χ*

^{2}expected due to a unit change in

**f**, and

**f**

_{ n }=

*D*

_{ n }

**f**is the 2D component of

**f**corresponding to landmark

*n*(where

*D*

_{ n }is an operator which zeros all but those quantities associated with the

*n*th landmark and ⊗ is for outer product between two vectors). For an eigenvector

**e**

_{ j }defined in the whitened ghost space, this would suggest a total correction of

The known structure of the covariance can be enforced by zeroing relevant off-diagonal terms. The parameters of the linear model, including scale, rotation, translation and linear model weightings can also be treated in this way. If Θ_{
i
} represents one of the direction vectors of these parameters (with 2*N* elements for 2D data), it follows that direction vectors corresponding to translation in x and y directions Θ_{1}=[1,0,1,0,...] and Θ_{2}=[0,1,0,1,...] are orthogonal, i.e. Θ_{1}.Θ_{2}=0. Similarly, direction vectors Θ_{3}=**m**=[*m*_{1x},*m*_{1y},*m*_{2x},*m*_{2y},...] and Θ_{4}=[−*m*_{1y},*m*_{1x},−*m*_{2y},*m*_{2x},...] corresponding to scaling and rotation are orthogonal, and so Θ_{3}.Θ_{4}=0. Note that **m** is identical to the mean vector defined in Eq. (1).

Strictly, Kendall’s definition of shape explicitly removes aspects of object transformation before model construction. Joint estimation of shape and alignment parameters is potentially unstable as estimated linear shape parameters can correlate with transformation parameters. Here we stabilise this process by removing first order correlations from the data covariance *F* prior to model construction.

_{ i }. The new

**g**

_{ k }is computed iteratively using each ${\widehat{\Theta}}_{\mathit{i}}$ so that any variation about the mean that could have been described by an alignment parameter is removed from the correlation matrix

*F*prior to model construction. The corresponding measurement covariance correction term is hence given by

Using the above formula, the contribution to the *χ*^{2} lost by using a scaling parameter associated with each vector **e**_{
j
} and Θ_{
i
} contributes a value of unity to the *χ*^{2} for each additional independent degree of freedom, totalling *J*+4. Our method for covariance correction is therefore consistent with a degree of freedom correction as described in conventional analysis approaches [46]. As a consequence the covariance estimation process can be considered equivalent to the Expectation-Maximisation (EM) algorithm, both in operation and parameter estimates, so that the conventional proof of convergence is applicable [47].

### Extension from 2D to 3D

Here we outline the mechanism we use to extend 2D shape rotation analysis, and the extraction of corrected anisotropic measurement covariances, to 3D. The methods are demonstrated in the analysis of 3D mouse skull data, both as a test of the theory/software implementation and as an illustration of use for the identification of outlier landmarks.

The extension to 3D data is mainly involved with the mechanism of representing and estimating 3D shape rotations. We define a fixed orientation co-ordinate system from a set of 3D data-points based upon a selection of three landmark points. We then represent a rotation matrix in terms of three separate rotations about the co-ordinate axes. Finally we compute the linear vectors which approximate the first order shifts seen in the 3D points due to these rotations. These are then used in the linearised approximation for sample covariance correction, as described earlier. These extensions are enough to support a quantitative analysis of 3D landmark data, for the estimation of landmark accuracy and identification of outlier data. The mathematical model used is described in detail here and in Appendix A. We provide quantitative tests in the Results and discussion section which demonstrate the numerical stability of the algorithms using Monte-Carlo data.

### Rotation matrix

Our first task is to define a co-ordinate system for a 3D data-set, from which we can define certain basic properties of orientation for the mean shape, and so that individual data samples can be approximately oriented prior to optimisation during linear model construction. In the 2D case this is done by defining the line between two landmark points in the mean model as horizontal. In 3D, in order to stay consistent with the 2D, we define 2 points to establish a horizontal, and then a third to define the vertical relative to the first two.

*P*

_{1},

*P*

_{2},

*P*

_{3}, with relatively large distance from each other (Figure 1) to define the orientation plane for the shape. The rotation matrix

*R*

^{ T }is hence found based on basic vector calculations (see Appendix A).

### Roll, pitch and yaw angles

*α*,

*β*, and

*γ*as yaw, pitch, and roll respectively, the 3D rotation matrix is defined as three consecutive rotations around the z, y, and x coordinate axes.

By making the rotation matrix *R*^{
T
} equivalent to *R*_{
xyz
}, we find the yaw, pitch, and roll angles (see Appendix A). Thus we can convert easily between the rotation matrix and rotation parameters.

### Orientation adjustments

We initialise the rotation angles, by computing the *R*^{
T
} matrix for every original shape in the data set based upon the three identified landmark points and extracting the corresponding *α*, *β*, and *γ* angles. These are then further adjusted during iterative alignment via optimisation of the anisotropic measurement-based Mahalanobis distance. We perform orientation adjustment on the mean shape following every iteration over the set of shape samples. In this case the set of yaw, pitch, and roll angles corresponding to the mean shape are subtracted from the corresponding rotation angles for each shape sample, so that the computed mean shape complies with the three-point orientation constraint.

### Direction vectors

In order to correct the covariances due to alignment parameters in 3D, we need the approximate linear direction vectors corresponding to translation, rotation and scale. Computing these for translation and scale is straightforward. If **m**=[*m*_{1x},*m*_{1y},*m*_{1z},*m*_{2x},*m*_{2y},*m*_{2z},...] is the vector corresponding to the 3D mean shape (with 3*N* elements), then the direction vectors due to translation in x, y and z directions are simply given by Θ_{1}=[1,0,0,1,0,0,...], Θ_{2}=[0,1,0,0,1,0,...] and Θ_{3}=[0,0,1,0,0,1,...]. Also, the direction vector due to scaling is Θ_{4}=**m**.

*R*

_{ z },

*R*

_{ y }and

*R*

_{ x }. For the mean shape

**m**rotated by the yaw angle

*α*around the z axis, we have

**m**

^{ ′ }=

*R*

_{ z }(

*α*)

**m**. As

*α*becomes very small, the tangential direction of movement in landmark point

*n*due to this rotation is

*β*around the y axis and by the roll angle

*γ*around the x axis (see Appendix A). Hence we have

It follows that Θ_{5}=[−*m*_{1y},*m*_{1x},0,−*m*_{2y},*m*_{2x},0,...], Θ_{6}=[*m*_{1z},0,−*m*_{1x},*m*_{2z},0,−*m*_{2x},...] and Θ_{7}=[0,−*m*_{1z},*m*_{1y},0,−*m*_{2z},*m*_{2y},...]. The set of vectors Θ_{1}, Θ_{2} and Θ_{3} on one hand, and the set of vectors Θ_{5}, Θ_{6} and Θ_{7} on the other hand are mutually orthogonal and orthogonal to the vector Θ_{4} due to scaling. These direction vectors now constitute the linearised parameterisations needed for corrections to the sample covariance (where *I*=7 in Eq. 9).

### Procedures

**The algorithmic procedure for our new method**

Step | Process |
---|---|

1 | Initialise each translation parameter |

2 | Initialise each rotation parameter |

3 | Initialise scale parameters |

4 | Initialise measurement covariance matrix as identity matrix. |

5 | Compute initial transformed shapes |

6 | Compute the initial mean shape |

7 | Compute current transformed shapes |

8 | Compute the current mean shape |

9 | Compute the whitening matrix |

10 | Compute current ghost points |

11 | Construct current models ${\mathbf{\text{z}}}_{\mathit{k}}^{\mathit{\prime}}$ based on PCA and the number of eigenvectors |

12 | Minimise the Mahalanobis distance corresponding to every shape |

13 | Update current estimates of |

14 | Compute current estimate of the sample covariance matrix |

15 | Compute covariance correction term $\Delta {\mathit{C}}_{{\mathbf{\text{e}}}_{\mathit{j}}}$ due to degrees of freedom in the model (Eqs 5-6) for every eigenvector used |

16 | Skip this step for the first iteration (as it requires an estimate of |

17 | Compute current estimate of the measurement covariance matrix |

18 | Repeat steps 7 to 17 until convergence (typically ≈10 iterations). |

### Model selection

*σ*

_{ r }(our ability to define homologous points reliably), and the second will be due to random (unmodellable) biological variation

*σ*

_{ b }. So that the observed statistical variation seen in a given direction

*v*for any landmark

*σ*

_{ v }is

Unfortunately we cannot know the expected value of *σ*_{
b
} in advance. However, the first of these terms can be estimated via reproducibility experiments and compared to the measured directional covariances, using the observation that *σ*_{
v
}≥*σ*_{
r
}. Thus if we observe individual estimates of measurement covariance which begin to surpass the limiting accuracy known to be set by reproducibility tests, then the model must be over-fitting the data and therefore has too many parameters. We check that for a given model order this inequality is satisfied within statistical limits by considering the principle axes of each landmark measurement distribution. We use a 1% confidence level to set the hypothesis test for over-fitting. This test is expected to be most reliable for the largest variances.

### Monte-Carlo tests and outlier identification

As our method is based on likelihood, we require that the assumed distribution matches the corrected covariance. The standard way to validate this is through generating Monte-Carlo (MC) data using the known distributions. In what follows we experiment with MC data and display a number of informative scatter plots for two forms of test; Test A: When applying our method to the MC data, the mean shape, eigenvectors and measurement covariances used are identical to the ones used when generating the simulated data. Test B: All parameters are estimated using the MC data in order to compare the measurement covariances estimated using the simulated data with those expected, i.e. the ones assumed when generating the MC data.

For Test A the covariances estimated using our method are expected to be within statistical sampling limits of the ones used when generating the MC data. Failure to do so is taken as an indication of a problem with the data sample (i.e. outliers). Outliers can be identified at early stages of analysis as those points which have the largest normalised residual errors.

We use 2.8 standard deviations of the error on the sample variance (or being allowed to have 1% of data falling outside the limits), where the error on the standard deviation *σ* is $\mathit{\sigma}/\sqrt{2(\mathit{K}-1)}$ with *K* being the number of samples [48]. Additional variance is expected for Test B (beyond that seen in Test A), where the linear model must also be estimated. Therefore, having excluded the possibility of outliers using Test A, we can interpret variations beyond the statistical limits as due to instability in linear model construction (specifically the mean and eigenvectors).

#### χ^{
2
} test

A test is needed to confirm the equivalence of measurement covariances computed during repeatability experiments, in order to confirm that our methods generate estimates which are consistent. This can also be done by splitting the data into two separate groups if there are a sufficient number of samples. We perform a modified *χ*^{2} test based upon the construction of corrected covariances on one data set and then used for the calculation of *χ*^{2} for the second set. For large numbers of samples ( *K*>30) the resulting statistic when applied to each 2D landmark is expected to be approximately Gaussian with mean 2*K* and variance 4*K*. We set the statistical test for significant difference on the basis of an allowable range of *χ*^{2}/*D* *o* *F* corresponding to ±2.8 *S*.*D*., i.e. [0.8, 1.2] for 200 samples. The corresponding plot would confirm the stability of the method if 99% of the *χ*^{2}/*D* *o* *F* values fall inside the range expected.

#### Fisher information

Fisher information (FI) is a concept for quantifying the constraint on an estimated value associated with data. It has the useful property that the amount of estimated information is linear in the quantity of data. It is generally defined according to the second derivative of a log-likelihood function, but from the association of this function and the CRB we can also observe that, for good model fits, it is proportional to the inverse variance. An empirical estimate of the FI contained in data, and associated with a particular model, can therefore be obtained from the residual distributions following parameter estimation.

We use this idea here to summarise the amount of information that has been extracted from data for a specific analysis. As this quantity scales linearly with the quantity of data it allows us to make comparative statements regarding the statistical efficiency associated with the estimation process. For example, if the FI is seen to double on the same dataset when applying an alternative analysis then this is statistically equivalent to having four times as much data to begin with. A poor analysis method might need a lot more data to reach the same level of statistical equivalence in a hypothesis test than a good method.

### Ethics

The animal datasets used in this paper have been approved according to German ethical standards. They were registered under number V312-72241.123-34 (97-8/07) and approved by the ethics commission of the Ministerium für Landwirtschaft, Umwelt und ländliche Räume on 27.12.2007.

## Results and discussion

We have used example datasets to investigate the stability of covariance weighted shape analysis and to compare quantitative performance figures to the standard approach using Procrustes. We have selected several datasets in order to demonstrate behaviour with different quantities of data, data dimensionality (i.e. 2D and 3D) and model order.

As standard methods, even those including landmark weighting, are not conventionally used in a way that would support estimation of landmark variability we have made some assumptions regarding what would be the most straightforward approach. As mentioned earlier, in this paper we are interested in analysing point-based shape datasets without seeking to obtain extra knowledge about local structures surrounding each landmark. Hence, in conjunction with our method, we have not used methods that estimate localisation errors from the original image data such as those described in [26, 28]. For Procrustes we use the residuals from the fitted models to make an estimate of landmark measurement error (although this is widely concluded in the literature not to work [22]). For methods that would support anisotropic weighting, we use a variation of our own method (incorporating iterative re-weighted alignment) to estimate the resulting residuals during iterative analysis. The difference between this and our preferred method is the lack of correction for degree of freedom biases, we therefore refer to this as the “uncorrected” method.

### Data

Next, we use some fly wing data in order to test the performance of our method on semi-landmarks and also to test the statistical stability of our method. There are four original data sets available from left and right wings(L and R) of 200 female flies, called FL1, FL2, FR1 and FR2 [49]. Two images of each wing were taken from slightly different viewing positions (1 and 2), and used for marking-up in order to perform reproducibility tests [49]. Each of these four data sets has 200 samples with 15 landmarks per sample. Further, as we had access to the fly wing images, we have added four semi-landmarks to each sample of the original data set FL1. Once finished, we removed 5% outliers and stored 189 samples with 19 landmarks per sample. This resulting data set, which is called P-FL1, plays an important role in our experiments with semi-landmarks. In order to be able to test the repeatability with these added semi-landmarks, we have repeated the marking-up process only for the four new landmark points and using a subset of the left fly wing images.

### Model selection

### Monte-Carlo tests

Further, the results for the Test B (Figures 10 and 11) indicate that even for the mouse mandible data, the values of covariance are significantly different, due to the amplification of initial estimation bias during the process of iterative linear model estimation. The correction process now removes these instabilities bringing estimated covariances back close to the expected sampling limits and symmetrically around the expected correlation line.

Turning to the 3D MS data, for the Test A (Figure 9) the eigenvalues fall inside the allowable range (dashed lines). However for the Test B (Figure 12), the eigenvalues appear to fall under the lower bound. The under-estimation seen is in accordance with a correction factor based upon the number of samples and model complexity (*K*−*J*)/*K*. Unlike the earlier biases this under-estimation does not destabilise the analysis, as a common multiplicative change on all variance estimates leaves the estimated model parameters unaffected.

Note that the equivalent residual distributions estimated here from the conventional Procrustes analysis have no associated correction process and (along with uncorrected estimates from our own algorithm) are probably indicative of anything which could be attempted based upon estimating sample covariances for existing weighted methods.

### Shape analysis

In both Figures 21 and 22, from the left to the right, we show the projected results on zy, xy and xz planes respectively. Using the mouse skull volume shown in Figure 3, one can see how these viewing planes (zy, xy and xz) correspond to the coronal, sagittal and transverse planes respectively. In these 42 data sets, five had a marked asymmetry of the nasal bones (affecting landmark 1), three had a partially open frontal suture (affecting landmark 3), and one exhibited both of these effects. In Figure 21, one can observe that the largest error bars estimated using our method are for the landmarks 3 and 1. This is consistent with the data clouds corresponding to these landmarks in Figure 22 where in each case some points stand away from the main cloud due to the deformations mentioned above. This is not the case for Procrustes where the error residuals left after alignment for landmarks 3 and 1 show severe underestimation. This is due to the fact that Procrustes translates strong shifts in one landmark position into smaller shifts in all landmarks. However, in this example the observed variation is largely restricted to deformations of the nasal bones (landmark 1) and partially open frontal suture (landmark 3) without displaying noticeable shape changes in other parts of the skull. Hence the larger error bars of our method give in this case a more accurate representation of the observed biological variation. This is in agreement with the results shown earlier in Figure 15 where for two landmarks Procrustes residuals are much smaller than the expected error values (standard deviations) with which the Monte-Carlo data were generated. For our method, however, estimated errors are all comparable to the expected ones as shown earlier in Figure 12. In order to compare the magnitude of errors estimated using our method to those suggested by the repeat data, one should revisit Figure 6. The figure again suggests comparable error estimations. Finally, it is clear from the zy and xz projection planes that expected symmetry is achieved to a large extent in orientation and size for most corresponding error bars (in either method).

*χ*

^{2}test based upon the construction of corrected covariances on one data set (FL1/FR1) and then used for the calculation of

*χ*

^{2}for a second data set (FL2/FR2). The corresponding plot for

*χ*

^{2}test in Figure 24 confirms the stability of our method, as all

*χ*

^{2}/

*D*

*o*

*F*values fall in the range expected. Further

*χ*

^{2}tests (not shown here) with different numbers of data samples and combinations of data sets indicate the appropriateness of the assumed linear model for the fixed number of components.

**Fisher information (FI) values: listed for the Procrustes and our method when applied to the fly wing data (P-FL1), mouse mandible data (MM1) and 3D mouse skull data (MS)**

FI value | Procrustes | Likelihood |
---|---|---|

3D Mouse skull data (14-component model) | 23.62 | 111.88 |

Mouse mandible data (6-component model) | 6.60 | 19.55 |

Fly wing data (2-component model) 15 points | 17.36 | 29.68 |

Fly wing data (2-component model) 15 (+4) points | 13.81 (+0.88) | 25.46 (+2.47) |

Finally, the PCA analysis shows that in fly wing data 3 components can account for about 65% of variance, while for mouse mandibles 6 components are needed to achieve the same level. In both cases, the model order preferred by our analysis is significantly less than the heuristic limit of 90% used by some researchers.

## Conclusions

Our analysis approach has been driven by the requirements of statistical estimation, quantitation and self consistency, i.e. distributions assumed during likelihood construction match the data and estimated parameters match those generating the data. From a more philosophical standpoint we can consider what we are doing when we identify landmark locations and attempt to compare them between sets (shapes). We do not expect that biology manipulates the locations of our chosen landmarks directly, they simply appear to move around as the net effect of distributed developmental and evolutionary influences. Recent considerations of biology have introduced the phrase “palimpsest” [52], as an analogy with repeatedly erasing and rewriting text in an ancient parchment, to describe the way that structures develop. Notice that the initial choice of landmarks is subjective, not only in terms of the features selected but also how we chose to define their locations. A landmark is the result of a localisation procedure (partly influenced by multiple biological considerations) which has an associated positional uncertainty. In this work we have associated the problems of working with semi-landmarks in biological shape analysis as being a consequence of the statistical assumptions implicit to analysis techniques such as Procrustes/PCA. We have implemented a new method which takes appropriate account of measurement and landmark localisation stability in order to obtain a new form of analysis which is consistent with a likelihood-based definition of the alignment and model building tasks. This method can be equivalently interpreted as a redefinition of the landmark location as ghost points.

The conventional interpretation of Procrustes is that the resulting linear model is a pure shape description which can be directly associated with biological processes. Some may argue that extending the approach to weight data, even to accommodate semi-landmarks, breaks with this tradition. However, it is our belief that any distinction between the original landmark and our definition of a ghost point, as locations which are somehow true measurements of biology in one case but not the other, is arbitrary. Re-weighting of data using a covariance is statistically equivalent to modifying the information available by changing the specified set of landmarks. Use of a least-squares measure (which assumes isotropic errors) does not introduce some absolute measurement of biology. Both approaches need to be calibrated using known samples with identifiable biological cause in order to make any scientific interpretation.

Now that we have a specific definition for how to weight landmark data, we can see that using ghost points does not invalidate use of Kendall’s statistics as suggested in [22]. The use of these approaches follows due to scale normalisation of the shape data, it is not an intrinsic property of the use of the original landmarks co-ordinates per-se. We can also re-project scaled (whitened) shapes onto the tangent space defined in the transformed ghost space if we wish, in order to remove local curvature arising from scale normalisation.

Far from there being no objective way to define these covariances [22, 24], there are at least three; a) one can estimate them directly from repeatability of measurements (e.g. see [48]); b) they can be directly estimated via conventional statistical means when using likelihood-based landmark location (CRB) (e.g. see [25, 26, 28]); c) they can be estimated as the unexplained stochastic variation (residuals) in fitted data (as in this paper and e.g. [27]). For the latter, when estimated using residuals of the fitted shape model, we will see contributions additional to the measurement process; this is the stochastic (therefore unmodellable) behaviour of the biology itself. Our results indicate that measurement covariances can be reliably estimated in our data for sample sizes at least as small as 40.

Our result indicate that the new method summarises the information content of the measured data better (improved FI scores), and with more stability than Procrustes/PCA (consistent models are generated following the addition of new points). Although we have not provided empirical evidence in this paper, the expected theoretical advantages of this approach are several; a) as all landmarks of fixed local structure have an associated measurement covariance, the approach described provides a consistent way of incorporating qualitatively different forms of landmark (type I, type II, semi-landmarks, geometric landmarks, etc.) into the analysis; b) provided that landmark stability is well described by a Gaussian distribution, our method removes the instabilities inherent in the analysis due to poorly determined points; c) as the parameters for the linear model are now self-consistently estimated for an identifiable generative scheme (embodied here via Monte-Carlo simulation) it affords the application of an eigenvector analysis statistical rigour; d) it offers the possibility of interpreting the linear modelling process as a statistical approximation, with consequent interpretations of the requirement for the number of linear model components; e) finally, generalisation of the approach would seem to be possible which would support the analysis of dense landmarks on surfaces and curves.

We have also demonstrated how linear model order selection can be performed by comparing baseline reproducibility errors with those estimated from the model. Finally, we have shown how the use of repeated analysis on matched samples can be used to confirm the stability of the estimated anisotropic error. We believe that these tools are sufficient to allow use of this technique in biological studies. More study is needed in order to develop an understanding of the value of our new technique in a greater range of biological analyses.

The methods described in this paper are freely available from the TINA web site [51] via the Geometric Morphometric toolkit, as a system for quality assessment and validation of output data.

## Endnote

^{a}Bookstein [53]: “Wherever there is partial registration the true value of a (vector deformation) is inaccessible.”

## Appendix A

### Rotation matrix

*R*

^{ T }is hence given by:

### Roll, pitch and aw angles

The multiplication of the rotation matrices *R*_{
x
}(*γ*), *R*_{
y
}(*β*) and *R*_{
z
}(*α*) gives

Hence by enforcing *R*^{
T
}=*R*_{
x
y
z
}, it is straightforward to find the rotation angles *α*, *β* and *γ*.

### Direction vectors

*n*with

*m*

_{ n x },

*m*

_{ n y }and

*m*

_{ n z }as the mean coordinates, the rotated vector by angle

*α*around the z axis is

*α*gives

## Declarations

### Acknowledgements

This work was funded by institutional resources of the Max-Planck Society. The authors would like to thank Chris Klingenberg (at the University of Manchester) and Louis Boell (at the Max-Planck Institute for Evolutionary Biology) for providing the fly wing data and the mouse mandible data respectively.

## Authors’ Affiliations

## References

- Adams DC, Rohlf FJ, Slice DE: Geometric morphometrics: ten years of progress following the ‘revolution’. Ital J. Zool. 2004, 71: 5-16. 10.1080/11250000409356545.View Article
- Klingenberg CP: Evolution and development of shape: integrating quantitative approaches. Nat Rev Gen. 2010, 11: 623-635.
- Mitteroecker P, Gunz P: Advances in geometric morphometrics. Evol Biol. 2009, 36 (2): 235-247. 10.1007/s11692-009-9055-x.View Article
- Vignon M, Sasal P: The use of geometric morphometrics in understanding shape variability of sclerotized haptoral structures of monogeneans (Platyhelminthes) with insights into biogeographic variability. Parasitol Int. 2010, 59 (2): 183-191. 10.1016/j.parint.2010.01.006.View ArticlePubMed
- Bookstein FL: Tensor biometrics for changes in cranial shape. Ann Human Biol. 1984, 11: 413-437. 10.1080/03014468400007321.View Article
- Goodall CR: The Statistical Analysis of Growth in Two Dimensions. 1983, USA. Harvard University: Department of Statistics
- Kendall DG: Shape-manifolds, procrustean metrics, and complex projective spaces. Bull London Math Soc. 1984, 16 (2): 81-121. 10.1112/blms/16.2.81.View Article
- Bookstein FL: Size and shape spaces for landmark data in two dimensions. Stat Sci. 1986, 1: 181-242. 10.1214/ss/1177013696.View Article
- Mantel NA: The detection of disease clustering and a generalized regression approach. Cancer Res. 1967, 27: 209-220.PubMed
- Peres-Neto PR, Jackson DA: How well do multivariate data sets match?The advantages of a procrustean superimposition approach over the mantel test. Oecologia. 2001, 129: 169-178. 10.1007/s004420100720.View Article
- Hubert M, Rousseeuw PJ, Branden K: ROBPCA: A new approach to robust principal component analysis. Technometrics. 2005, 47: 64-79. 10.1198/004017004000000563.View Article
- Gunz P, Mitteroecker P, Bookstein FL: Semilandmarks in three dimensions. Modern Morphometrics in Physical Anthropology. Edited by: Slice DE. 2005, New York: Kluwer Academic/Plenum Publishers, 73-98.View Article
- Bookstein FL: Landmark methods for forms without landmarks: morphometrics of group differences in outline shape. Med Image Anal. 1997, 1 (2): 225-243.View ArticlePubMed
- Fitzpatrick JM, West JB, Maurer CR: Predicting error in rigid-body point-based registration. IEEE Trans Med Imaging. 1998, 17 (5): 694-702. 10.1109/42.736021.View ArticlePubMed
- Chui H, Rangarajan A: A new point matching algorithm for non-rigid registration. Comput Vision Image Underst. 2003, 89 (2-3): 114-141. 10.1016/S1077-3142(03)00009-2.View Article
- Rohlf FJ, Slice DE: Extensions of the procrustes method for the optimal superimposition of landmarks. Syst Zool. 1990, 39: 40-59. 10.2307/2992207.View Article
- Walker JA: Ability of geometric morphometric methods to estimate a known covariance matrix. Syst Biol. 2000, 49 (4): 686-696. 10.1080/106351500750049770.View ArticlePubMed
- Richtsmeier JT, Deleon VB, Lele SR: The promise of geometric morphometrics. Yearbook Phys Anthropol. 2002, 45: 63-91.View Article
- Rohlf FJ: Bias and error in estimates of mean shape in geometric morphometrics. J Human Evol. 2003, 44: 665-683. 10.1016/S0047-2484(03)00047-2.View Article
- Lele S: Euclidean distance matrix analysis (EDMA): estimation of mean form and mean form difference. Math Geol. 1993, 25 (5): 573-602. 10.1007/BF00890247.View Article
- Martinez-Abadias N, Heuze Y, Wang Y, Jabs EW, Aldridge K, Richtsmeier JT: FGF/FGFR signaling coordinates skull development by modulating magnitude of morphological integration: evidence from Apert syndrome mouse models. PLoS One. 2011, 6 (10): 1-9.View Article
- Zelditch ML, Swiderski DL, Sheets HD, Fink WL: Geometric Morphometrics for Biologists, A Primer. 2004, New York: Elsevier Academic Press
- Goodall CR: Procrustes methods in the statistical analysis of shape. J R Stat Soc, Ser B (Methodological). 1991, 53 (2): 285-339.
- Lele S, Richtsmeier JT: Statistical models in morphometric: are they realistic?. Syst Zool. 1990, 39: 60-69. 10.2307/2992208.View Article
- Theobald DL, Wuttke DS: Empirical bayes hierarchical models for regularizing maximum likelihood estimation in the matrix gaussian procrustes problem. Proc Natl Acad Sci USA. 2006, 103 (49): 18521-18527. 10.1073/pnas.0508445103.PubMed CentralView ArticlePubMed
- Rohr K, Stiehl HS, Sprengel R, Buzug TM, Weese J, Kuhn MH: Landmark-based elastic registration using approximating thin-plate splines. IEEE Trans Medical Imaging. 2001, 20 (6): 526-534. 10.1109/42.929618.View ArticlePubMed
- Ragheb H: Morphometric shape analysis with measurement covariance estimates. Proc. British Machine Vision Conference. 2011, Dundee, UK
- Ragheb H, Thacker NA: Quantitative localisation of manually defined Landmarks. Proc. Medical Image Understanding and Analysis. 2011, London, UK., 221-225.
- Balachandran R: Iterative solution for rigid-body point-based registration with anisotropic weighting. Proc. of SPIE (Medical Imaging),. vol. 7261. 2009, 72613D-1–72613D-10.
- Beinat A, Crosilla F: A generalized factored stochastic model for the optimal global registration of LIDAR range images. Proc. of IAPRS,. Vol. 34. 2002, 36-39.
- Hyvarinen A, Karhunen J, Oja E: Independent Component Analysis. 2001, New York: John Wiley & SonsView Article
- Ruto A, Lee M, Buxton B: Comparing principal and independent modes of variation in 3D human torso shape using PCA and ICA. ICA Research Network International Workshop. 2006, Liverpool, UK, 1-4.
- Uzumcu M, Frangi RF, Reiber JHC, Lelieveldt BPF: Independent component analysis in statistical shape models. SPIE Med Imaging,. Volume 5032. 2003, 375-383.
- Mitteroecker P, Bukstein F: Linear discrimination, ordination, and the visualization of selection gradients in Modern Morphometrics. Evol Biol. 2011, 38: 100-114. 10.1007/s11692-011-9109-8.View Article
- Luo B, Hancock ER: Iterative procrustes alignment with the EM algorithm. Image Vision Comput. 2002, 20 (5): 377-396.View Article
- Cootes TF, Taylor CJ, Cooper DH, Graham J: Active shape models-their training and application. Comput Vision Image Underst. 1995, 61: 38-59. 10.1006/cviu.1995.1004.View Article
- Klingenberg CP: Novelty and “homology-free” Morphometrics: What’s in a name?. Evol Biol. 2008, 35 (3): 186-190. 10.1007/s11692-008-9029-4.View Article
- Polly PD: Developmental dynamics and G-Matrices: Can morphometric spaces be used to model phenotypic evolution?. Evol Biol. 2008, 35 (2): 83-96. 10.1007/s11692-008-9020-0.View Article
- Oxnard C, O’Higgins P: Biology clearly needs morphometrics. Does morphometrics need biology?. Biol Theory. 2009, 4: 84-97. 10.1162/biot.2009.4.1.84.View Article
- Bookstein FL, Slice DE, Gunz P, Mitteroecker P: Anthropology Takes Control of Morphometrics. 2004, Vienna, Austria: Institute for Anthropology: University of Vienna
- Slice DE: Geometric morphometrics. Annual Rev Anthropol. 2007, 36: 261-281. 10.1146/annurev.anthro.34.081804.120613.View Article
- Perez SI, Bernal V, Gonzalez PN: Differences between sliding semi-landmark methods in geometric morphometrics, with an application to human craniofacial and dental cariation. J Anat. 2006, 208 (6): 769-784. 10.1111/j.1469-7580.2006.00576.x.View ArticlePubMed
- Gomez-Robles A, Olejniczak AJ, Martinon-Torres M, Prado-Simon L, de Castro JMB: Evolutionary novelties and losses in geometric morphometrics: a Practical approach through Hominin molar morphology. Evolution. 2011, 65 (6): 1772-1790. 10.1111/j.1558-5646.2011.01244.x.View ArticlePubMed
- Frederich B, Liu SYV, Dai CF: Morphological and genetic divergences in a coral reef damselfish, pomacentrus coelestis. Evol Biol. 2012, 39: 359-370. 10.1007/s11692-011-9158-z.View Article
- Tipping ME, Bishop CM: Probabilistic principal component analysis. J R Stat Soc B. 1999, 61 (3): 611-622. 10.1111/1467-9868.00196.View Article
- Akaike H: A new look at the statistical model identification. IEEE Trans Automatic Control. 1974, 19 (6): 716-723. 10.1109/TAC.1974.1100705.View Article
- Dempster AP, Laird NM, Rubin DB: Maximum likelihood from incomplete data via the EM algorithm. J R Stat Soc B (Methodological). 1977, 39: 1-38.
- Barlow RJ: Statistics: A Guide to the Use of Statistical Methods in the Physical Sciences. 1989, Wiley-Blackwell
- Fly Wing Data. Klingenberg Lab, The University of Manchester. [http://www.flywings.org.uk]
- Schunke AC: TINA manual landmarking tool: software for the precise digitization of 3D landmarks. Front Zool. 2012, 9 (6):
- Bromiley PA: The TINA Geometric Morphometrics Toolkit. [http://www.tina-vision.net/docs/memos/2010-007.pdf]
- Halgrimsson B, Lieberman DE, Young NM, Parsons T, Wat S: Evolution of covariance in mammalian skull. Novartis Foundation Symposium-Tinkering: The Microevolution of Development,Volume 284. Edited by: Hall BK, Lieberman DE. 2007, New York: Wiley-Liss, 164-184.
- Bookstein FL: Registration error and functional image analysis. Workshop on Biomedical Statistics. 2001, Leeds: UK

## Copyright

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.