UltraScan Version

Manual


CorMap Analysis Module:

Last updated: December 2017

NOTICE: this module is being developed by E. Brookes, J. Pérez, P. Vachette, and M. Rocco.
Portions of this help file are taken from Brookes et al. "US-SOMO HPLC-SAXS Module: Dealing with Capillary Fouling, and Extraction of Pure Component Patterns from Poorly Resolved SEC-SAXS Data", J. Appl. Cryst.49:1827-1841, 2016.

Warning: this Help section was originally written in 2017, and has not been fully updated for the July 2024 intermediate US-SOMO release. Therefore, all screenshots refer to an older layup, although the commands are mostly the same. In particular, the CorMap Analysis button has been renamed "PVP" ("P-value pair" analysis). An update of this Help section is planned.


Synopsis

SEC-SAXS data analysis involves repeated curve comparisons and decisions regarding their similarity. This problem has recently been addressed by Franke et al. (Franke D, Jeffries CM, Svergun DI. Correlation Map, a goodness-of-fit test for one-dimensional X-ray scattering spectra. Nature Methods, 12, 419-422, 2015) in a paper in which the authors propose a novel goodness-of-fit test for assessing differences between one-dimensional datasets using only data point correlations over the recorded q‑range or part of it, independently of error estimates, named Correlation Map (CorMap for short). We implemented a routine derived from the calculations described in Franke et al. (2015), in which we essentially perform pairwise comparison of two scattering patterns. In this case, the probability of similarity between the two curves (two different frames or experimental and calculated intensities) may be quantified by evaluating the probability (P‑value) that the largest observed stretch of constant sign correlations be observed by chance. If the P‑value is less than a given threshold, the two curves can be considered as statistically different. We refer the reader to the original article for more details on the method.

When analysing multiple curves for similiarity, we offer two options. The first options is to compare a statistic of the curves against a reference dataset, and the second is to utilize the Holm-Bonferroni multiple-testing adjustment (Holm, S. (1979). Scand. J. Stat. 6, 65-70; Holm-Bonferroni method Wikipedia).

When comparing a set of scattering frames, we perform all pairwise comparisons. We present the results in a synthetic way by plotting a square matrix in which the dot (i,j) contains the respective pairwise P-value represented using a three color code1: green for  0.05, yellow for 0.01  P < 0.05 and red for P < 0.01, when not using the Holm-Bonferroni adjustment; the same color code is utilized using the adjusted acceptance threshold when applying the HB procedure. This pairwise P‑value map is first analyzed in terms of the distribution of values between the three classes with an emphasis on the % of “red” dots. In our unadjusted comparative approach, this is complemented by an evaluation of the average red cluster size, defined as maximal groupings of horizontally and/or vertically adjacent “red” dots. After careful examination of several indicators derived from the pairwise P-value map analysis, average red cluster size was chosen as the most reliable one to determine the global similarity between all frames of the considered subset. However, we have observed that red P-values are too few for clusters to be present when the Holm-Bonferroni adjustment is applied. In this case, the percentage of red pairs is used as the indicator. When the unadjusted comparative approach is used, conclusions are reached regarding the global similarity within the dataset of interest from the comparison of the resulting distributions obtained for that dataset and for the reference set.

We also provide a qmax cutoff for all P-value comparisons, which is by default 0.05 Å‑1 but can be changed by the user. The primary purpose of this cutoff is to reduce the number of points compared and to focus the comparison in the region of greatest signal information and thereby increase the sensitivity of the probability test.

Details

We start with an example. Suppose we select two I(q) curves (in this case taken near the peak of an SEC-SAXS Lysozyme dataset) as shown below.

SOMO HPLC-SAXS Lysozyme I(q) 2 curves near peak

We wish to know if these two curves are P-value map probabilistically identical. This can be achieved by pressing the CorMap Analysis button in the first row under the plot. This will result in the following pop-up window:

SOMO HPLC-SAXS CorMap Correlation Correction

This window is asking if you wish to sample alternate q-points. Generally, the need for this depends on the beamline/detector characteristics, and is best evaluated during the analysis of Blanks (the frames typically averaged for buffer subtraction).

In this case will will press Continue to not sample. The following question:

SOMO HPLC-SAXS CorMap q minimum cutoff

If you wish to remove noisy low q values from the CorMap analysis, you may enter a positive q value here. In our example, we press OK without changing the default value of zero. Finally, the CorMap Analysis window will be shown.

SOMO HPLC-SAXS CorMap Analysis

For clarity, we start with the bottom of the text area. In dark blue, the details of the CorMap comparison test(s) are listed. The two file names are first listed, then the number of q points compared N, followed by the q point position where the longest streak occurs (Start point), then the length of the longest streak (C) and finally the P-value of a streak of length C occurring in a sequence of N points.

In this case, we have long streak C of 20, starting at Start point 8. You can see this streak in the residuals plot shown in first image of this section.

The P values correspond to colors : green for  0.05, yellow for 0.01  P < 0.05 and red for P < 0.01, as listed in the top of the text area.

In our example, this long C of 20 given an N of 78 points gives a P value < 0.01 and therefore encodes as red.

At the top left is the Pairwise P value map. This map summarizes the P value colors. The map is symmetric. The first row corresponds to the first file as summarized in the Ref. : Name section of the text area. The axis on the map are unfortunately not perfect, but the best we currently have (as in this case it unfortunately reports fractional values and the numbers are obviously not centered). In this trivial example, the map is a simple 2x2 since we are only comparing two I(q) data files. The diagonal is white, as it represents self-comparisons. The off-diagonal elements show the color of the P value comparison of the (i,j) curves.

At the top center is the Red pair % histogram. This histogram reports the percentage of red pairs in each row (or equivalently, column) as enumerated by Ref. of the map. There is a green horizontal line representing the overall average and also a yellow dotted lines at ± 1 S.D. (superimposed on the average in this trivial case, more informative examples are shown in the Scale mode and Baseline mode examples below).

At the top right is the Red cluster size histogram. A red cluster is defined as horizontally and/or vertically contiguous red points in the Pairwise P value map. In this case, we have simply a cluster size of one, and this is reported in the histogram. More complicated cases are reported the Scale Mode and Baseline Mode analyses below.

The text area contains in this order:

Below the text area is a checkbox labeled Holm-Bonferroni adjusted P values. Selecting this check box will replace the data with an Holm-Bonferroni adjusted version, which is not relevant in this trivial case of 2 curves. An example of Holm-Bonferroni adjusted data is shown here and here.

At the bottom of the window are four buttons

Note the title within the window (not the window caption at the very top) lists specific information about the current CorMap analysis. These include:

Example of 11 curves from Scale mode

SOMO HPLC-SAXS CorMap Analysis from scale mode

In this case, the CorMap analysis was performed on 13 curves from the top of a peak from the same Lysozyme data with alternate q point sampling. This is indicated in the window title with the text Only every 2nd q value sampled

Example of 11 curves from Scale mode with Holm-Bonferroni adjustment applied without sampling

SOMO HPLC-SAXS CorMap Analysis from scale mode

In this case, the CorMap analysis was performed on 13 curves from the top of a peak from the same Lysozyme data with with Holm-Bonferroni adjustment applied and without alternate q point sampling. Running the Holm-Bonferroni adjusted analysis with the alternative q value sampling as above results in a completely green map. Notice from the text area that the P-values limits have changed. These are the values as determined after application of the Holm-Bonferroni adjustment.

Example from Baseline mode

SOMO HPLC-SAXS CorMap Analysis from baseline mode

In this case, the title also reports the frame range. The range selected includes the eluting peak, so a lot of red occurs as I(q)'s change. A stable region is observable in the lower right as large, predominantly green diagonal sub-blocks appear.

Example from Baseline mode with Holm-Bonferroni adjustment applied

SOMO HPLC-SAXS CorMap Analysis from baseline mode

This is the idential dataset to the previous analysis with the same sampling. The only difference is the Holm-Bonferroni adjustment was applied. As above, the range selected includes the eluting peak, so a lot of red occurs as I(q)'s change. A large stable region is observable in the lower right as a completely green diagonal sub-block. As with the Scale mode analysis with Holm-Bonferroni adjustment, notice from the text area that the P-values limits have changed. These are the values as determined after application of the Holm-Bonferroni adjustment.

Example Global Gaussian mode

SOMO HPLC-SAXS CorMap Analysis from global Gaussian

In this case, the CorMap analysis is different from the standard CorMap analysis, and the button to access it changes from CorMap Analysis to Show CorMap to reflect this difference. The CorMap comparison is done between I(t) curves and their Gaussian representation, resulting in a single row of colors in the map, one for each I(t) and is Gaussian representation. There is also no red cluster information, as this is only applicable to a two dimensional map. (This mode does not currently support Load.)


1The same code is used by the authors in the CorMap implementation within PrimusQt software (Atsas package v. 2.7.1)


www contact: Emre Brookes

This document is part of the UltraScan Software Documentation distribution.
Copyright © notice.

The latest version of this document can always be found at:

http://somo.aucsolutions.com

Last modified on December 13, 2017. Warning note added July 10, 2024