Correction of chromatic shifts in three-dimensional (3D) multicolor fluorescence microscopy images is crucial for quantitative data analyses. This protocol is developed to measure and correct chromatic shifts in biological samples through acquisition of suitable reference images and processing with the open-source software, Chromagnon.
Quantitative multicolor fluorescence microscopy relies on the careful spatial matching of color channels acquired at different wavelengths. Due to chromatic aberration and the imperfect alignment of cameras, images acquired in each channel may be shifted, and magnified, as well as rotated relative to each other in any of the three dimensions. With the classical calibration method, chromatic shifts are measured by multicolor beads attached to the surface of a coverslip, and a number of software are available to measure the chromatic shifts from such calibration samples. However, chromatic aberration can vary with depth, change with observation conditions and be induced by the biological sample itself, thus hindering determination of the true amount of chromatic shift in the sample of interest and across the volume. Correcting chromatic shifts at higher accuracy is particularly relevant for super-resolution microscopy where only slight chromatic shifts may affect quantitative analyses and alter the interpretation of multicolor images. We have developed an open-source software Chromagnon and accompanying methods to measure and correct 3D chromatic shifts in biological samples. Here we provide a detailed application protocol that includes special requirements for sample preparation, data acquisition, and software processing to measure chromatic shifts in biological samples of interest.
Multicolor imaging is one of the fundamental aspects of biological fluorescence microscopy, in cases where the spatial relationship of different molecules or structures is of major interest. Chromatic aberration, an optical aberration of polychromatic light caused by dispersion, changes the apparent position of the colored objects of interest. Similarly, microscopes equipped with multiple cameras devoted to acquiring each color have more complex chromatic shifts due to differences in optical elements and imperfect alignment among the channels. Thus, such chromatic shifts may lead to a false conclusion unless explicitly corrected by the user. Although chromatic shifts have not been a major problem as long as the resolution of microscopy is limited by the classical resolution limit, recent development of super-resolution microscopy1 has prompted the need for more accurate correction of chromatic shifts.
It has been a common practice to measure chromatic shifts of microscope systems using a multicolor bead calibration slide2. The bead-based calibration method is appropriate for measuring chromatic shifts from the entire optics of the microscope towards the surface of the coverslip2. This method, however, is unable to measure chromatic shifts in the biological samples of interest. It is important to note that many biological samples are three-dimensional (3D), and the chromatic shifts of such samples are different from those at the surface of the coverslip. Furthermore, chromatic shifts change with imaging conditions2,3. We have measured the chromatic shifts in 3D biological samples and found that the uncertainty of chromatic shifts was often as much as 350 nm by the classical multicolor-bead calibration method3. Therefore, chromatic shifts need to be measured in biological samples at the depth of interest and under the imaging conditions being used.
Here, we describe procedures to measure chromatic shifts in biological samples and correct these shifts using our software, Chromagnon3. To measure chromatic shifts in biological samples, our method uses two kinds of data sets, a "target" image and a "reference" image. The "target" image is a multicolor image of interest, for example, images stained for DNA, nuclear envelope, and microtubules. It is often impossible to measure chromatic shifts in such an image. Therefore, we need a "reference" image that is dedicated to measure the chromatic shifts in the sample. The only definition of a "reference" image is a multicolor image of the same object. In this sense, a multicolor beads image is also a type of reference image. Here, we describe three different types of reference image that are used to measure chromatic shifts in the biological samples: "crosstalk reference images", "bright-field reference images" and "biological calibration reference images". The type of reference image depends on the type of microscope being used or the correction accuracy required as summarized in Table 1.
Crosstalk | Bright-field | Biological calibration (on a different slide) | Biological calibration (on the same slide) | |
Accuracya | +++ | + | ++b | +++ |
Simplicity | ++ | +++ | ++ | ++ |
Applicable microscopy | Wide-field | Wide-field | All | All |
Availability of local alignment | + | + | –c | –c |
a: Number of "+" indicates increasing rating. Single plus is about 50 nm and three plus is about 15 nm in 3D. b: The accuracy depends on how much the variable imaging conditions are kept constant. c: Local calibration measured by multicolor bead samples can be combined as described in protocol section 4. |
Table 1: Parameters when choosing the type of reference images.
"Crosstalk reference images" have the highest correction accuracy and are relatively simple to accomplish3,4 (Table 1). The drawback is their limitation in microscopy applications due to their incapability of measuring chromatic shifts in excitation paths. Also, to obtain such images, the microscope should be equipped with multiband dichroic mirrors, and emission filters that are independently controlled from the excitation filters or light sources. Suitable microscopy includes conventional wide-field microscopy, single molecule localization microscopy (SMLM) such as photo-activated localization microscopy/stochastic optical reconstruction microscopy (PALM/STORM)5,6 and expansion microscopy7 observed with wide-field microscopy. A crosstalk reference image is acquired from the target sample itself. It is an image of crosstalk (bleed-through) fluorescence of a dye obtained in all required channels. Fluorescence emission always expands towards the longer wavelengths, therefore dyes with the shortest emission wavelength are excited to obtain crosstalk fluorescence in channels of longer wavelengths. For example, when the sample is stained with blue, green, and red, only the blue dye is excited, and the emission light is obtained in the blue, green, and red channels. In this protocol, DNA stained with 4′,6-diamidino-2-phenylindole (DAPI) was used to obtain crosstalk fluorescence.
"Bright-field reference images" are an easier and less phototoxic alternative to "crosstalk reference images" but are the least accurate3 (Table 1). These are bright field images of the target sample, acquired in all the color channels used in the target image.
"Biological calibration reference images" have the advantage of being applicable to any type of microscopy due to their ability to measure the chromatic shifts both in the excitation and emission paths3,8 (Table 1). Suitable microscopy includes wide-field microscopy, confocal microscopy, light sheet microscopy, stimulated emission depletion (STED)9, structured illumination microscopy (SIM)10, Airyscan/SORA11,12, SMLM observed with the total internal reflection fluorescence (TIRF) mode, Olympus super resolution (OSR)13, and so forth. A biological calibration reference image is acquired from a calibration sample similarly prepared as the target sample, but with staining of a single structure with multiple colors. The correction accuracy excels the resolution of most super-resolution microscopy and preparing a biological calibration sample can be relatively simple. Another advantage is the availability to "average" multiple reference images. Therefore, even though the individual images contain poor information for the measurement of chromatic shifts, the information content can be increased by averaging multiple images. The accuracy depends on how much the imaging conditions are kept constant. In this regard, the best performance is obtained when both target and reference samples are on the same slide, using, for example, 8-well chambered coverglasses (Table 1, right-most). In this protocol, actin stained with three colors of phalloidin was used as a biological calibration.
Once a reference image is obtained, then the chromatic shift is measured and corrected by our software Chromagnon. There is no limitation on the number of channels, Z sections and time frames that Chromagnon can measure and correct the chromatic shifts for. Chromagnon measures chromatic shifts in two steps. The first step acquires the "global" or "affine" alignment parameters of translation in the X, Y, Z axes, magnification along the X, Y, Z axes, and rotation around the Z axis. The calculation accuracy of the global alignment is ~16 nm in 3D and ~8 nm in 2D. The second step is an optional 2D iterative "local alignment" on projected images to obtain a higher accuracy. In the local alignment process, the images are subdivided into multiple regions and chromatic shifts in these local regions are measured. Subsequently, the regions are further divided and chromatic shifts in the subregions are measured iteratively until the number of pixels in the region reaches the minimum number of pixels (usually 60 x 60 pixels). The resulting local alignment map is combined with the global alignment parameter and is applied to the target image by an elastic transformation. Following this step, the calculation accuracy is improved to ~14 nm in 3D and ~6 nm in 2D. The local alignment is not suitable for biological calibration reference images because biological structure in the reference is different from that in the target (Table 1). Therefore, only global alignment is used for biological calibration reference images.
The local chromatic shifts originate from two sources; microscope instrumental local distortion and biological structural inhomogeneity. Because microscope instrumental local distortion is constant, this can be measured from the multicolor beads reference sample and corrected as a fixed parameter. Chromagnon can combine the microscope instrumental local distortion map and the global alignment parameters from the biological calibrations (Table 1). Using this method, it is expected that the average accuracy of biological calibration will be improved by an additional 1−2 nm.
Here, we describe a protocol to correct the chromatic shifts of 3D fluorescence images using our software Chromagnon, from the easiest low end to the highest accuracy. We use immunostaining of HeLa cells as an example and observed them using 3D wide-field microscopy and 3D-SIM. In the first section, we describe how to prepare target samples and biological calibration samples. This part of the protocol should be optimized for the specific targets of the research. In the second section, we describe the acquisition methods for three kinds of reference images by microscopes. The assumption was to obtain blue, green, and red channels but channel composition should be modified by the specific targets of the research and by the setups of the microscope. It does not matter if the microscope is equipped with a single camera or multiple cameras. In the third section, we describe how one can use our software to measure and correct chromatic shifts of the target image by using reference images. Finally, in the fourth section, we describe a method to complement the biological calibration reference images by using a microscope's instrumental local calibration.
1. Sample preparation
2. Acquisition of reference images
3. Correction of chromatic shift using Chromagnon software
Figure 1: A screenshot of Chromagnon graphical user interface. Please click here to view a larger version of this figure.
Figure 2: Example screenshot for loading multiple files. (A) A case in which all reference images have the corresponding target images. Channel names are correctly identified by wavelengths (indicated by a green box) in the image files used in this example. (B) A case in which a single reference image is used to correct multiple target images. (C) A case in which multiple reference images (indicated by a red box) are averaged, and the resulting reference image after averaging is used to correct multiple target images. Please click here to view a larger version of this figure.
Figure 3: A screenshot of the image viewer. Please click here to view a larger version of this figure.
Figure 4: A screenshot of an alignment parameter editor. Please click here to view a larger version of this figure.
4. Generating a microscope-specific local alignment map
An example of chromatic shift correction using a crosstalk reference image is shown in Figure 5. The image was obtained with a wide-field microscope equipped with a single camera. Fluorescence emission from DAPI was used as a reference (Figure 5A,B) to correct the blue, green, and red channels. The image comprises 3 channels of 60 Z slices, each composed of 256 x 256 pixels. The images were deconvolved before measuring the chromatic shifts. Measuring the local chromatic shifts using Chromagnon took 51 s on a Mac with Intel Core i7 (quad core, 8-threads, 2.7 GHz), 16 GB RAM and 1 TB flash storage. The alignment parameter was applied to the target image (Figure 5C,D), which has exactly the same number of voxels as the reference image. Preparing the aligned file took 3 s. As a result of trimming the edge pixels during the alignment process (crop margins checkbox in Figure 1C), the number of voxels was reduced after alignment (Figure 5B, 51 Z slices, 252 x 251 pixels). DNA in the anaphase bridge (indicated by arrowheads) is seen incorrectly outside of the nuclear envelope before alignment (Figure 5C, obvious in the bottom panel showing the XZ view), but as expected inside the envelope after alignment (Figure 5D).
An example of chromatic shift correction using a biological calibration reference image is shown in Figure 6. The images were obtained with a SIM microscope equipped with three cameras. Three images of HeLa cells stained with phalloidins conjugated to blue, green, and red dyes were averaged (Figure 6A). The reference image comprises 3 channels of 76 Z slices, each composed of 1,024 x 1,024 pixels. Measuring chromatic shifts using Chromagnon without local alignment required 194 s on the Mac system described above. The parameter was applied to a target image consisting of 3 channels of 73 Z slices, each composed of 1,024 x 1,024 pixels. Generation of the aligned file took 25 s. The XZ view shows incorrect channel positions along the Z, and slightly along the X directions (Figure 6A,C) but this misregistration was corrected after alignment (Figure 6B,D).
Figure 5: An example of alignment with a crosstalk reference image. HeLa cells were stained with DAPI for DNA (shown in magenta), Alexa Fluor 488 (shown in yellow) for nuclear envelope, and Alexa Fluor 555 (shown in blue) for microtubules. Images were acquired by 3D wide-field microscopy with a single camera and deconvolved. (A,B) A representative crosstalk reference image using DAPI emission, before and after alignment by Chromagnon. Three color channels are shown as overlaid. (C,D) An optical section of the 3D stack in three channels before and after alignment. Axial chromatic aberration is obvious at the anaphase bridge shown by arrowheads. Scale bar in panel A indicates 5 µm for all panels. Please click here to view a larger version of this figure.
Figure 6: An example of alignment with a biological calibration reference image Images were acquired with 3D-SIM equipped with three cameras. (A,B) A reference image averaged from three images before (A) and after (B) alignment. HeLa cells were stained with phalloidin conjugated with Alexa Fluor 405, 488 or 594. (C,D) The target image before (C) and after (D) alignment. HeLa cells were stained with DAPI for DNA (shown in magenta), Alexa Fluor 488 (shown in yellow) for nuclear envelope, and Alexa Fluor 594 (shown in blue) for microtubules. Scale bar in panel A indicates 5 µm for all panels. Please click here to view a larger version of this figure.
The procedure for chromatic correction is a trade-off between accuracy and effort. To save needless efforts, it is better to know how much accuracy is required for your study. The highest accuracy may not be required for conventional wide-field (live) imaging, and thus, bright field reference images are often sufficient to correct the chromatic shift. Similarly, when the imaging condition and environment is constant, repeated use of a biological calibration will save time. On the other hand, if a highly accurate registration is desired, high-quality crosstalk or biological calibration reference images are necessary. For the best performance, reference images should be obtained with as similar conditions and timings as the target images as possible. As long as both reference and target images are obtained by the same microscopy, higher spatial resolution will improve the correction accuracy. If deconvolution is available for both reference and target images, then implementing this before correction may improve the correction accuracy. Also, for the best performance, the sampling theorem for the optical (Z) axis should be fulfilled in both the reference and target file for precise subpixel interpolation (protocol step 2.1.3).
Failure to correct chromatic shift leads to incorrect conclusions. Furthermore, using the wrong calibration may even worsen the chromatic shifts rather than correcting them, and this therefore needs to be avoided. We have summarized the possible causes of failures, and their common solutions, in Table 2. To examine the cause of a failure, in the first place, it is necessary to visually check if the chromatic shift in the reference image is precisely corrected (protocol step 3.12). Most failures are due to the quality of the reference images and are easily remedied as per the descriptions in Table 2. Regarding to the quality of reference images, it is important to note that the accuracy of global alignment decreases if the entire field of view is not filled with the sample (Figure 7, Table 2). Compared to the good example shown in Figure 7A, the bad example shown in Figure 7B contains only three nuclear envelopes in the upper-left region, and Chromagnon failed to align a part of this image. This is because the global alignment method of Chromagnon splits the field of view into four regions (Figure 7C) in order to measure the differences in rotation and magnification with high accuracy3. This method, if correctly operated, is one order more accurate than other linear methods such as the log polar transformation and simplex methods3. If any of the four regions are unavailable, then Chromagnon will switch to less effective linear methods. Therefore, for the best performance, the examples shown in Figure 7B and Figure 7C are undesirable, and the four regions should be filled with objects. Users can check if any quadratic region of the field of view is unavailable for measurement by looking at the log file ("Chromagnon.log"; see protocol step 3.10). Fortunately, this problem can be easily overcome by averaging multiple biological calibration images or using local alignment for crosstalk or bright-field reference images (Table 2). Contrary to the case of failure to correct reference images, failure to correct target images is more difficult to identify. Because such failures arise due to differences in file formats, imaging conditions, imaging timings, imaging/alignment methods between the reference and target images (Table 2), users should always be careful when using reference images that are obtained in different conditions/timings from the target images. Some example images are available for testing (https://github.com/macronucleus/Chromagnon) to obtain concrete idea of the good and bad example images.
Problem | Cause | Solution |
Failed to correct the reference image | Low contrast | Acquire a higher contrast image if possible. If a bright-field reference image is used, reacquire the image in a water-based solution to obtain higher contrast of the cell. Alternatively, try applying computational noise reduction (e.g. Gaussian filtering). Turn off local alignment, which is more sensitive to noise. |
Contamination of unrelated images | Remove the source of the unrelated images in the sample if possible. For crosstalk reference images, check the excitation spectra of the dyes used for the target images. If the dyes are excited during acquisition of a crosstalk image (e.g. Alexa Fluor 568 or 594), consider other dyes (e.g. Alexa Fluor 555). If dusts on the camera chip creates an obvious channel difference, clean the camera chip or use a computational flat-fielding method. | |
An extremely bright spot made by a cosmic ray | Acquire the image again if possible. Alternatively, try applying computational noise reduction (e.g. Median or Gaussian filtering). | |
Deconvolution artifacts (artificial signals at the axial and lateral edges) | Trim the edge pixels or Z sections after deconvolution. If one side is trimmed, the other side should also be trimmed to maintain the image center. | |
The Z step size too sparse | A Z stack should be acquired to fulfill the Nyquist criterion as written in protocol 2.1.3. | |
Optical aberration | Spherical aberration is the major aberration caused by users. Choose the right objective lens for the sample and use a coverslip thickness of 170 µm. If the objective lens is equipped with a correction ring, adjust it to find the position where the highest fluorescence count is obtained from the focus. In the case of an oil-immersion objective without a correction ring, adjust the refractive index of the immersion oil that increases the fluorescence count at the focus. | |
Field of view is unfilled (Fig. 7) | In the case of biological calibration reference images, average many images. In the case of crosstalk or bright-field reference images, use local alignment. | |
An unidentified software bug | Report the issue through GitHub (https://github.com/macronucleus/Chromagnon/issues) | |
Failed to correct the target image | Metadata of the image file is lost | Use the original microscope file format which contains complete metadata, and avoid converting to a multipage tiff file before processing. Use the same ordering of channels as written in protocol 3.3. |
Wrong alignment methods for the given microscopy | Do not apply the local alignment method when measuring from biological calibration reference images to target images. Do not use crosstalk reference images other than wide-field microscopy. | |
Differences in imaging conditions | Keep the imaging conditions constant between the reference and the target images as written in protocol 2.3.3. | |
Differences in sample (including coverslip) | Always use the same mounting medium, coverslip (e.g. No. 1.5H) and a similar depth of focus. | |
Microscope drift since the calibration was last made | Make a calibration as often as every two weeks. Keep the temperature constant, and use a floating table to avoid hardware drift of the microscope. |
Table 2: Troubleshooting for chromatic correction.
Figure 7: Examples of reference images. Nuclear envelope in fission yeast cells labeled with GFP and mCherry. Images were acquired with conventional wide-field microscopy. Chromatic shifts were corrected using Chromagnon without local alignment using the images themselves as reference images. Images were then deconvolved to show the details. (A) A good example with many objects in the field of view. (B) A bad example with objects only at the top-left corner. Misalignment is obvious at a certain region of the image. (C) An undesirable example where one of the quadrisection (separated by dotted cross lines) is empty. Scale bar in panel A indicates 5 µm for the full field view and 1.25 µm for the enlarged view and is applicable to all panels. Please click here to view a larger version of this figure.
In this protocol, we described three different reference types (Table 1). Among them, crosstalk reference images and biological calibration reference images need further careful discussion. For crosstalk reference images, samples stained with DAPI or Hoechst 33342, and mounted in glycerol or commercial mounting media can be efficiently used to align the blue, green, and red channels. Similarly, Alexa Fluor 488 can be used to align the green and red channels. However, obtaining crosstalk fluorescence is often difficult since many blue dyes except DAPI and Hoechst are dimmer and decay faster than most green and red dyes. Furthermore, the emission spectra of modern dyes are narrower, which makes the alignment of more than three channels by this method challenging. Attention should also be paid to some common red dyes (e.g., Alexa Flour 568 and 594, but not Alexa Fluor 555) that can be excited by violet light, which prevent obtaining high-contrast crosstalk images from blue dyes. Another drawback is that this method cannot measure the chromatic aberration of excitation light paths in multicolor excitation, because only a single excitation wavelength is used for excitation (Table 1). As most advanced microscopy uses altered illumination optics, the application of this method is limited. Still, its higher correction accuracy is sufficiently advantageous for it to be described in this protocol. In general, a crosstalk image should be taken after a target image to prevent bleaching or phototoxic effects. For SMLM observed with the wide-field mode, a reference image should be acquired before acquiring a target image as fluorescence dyes can be bleached while imaging.
Biological calibration reference images allow users to easily align any desired number of channels at the cost of additional sample preparation. Another advantage of biological calibration reference images is the availability of "averaging" multiple references that helps fill all fields of view. This method may suffer from differences in imaging conditions if the calibration sample is prepared on a different slide. Most of this problem can be solved if both targets and references are prepared on the same slide by using commercial chambered coverglasses (Table 1), and other imaging conditions are kept constant as in protocol step 2.3.3. In this case, a correction accuracy similar to that of crosstalk reference images can be expected3. The protocol to use phalloidin as shown here is one of the easiest ways to stain a single cellular structure with multiple colors. There are numerous possible scenarios to prepare biological calibration samples. For immunostaining, a sample can be labeled with a single primary antibody followed by staining with secondary antibodies of multiple colors. In this way, a single target structure can be labeled with multiple colors. Alternatively, 5-ethynyl-2'-deoxyuridine, detected by "click" chemistry labels newly synthesized DNA in multiple colors at high density, as described in detail previously8. For live cells, it is useful to prepare a transgenic strain harboring two copies of a gene that are fused to GFP or mCherry to label the same structure with two colors. If the copy number of the gene is critical as often observed for membrane proteins, a single copy of the gene can be tandemly fused to GFP and mCherry (Figure 7). Photoconvertible fluorescent proteins, such as mEOS218, can also be used by illuminating a moderate level of violet light to obtain both protein species with or without photoconversion. Under low oxygen conditions, GFP can also be used as a photoconvertible protein from green to red19,20. Choosing the right calibration sample will thus make the experiment more robust.
The authors have nothing to disclose.
This study was supported by JSPS KAKENHI Grant Numbers JP19H03202 to A.M., JP18H05528 and JP17H03636 to T.H., and JP17H01444 and JP18H05533 to H.Y. L.S. acknowledges the support by the Welcome Trust Strategic Awards 091911 and 107457/Z/15/Z funding advanced imaging at Micron Oxford.
16% formaldehyde solution | Polyscience | 18814-10 | |
35 mm glass-bottom dish | MatTek | P35G-1.5-10-C | |
Alexa Fluor 405 phalloidin | Thermo Fisher Scientific | A30104 | |
Alexa Fluor 488 phalloidin | Thermo Fisher Scientific | A12379 | |
Alexa Fluor 594 phalloidin | Thermo Fisher Scientific | A12381 | |
Bovine Serum | Thermo Fisher Scientific | 16170078 | |
Coverslip | Matsunami | No. 1S HT | |
DAPI (4',6-Diamidino-2-Phenylindole, Dihydrochloride) | Thermo Fisher Scientific | D1306 | |
Dulbecco’s Modified Eagle Medium with L-Gln and sodium pyruvate | Nacalai Tesque | 08458-16 | |
Mounting medium (VECTASHIELD) | Vector Laboratories | H-1000 | |
Mouse anti-tubulin monoclonal antibody (TAT1) | Described in Ref 15. | ||
Nunc Lab-Tek II chambered coverglass (8 well) | Thermo Fisher Scientific | 155409 | |
Rabbit anti-emerin polyclonal antibody (ED1) | A gift from Hiroshi Yorifuji, Gunma University, Gunma, Japan and Kiichi Arahata, National Center of Neurology and Psychiatry, Tokyo, Japan; deceased. | ||
Secondary antibody with Alexa Fluor 488 | Thermo Fisher Scientific | A-11034 | |
Secondary antibody with Alexa Fluor 555 | Thermo Fisher Scientific | A-21424 | |
Secondary antibody with Alexa Fluor 594 | Thermo Fisher Scientific | A-11032 | |
TetraSpeck Microspheres, 0.2 µm | Thermo Fisher Scientific | T7280 |