Copyright ©The Histochemical Society, Inc.

Quantification of Viability in Organotypic Multicellular Spheroids of Human Malignant Glioma using Lactate Dehydrogenase Activity : A Rapid and Reliable Automated Assay

Philip C. De Witt Hamer, Ard Jonker, Sieger Leenstra, Jan M. Ruijter and Cornelis J.F. Van Noorden

Departments of Neurosurgery (PCDWH,SL), Cell Biology and Histology (AJ,CJFVN), and Anatomy and Embryology (JMR), Academic Medical Centre, University of Amsterdam, Amsterdam, The Netherlands

Correspondence to: Philip C. De Witt Hamer, MD, Academic Medical Centre, University of Amsterdam, Dept. of Neurosurgery, Room H2-230, PO Box 22660, 1100 DD Amsterdam, The Netherlands. E-mail: P.C.deWittHamer{at}amc.nl


    Summary
 Top
 Summary
 Introduction
 Materials and Methods
 Results
 Discussion
 Literature Cited
 
Organotypic spheroids from malignant glioma resemble the biological complexity of the original tumor and are therefore appealing to study anticancer drug responses. Accurate and reproducible quantification of response effect has been lacking to determine drug responses in this three-dimensional tumor model. Lactate dehydrogenase (LDH) activity was demonstrated in cryostat sections of spheroids using the tetrazolium salt method. Calibrated digital image acquisition of the stained cryostat sections enables quantification of LDH activity. Fully automated image cytometry reliably demarcates LDH-active and LDH-inactive tissue areas by thresholding at specific absorbance values. The viability index (VI) was calculated as ratio of LDH-active areas and total spheroid tissue areas. Duplicate staining and processing on the same tissue showed good correlation and therefore reproducibility. Sodium azide incubation of spheroids induced reduction in VI to almost zero. We conclude that quantification of viability in cryostat sections of organotypic multicellular spheroids from malignant glioma can be performed reliably and reproducibly with this approach. (J Histochem Cytochem 53:23–34, 2005)

Key Words: spheroids • glioma • lactate dehydrogenase • enzyme histochemistry • metabolic activity • toxicity test • biological assay • drug screening assays • image cytometry • cryostat sections


    Introduction
 Top
 Summary
 Introduction
 Materials and Methods
 Results
 Discussion
 Literature Cited
 
MALIGNANT GLIOMA [anaplastic astrocytoma, WHO grade 3 (AA) or glioblastoma multiforme, WHO grade 4 (GBM)] is a devastating primary CNS tumor with a median patient survival of 10 and 18 months, respectively, despite standard treatment consisting of gross total surgical resection and radiotherapy (Gupta and Sarin 2002Go; Laws et al. 2003Go). Effective treatment strategies are notoriously lacking. Therefore, screening of novel anticancer agents is of primary importance. Signal transduction modifiers have recently extended the list of potential agents, in addition to conventional cytostatics, angiogenesis inhibitors, immunotherapy, and endotoxins (Brandes et al. 2001Go; Basso et al. 2002Go; Hanash et al. 2002Go; Reddy and Kaelin 2002Go; Tremont-Lukats and Gilbert 2003Go).

Screening of cytostatic drugs is commonly carried out with the use of monolayer cell cultures. Apparent advantages of these tumor models are ease of culture and availability of assays that enable quantification of drug response effects. However, new agents with promising effects in these in vitro models repeatedly fail to be efficacious in patients (Wolff et al. 1999Go). Perhaps the biological behavior of human malignant glioma is not portrayed by monolayer cell cultures, and efforts toward development of a more complex biological model are worthwhile.

The organotypic multicellular spheroid (OMS) model retains the heterogeneity of the original tumor tissue in addition to the presence of extracellular matrix, vascular elements, and cell–cell interactions (Sutherland 1988Go; Hamilton 1998Go; Bates et al. 2000Go; Oudar 2000Go). A technique to culture OMSs has been specified for human malignant glioma (Bjerkvig et al. 1990Go). Fragmented surgical specimens are cultured in medium and closely resemble the original malignant glioma tissue histologically and morphologically, including glial fibrillary associated protein (GFAP) positivity, confirming the glial origin (Bjerkvig et al. 1990Go; Kaaijk et al. 1995Go). Quantification of drug responses in OMSs has been hampered by the heterogeneous character of the OMSs and their three-dimensional structure. To quantify drug response effects in the OMS model, we first introduce a viability score [the ratio of the lactic dehydrogenase (LDH)-active tissue area and total tissue area] and, second, present an image cytometry process that is automated for high-throughput facilitation. The activity of LDH (EC 1.1.1.27) is histochemically determined by reduction of a tetrazolium salt to its formazan, which delineates viable tissue in cryostat sections of OMSs as shown in the present study. Subsequent image cytometry with calibrated absorbance measurements of formazan production enables calculation of a viability index (VI).

This anaerobic glycolytic enzyme was considered as a viability marker for four reasons: (a) stained LDH-active and LDH-inactive tissue areas contrast sharply, allowing accurate discrimination using image cytometry; (b) established techniques also based on reduction of tetrazolium salt are in use for determination of experimental myocardial and hepatic infarction size (Frederiks et al. 1984Go,1989Go) and routine verification of human myocardial infarction at autopsy (Lie et al. 1975Go; Fishbein et al. 1981Go); (c) the technique has analogy with established cytotoxicity response assays using the same concept for monolayer cell cultures (LDH release and MTT assays) (Korzeniewski and Callewaert 1983Go; Decker and Lohmann-Matthes 1988Go; Legrand et al. 1992Go; Allen et al. 1994Go; Sepp et al. 1996Go; Hand et al. 1998Go); (d) LDH is abundantly present in human malignant glioma tissue (Egami et al. 1983Go; Fujii et al. 1984Go; Marzatico et al. 1986Go; Subhash et al. 1993Go; Oudard et al. 1996Go).

Here we present the reliability and reproducibility of an automated quantification method using LDH activity as a marker for viability in cryostat sections of OMSs.


    Materials and Methods
 Top
 Summary
 Introduction
 Materials and Methods
 Results
 Discussion
 Literature Cited
 
Suppliers of Resources
Dulbecco's modified Eagle's medium was supplied by ICN Biochemicals (Aurora, OH) and normal human serum by BioWhittaker (Walkersville, MD). L-Glutamine, penicillin, and streptomycin were supplied by Gibco Invitrogen (Breda, The Netherlands). Agarose and gelatin were supplied by Sigma (St Louis, MO). Corning Life Sciences (Schiphol, The Netherlands) supplied the Costar 48-well culture plates.

Potassium dihydrogen phosphate, disodium hydrogen phosphate, sodium azide, and dimethylformamide were supplied by Merck (Darmstadt, Germany). Polyvinyl alcohol (average molecular weight 70,000–100,000) and nitroblue tetrazolium were supplied by Sigma. Sodium L-lactate and 1-methoxyphenazine methosulfate (mPMS) were supplied by Serva (Heidelberg, Germany). NAD was supplied by Roche Diagnostics (Mannheim, Germany).

Organotypic Multicellular Spheroids in Culture
Tumor specimens obtained at surgery from patients with malignant glioma were fragmented with number 10 and number 15 lancets and transferred to 48-well plates containing minimal essential medium as previously described (Bjerkvig et al. 1990Go), with slight modifications.

Minimal essential medium consists of Dulbecco's modified Eagle's medium with 10% heat-inactivated normal human serum, 2% L-glutamine, penicillin (100 IU/ml), and streptomycin (100 µg/ml). Each well was coated with 100 µl 50% medium containing agarose to avoid cell adhesion and 300 µl medium overlay was added. Tumor fragments were cultured in a SteriCult 200 tissue culture incubator (CleanAir; Woerden, The Netherlands) at 37C, 100% humidity, 95% air, and 5% CO2. After 1 week, tumor fragments that had evolved to OMSs were manually selected using a phase-contrast microscope. This is the empirically found shortest time in culture for development of fragments to OMSs. The manual selection was based on spherical morphology, cell shedding, and transparency. Figure 1A illustrates a typical fragment meeting these requirements, and Figure 1B shows a typical fragment that disintegrated to a flock of debris that is not suitable for further analysis. The fraction of OMSs that evolved from initial fragments was 65–78% [150 from 192 fragments for one tumor from a 74-year-old woman with a GBM (internal reference no. A26); 62 from 96 fragments for another tumor from a 47-year-old man with a GBM (A27)]. OMSs were then cultured for another week after medium overlay replacement with a Pasteur's pipette until harvesting for analysis. The OMSs stabilized in volume and had a mean diameter (SD) of 923 (213) µm.



View larger version (100K):
[in this window]
[in a new window]
 
Figure 1

Phase-contrast micrograph of (A) a glioma spheroid that has evolved from a fragment of a surgical specimen after 1 week in culture, and (B) a fragment of a surgical specimen that does not meet the requirements of a spheroid as specified in Materials and Methods. Bar = 500 µm.

 
Gelatin Embedding and Cryosectioning
After harvesting, OMSs were embedded in plastic containers (20 x 30 mm) containing a liquefied solution of 8% gelatin at 37C in 100 mM phosphate buffer (pH 7.45). Gelatin embedding resulted in a better quality of the sections compared with various other embedding agents tested (data not shown). Multiple OMSs were embedded in one gelatin unit to incorporate OMSs from a 48-well plate all together. The unit was then snap-frozen in liquid nitrogen and stored at –80C until cryostat sectioning. Sectioning was carried out on a Jung Frigocut 2800-E cryostat (Leica Microsystems; Bannockburn, IL) using disposable knives at a cabinet temperature of –22C to cut sections of 8-µm thickness.

Histochemistry of LDH Activity
Tetrazolium salt methods are established precipitation reactions for the localization of the activity of dehydrogenases. Enzyme-catalyzed oxidation of the substrate lactate by LDH releases protons that are picked up by the co-enzyme NAD. The reduced co-enzyme reduces an electron carrier (mPMS), which transfers the electrons directly to the tetrazolium salt as electron acceptor to generate formazan. Formazan is formed as a dark purple water-insoluble precipitate. LDH is a dehydrogenase whose activity can be determined by this histochemical technique (Van Noorden and Frederiks 1992Go).

The incubation medium consisted of 18% polyvinyl alcohol dissolved in 100 mM phosphate buffer (pH 7.45) containing sodium L-lactate (150 mM), NAD (3 mM), mPMS (0.32 mM), sodium azide (5 mM), and tetra nitroblue tetrazolium (5 mg/ml medium first dissolved in 20 µl ethanol and 20 µl dimethylformamide solution; final dilution of each solvent in the medium 2%). We used tetra nitroblue tetrazolium because it produces the finest formazan precipitate of all tetrazolium salts and thus increases detail (Van Noorden and Frederiks 1992Go). Slides with unfixed cryostat sections attached were adapted to room temperature and air dried for 10 min. Afterward, incubation was performed using 1 ml of incubation medium per slide. The reaction was aborted using 100 mM phosphate buffer (pH 5.3) at 70C for 15 min to stop the reaction promptly and rinse off all viscous incubation medium (Van Noorden and Frederiks 1992Go). Serial sections were stained with HE. Sections were dehydrated using standard ethanol and xylol dilution series and mounted in Pertex (HistoLab Products; Goeteborg, Sweden) to be coverslipped.

Kinetic Measurements of LDH Activity
End point measurements were designed to allow maximal contrast between LDH-active and LDH-inactive tissue compartments. Kinetic measurements of LDH activity were used to determine differences in absorbance values between LDH-active and LDH-inactive tissue compartments over time at RT and 37C [OMS of a 63-year-old man with a GBM with gemistocytary characteristics (A18)]. Control incubations were performed (on serial sections of the same OMSs) omitting the substrate lactate from the incubation medium (Van Noorden and Vogels 1989bGo).

Digital Image Acquisition
Video microscopy was accomplished with a CCD video camera (high performance CCD, model 4910; Cohu, San Diego, CA) mounted on a light microscope (Vanox AH-2; Olympus, Tokyo, Japan). The image acquisition setup and calibration have previously been described (Jonker et al. 1997Go). A monochromatic filter of the isobestic wavelength of the half-formazan and formazan (550 nm) was used (Van Noorden and Frederiks 1992Go). Images of OMS sections after LDH activity staining were acquired with a x6.3/0.16 microscope magnification objective and frames were grabbed with the CCD video camera in 8-bit images of 786 x 512 pixels. Digital images were calibrated for absorbance measurements with a 10-step absorbance reference strip (Eastman Kodak; Rochester, NY) and pixels were scaled to µm. Acquired images were archived and processed on a Macintosh computer (Cupertino, CA) with a customized macro in the public domain software application Object-Image v2.09 (Norbert O.E. Vischer; University of Amsterdam, Faculty of Science, Amsterdam, The Netherlands; available at http://simon.bio.uva.nl/object-image.html).

Image Cytometry to Determine the Viability Index
Viability of tissue in an OMS section was calculated as ratio of the area (in µm2) expressing an absorbance value compatible with LDH-active tissue and the area (in µm2) expressing an absorbance value compatible with both LDH-active and LDH-inactive tissue. This ratio specifies the VI for a section ‘j’ of an OMS ‘i’:

(eq.1)

The VI is a ratio ranging from 0 to 1. A VI of 0.00 represents a minimally viable OMS section, whereas a VI of 1.00 represents a maximally viable OMS section.

Two absorbance thresholds are required to discriminate between absence of tissue, LDH-inactive tissue, and LDH-active tissue. The absorbance thresholds were resolved by correlating contours of LDH-active tissue and LDH-inactive tissue in serial sections of OMSs after conventional HE staining and histochemical localization of LDH activity. Conventional HE staining is generally considered to be the standard for determination of viable tissue in OMS sections. Absorbance thresholds were established on the basis of 40 OMS sections in three separately calibrated acquisition sessions [tumor material from a 47-year-old man with a GBM (A27)]. Average absorbance values (± SD) for the thresholds were determined to be 0.10 (± 0.03) for the value discriminating between absence of tissue and LDH-inactive tissue and 0.40 (± 0.10) for discrimination between LDH-inactive and LDH-active tissue.

Image Procressing Algorithm
OMS sections usually show an outer rim with reduced LDH activity. This phenomenon is considered to be an artifact produced by embedding or cutting. This artifact obviously results in an underestimation of the VI. To exclude the artifactual rim from calculations of the VI, an image processing algorithm was implemented.

The concept of the image processing algorithm is based on the construction of a new OMS section contour to which VI calculations are limited. The new contour is created by shrinking the original OMS section contour to the size of the most frequently occurring distance between the original OMS section rim and LDH-active tissue.

The elementary processing steps are schematically drawn in Figure 2. An example of the algorithm applied to an OMS section is outlined in Figure 3.



View larger version (28K):
[in this window]
[in a new window]
 
Figure 2

Schematic illustration of the fully automated image processing algorithm to determine the viability index (VI) in organotypic multicellular glioma spheroids (OMS) on the basis of LDH activity. (A) OMS section with a dark gray LDH-active tissue area and a light gray LDH-inactive tissue area. The artifactual rim that is to be excluded surrounds the LDH-active and LDH-inactive tissue areas. Three elements (1–3) illustrate algorithm handling of contour finding problems: (1) an LDH-active tissue area not surrounded by the artifactual rim, (2) an LDH-inactive tissue area surrounded by LDH-active tissue, and (3) an LDH-inactive tissue area bordering the artifactual rim. (B) The lower absorbance threshold value determines the entire OMS section contour as shown in yellow. (C) The upper absorbance threshold value determines the LDH-active tissue contours as shown in green. (D) The closest distance to LDH-active tissue is determined for every point of the rim of the entire OMS section. (E) The most frequently observed distance is determined (to preserve LDH-inactive tissue area bordering the artifactual rim that is to be included in VI calculations) and applied to determine the adjusted OMS section contour as shown in red. (F) The adjusted contour in E is combined with the LDH-active tissue contour in C to include the incorrectly excluded LDH-active tissue area not surrounded by the artifactual rim. The adjusted contour in F is used as an overlay for the original image A. (G) The numerator in the VI calculation is provided by the surface measurement after application of the upper absorbance threshold. (H) The denominator in the VI calculation is provided by the surface measurement after application of the lower absorbance threshold.

 


View larger version (49K):
[in this window]
[in a new window]
 
Figure 3

Rim exclusion algorithm to determine the viability index (VI) in glioma OMSs on the basis of LDH activity. (A) Original 8-bit 400 x 400 pixel image acquired by a CCD video camera coupled to a light microscope with a monochromatic filter. (B) Binary image after thresholding for LDH-active tissue with high absorbance threshold. (C) Binary image after thresholding for LDH-active and LDH-inactive tissue with low absorbance threshold. (D) One-pixel-wide contour of Figure 3C after filling in the interior holes. (E) The inverted binary image of Figure 3B is distance-transformed to an image map with the 8-bit gray scale value specifying the closest distance in pixels to LDH-active tissue for each pixel. (F) The result image of Figure 3E combined with Figure 3D as mask, showing the shortest distance of outer rim pixels to LDH-active tissue. (G) Histogram of Figure 3F showing distribution of distances of outer rim pixels to LDH-active area; note that the most frequently occurring distance is 11 pixels (red bar). (H) The most frequently occurring distance value 11 is located in red on a distance-transformed image map of Figure 3C. For illustration purposes, the contour Figure 3D is also shown. (I) A threshold of the modal distance applied to the distance-transformed map inside the entire OMS section constructs a new outer contour. (J) Combined image of Figure 3B and 3I showing that LDH-active tissue containing information required for the VI calculations is located outside the new contour. Consequently, the LDH-active tissue area (Figure 3B) is added to the new contour (Figure 3I). (K) Result of application of the contour of Figure 3J as mask for the original image in Figure 3A with LDH activity information. (L) Outlines of original outer contour (yellow), new outer contour (red), and LDH-active area (green) plotted on the original image in Figure 3A. The VI calculated on the basis of the rim-exclusion algorithm was 0.68. Bar = 250 µm.

 
To demonstrate the impact of this rim exclusion algorithm on the total tissue area measurement, an algorithm impact (AI) on total tissue area was calculated for each OMS section (n=4136) of 64 OMSs from two tumors [from a 47-year-old man with a GBM (A27) and a 74-year-old woman with a GBM (A26)] as:

(eq.2)

The original total tissue area is the sum of LDH-active and LDH-inactive tissue areas before application of the rim exclusion algorithm, and the new total tissue area is the area remaining after application of the rim exclusion algorithm.

Reliability of the Histochemical VI Analysis
The reliability of demonstration of viability by LDH activity in serial cryostat sections of OMSs was verified in relation to conventional assessment of viable vs nonviable tissue on HE-stained cryostat sections. These were compared with the outlines as determined by the automated cytometry contours after histochemical visualization of LDH activity.

Reproducibility of the VI
For any histochemical technique with application of automated cytometry analysis, perception of its reproducibility is required. Several sources of variation need to be considered, such as cryostat settings, preparation of chemicals, incubation medium, incubation period, image acquisition settings, and cytometric analysis. To test the robustness of all sources of variation after sectioning, the incubation to localize LDH activity, image acquisition and cytometric analysis were repeated on two separate samples of serial OMS sections for 32 OMSs from one tumor [from a 37-year-old woman with a GBM with a significant sarcomatous component (A15)]. Each sample consisted of an average of 5.5 (SD 1.5) sections per OMS. The VI for an OMS ‘i’ was calculated from K sections as:

(eq.3)

The correlation between the two sets of 32 VI estimates was analyzed with a scatter diagram and the Pearson's correlation coefficient.

Detection of Viability Reduction by the VI
The VI for OMSs is expected to detect treatment response in terms of reduction in viability. Therefore, an unequivocal viability-reducing stimulus should induce a substantial reduction in the VI. Sodium azide inhibits the oxidative phosphorylation in mitochondria (Smith et al. 1991Go; Smith and Wilcox 1994Go; Chang and Lamm 2003Go). This metabolic uncoupling results in acute cytotoxicity to both normal and malignant cells and provides a means to test the detection of viability reduction. For this experiment, 64 OMSs were produced from two tumors [from a 47-year-old man with a GBM (A27) and a 74-year-old woman with a GBM (A26)]. These OMSs were used as untreated controls and the VIs were determined according to eq. 3. These measurements were compared with the VIs of 8 OMSs produced from another tumor [from a 41-year-old man with an AA dedifferentiated from low-grade astrocytoma (WHO grade 2) who had received temozolomide before surgery (A30)]. OMSs were incubated in the presence of 10 mM sodium azide in culture medium for 1 week before snap-freezing and analysis.

Because of the non-normal distribution, a Kruskal-Wallis test was performed to test differences of the three VI group means.


    Results
 Top
 Summary
 Introduction
 Materials and Methods
 Results
 Discussion
 Literature Cited
 
Kinetic Measurements of LDH Activity
Reaction curves describing formazan precipitation due to LDH activity in LDH-active tissue increase nonlinearly in time (Figure 4A) as described previously (Van Noorden and Vogels 1989aGo). The LDH-inactive tissue reaction curve is linear with time. On the basis of these kinetic measurements, we concluded that the maximal contrast between LDH-active and LDH-inactive tissue was obtained after 30 min of incubation at RT. Although the contrast may have increased further beyond 30 min, this incubation period was applied for end-point measurements to refrain from absorbance values above 0.8 to avoid the out-of-range error (Van Noorden and Butcher 1986Go). Reaction curves at 37C (data not shown) showed a rapid increase in absorbance over time, which we considered to be disadvantageous because incubation intervals that are too short may introduce a source of variation from timing error. Control reactions in the absence of lactate, i.e., the "nothing dehydrogenase" reaction (Van Noorden et al. 1985Go; Frederiks et al. 1989Go), showed a complete lack of formazan formation, indicating that endogenous substrate levels were very low. Some nonspecific formazan formation was observed in media containing lactate and NAD, and this was subtracted from all test reactions (Figure 4B).



View larger version (13K):
[in this window]
[in a new window]
 
Figure 4

Time-dependent increase in absorbance values of formazan produced by LDH activity at RT in sections of human glioma spheroids. (A) Reaction curves for circular regions of interest (size 200 µm2) containing (•) LDH-active tissue, ({blacktriangledown}) LDH-inactive tissue, ({blacksquare}) no tissue, i.e., object glass background ({triangledown}{square}{circ}) and respective control reactions without lactate. (B) Kinetic curves for (•) LDH-active tissue minus control reaction, and ({blacktriangledown}) LDH-inactive tissue minus control reaction. Maximal difference between the absorbance values is observed 30 min after incubation.

 
Reliability of the Histochemical VI Analysis
The comparison between tissue appearance using conventional HE-stained sections of OMSs, OMS sections stained for LDH activity, and digital images with contours for LDH-active and LDH-inactive tissue areas provided by automated image cytometry is illustrated in Figure 5. OMSs shown are either predominantly LDH-active (Figures 5A–5C) or harbor complex alternations of LDH-active and LDH-inactive tissue areas (Figures 5D–5I), or are predominantly LDH-inactive (Figures 5J–5L). Although the tissue was sectioned in a cryostat, the morphology of the tissue sections is sufficiently maintained and major cutting artifacts can usually be avoided. When the HE-stained sections are compared with the LDH activity-stained sections, it is evident that LDH-active and LDH-inactive tissue areas contrast sharply after LDH activity staining. Viable and nonviable tissue areas in HE-stained OMS sections appeared difficult to determine on the basis of morphological aspects, such as the center of the OMS section in Figure 5A (located with *). This area shows marked LDH activity, which unambiguously ascertains viability of this tissue area (Figure 5B). Comparison of the LDH activity-stained sections with the digital images indicated that the reliability of the contour finding cytometry is manifest. Even complex contours of the LDH-inactive tissue areas in Figures 5E and 5H are detected correctly. The value of the rim exclusion algorithm can be appreciated from the way the LDH-inactive tissue area bordering the artifactual rim is handled in Figure 5K. The red line in Figure 5L outlines the OMS section contour that was used for the VI calculation after application of the rim exclusion algorithm. The large LDH-inactive tissue area is included in the OMS section enclosed by the red line. Furthermore, the mean AI (SD) for the analyzed sections all together was 23% (17%). In addition to this, decreasing VIs of tissue sections in Figures 5C, 5F, 5I, and 5L reflect the decreasing extent of LDH-active tissue areas in the successive OMS sections. Based on these observations, we conclude that, first, localization of LDH activity reliably separates LDH-active and LDH-inactive tissue areas. Second, these areas can be automatically segmented by image cytometry independently of the complexity of the tissue areas. Third, the impact of the rim exclusion algorithm is nontrivial, and fourth, the viability can be adequately quantified using the VI.



View larger version (95K):
[in this window]
[in a new window]
 
Figure 5

Sections of human glioma spheroids with various appearances of LDH-active and LDH-inactive tissue after HE staining (A,D,G,J), histochemical localization of LDH activity (B,E,H,K), and after digital image acquisition and cytometric processing with outlines that color the entire spheroid contour (yellow), the adjusted contour resulting from the rim exclusion algorithm (red) and LDH-active tissue contours (green). Marker (*) locates tissue area that was difficult to interpret as either viable or nonviable in HE-stained section on the basis of morphological aspects. The VI is 0.98 in C, 0.78 in both F and I and 0.29 in L. Bars = 250 µm.

 
Reproducibility of the VI
According to the scatter diagram (Figure 6), the entire procedure of histochemical localization of LDH activity, digital image acquisition and cytometric analysis to determine the VI are reproducible (Pearson's correlation coefficient 0.935; p<0.01).



View larger version (11K):
[in this window]
[in a new window]
 
Figure 6

Scatter diagram of viability indices in two serial sets of the same 32 spheroids with histochemical detection of LDH activity, image acquisition, and cytometric analysis in separate sessions. Each dot depicts values obtained from an average of 5.5 (SD 1.5) sections of a spheroid. Pearson's correlation coefficient 0.935; p<0.01.

 
Detection of Viability Reduction by the VI
The frequency plot of untreated and sodium azide-treated samples is shown in Figure 7. These data highlight the detection of the cytotoxic effects of sodium azide by the VI. In fact, four of eight treated OMSs express a VI less than 0.02.



View larger version (12K):
[in this window]
[in a new window]
 
Figure 7

Frequency plot of viability indices for untreated spheroids from two tumors (n=32 for each) and sodium azide-treated spheroids (10 mM in culture medium for 1 week) from one tumor (n=8). Each dot represents one spheroid. The horizontal lines determine the average VI per spheroid group. Kruskal-Wallis {chi}-square of 22.8, d.f. 2, and p<0.001.

 
A number of interesting details arise from this frequency plot. First, the two untreated OMS groups have closely similar average VIs (0.72 vs 0.79) and distributions. Second, some overlap is observed in VI extremes for treated and untreated OMSs. On the one hand, there are respectively two and three OMSs with a VI less than 0.50 in the two untreated samples. Closer inspection indicated that the sections involved were correctly stained and processed to determine VIs. LDH activity levels and morphological aspects after HE staining were in agreement with LDH-inactive tissue with low viability. These specific OMSs harbor reduced levels of LDH activity, presumably due to spontaneous necrosis. On the other hand, a single outlier with a VI of 0.48 was found in the sodium azide-treated OMS group. This outlier contributes considerably to the average VI of 0.09 for sodium azide-treated OMSs. Again, closer inspection of the sections indicated that staining and processing to determine the VI appeared to be correct. Perhaps this OMS was less dependent on oxidative phosphorylation for its metabolic needs by having switched to anaerobic glycolysis and, as a consequence, became less susceptible to the toxic effects of sodium azide.

The Kruskal-Wallis test shows a {chi}-square of 22.8, d.f. 2, and p<0.001. This high significance is interpreted as strong statistical evidence for unequality of the three means. This effect is attributed to the significantly reduced VI in the sodium azide group. This finding of reduced VI after sodium azide treatment provides proof of principle for the validity of the VI to detect treatment response in OMSs.


    Discussion
 Top
 Summary
 Introduction
 Materials and Methods
 Results
 Discussion
 Literature Cited
 
This report describes the quantification of viability in cryostat sections of organotypic multicellular spheroids (OMSs) from human malignant glioma on the basis of LDH activity using image cytometry.

This focus on the OMS tumor model to study the behavior of human malignant glioma is our answer to the multitude of treatment strategies that arise rapidly and demand a suitable model for screening of their potential. The ideal tumor model for this purpose would be a system that is rapid in providing results in the short term, valid with respect to the original responsiveness of tumors, efficient, and allows analysis of multiple aspects of tumor biology. On the one hand, it is obvious that assessment of the anticancer potential of an unselected panel of promising novel agents in malignant glioma patients, although highly biologically valid, is slow, inefficient, and ethically unacceptable. On the other hand, initial drug screening in malignant glioma research is generally based on observations with monolayer cell line cultures that allow rapid and efficient high-throughput analysis. However, the discrepancy between results obtained in these basic culture systems and human glioma responses is probably due to shortcomings in the validity of representation of human glioma biology by monolayer cell cultures (Wolff et al. 1999Go). The more complex three-dimensional OMS tumor model may provide a biological system that more closely represents the human glioma responsiveness because of the native presence of extracellular matrix structures, vascular elements, and cell–cell interactions (Sutherland 1988Go; Kaaijk et al. 1995Go; Hamilton 1998Go; Kunz-Schughart et al. 1998Go; Bates et al. 2000Go; Mueller-Klieser 2000Go; Santini et al. 2000Go).

However, a test to evaluate drug responsiveness is required for the OMS tumor model that under the best circumstances is rapid, accurate in terms of quantifiability, reproducible, based on transparent principles, takes advantage of the spatial information available from the three-dimensional structure, and allows multiple comparative analysis of different aspects of tumor responses in the same tissue material. Other approaches to quantify responsiveness in OMS models are in use, including growth in diameter (Bjerkvig et al. 1990Go; Jung et al. 1991Go; Chignola et al. 1994Go,1995Go; Weber et al. 1994Go), cell adhesion and migration assays (Bjerkvig et al. 1997Go; Narla et al. 1998Go; Ohnishi et al. 1998Go; Mahesparan et al. 1999Go; Santini et al. 2000Go; de Ridder et al. 2000Go), chemical dissociation to provide cell suspensions that are amenable to conventional monoclonal cell culture cytotoxicity assays (Freyer and Sutherland 1980Go; Freyer and Schor 1989Go), confocal laser scanning microscopy after fluorescence probing (Wartenberg and Acker 1995Go; Wartenberg et al. 1998Go; Walenta et al. 2000Go), and immunohistochemical detection of proliferation and apoptosis markers (Kaaijk et al. 1996Go,1997Go; Kolchinsky and Roninson 1997Go; Wharton et al. 2000Go; Bell et al. 2001Go).

Before weighing the merits of these approaches, it is of importance to discern two categories of tumor spheroids. In the first place, there are multicellular aggregated spheroids that evolved from monolayer cell cultures by aggregation and, in the second place, there are OMSs with an architecture native to the surgical specimens from which they are grown. The latter OMSs stabilize in volume over time (Bjerkvig et al. 1990Go; Kaaijk et al. 1995Go) and are not susceptible to chemical dissociation (unpublished data from our laboratory) in contrast to the aggregated spheroids. Although these dissociative characteristics provide an opportunity for quantification of drug responsiveness in aggregated spheroids, the biological behavior of these aggregated spheroids is, again, probably affected by clonal selection and by deficiency of extracellular matrix and vascular elements.

Poor penetration of fluorescence probes in OMSs [up to ~60 µm from the margin (unpublished data)] impedes confocal laser scanning microscopy. Hence, immunohistochemical detection of cell proliferation and apoptosis markers is the only approach that provides spatial information and allows the serial analysis of multiple parameters in the same material. However, IHC markers are characterized by the fact that they provide information on one specific protein, which may be expressed only transiently. Therefore, a more general end point was pursued to determine the balance between cell proliferation and (programmed) cell death, which is of primary concern in the malignant glioma patient. One end point meeting this requirement is metabolic activity of cells, also referred to as viability. Here we show that tissue viability can be assessed in OMSs in analogy to various tetrazolium salt reduction assays available for cell cultures, and in essence provides an in situ application of the MTT assay. Quantification of LDH release from dying cells is an established approach to assessment of drug responsiveness in other tumor models based on diffusion of LDH from cells with a leaky plasma membrane, which is an early event in cell death (Frederiks et al. 1983Go, 1995Go; Korzeniewski and Callewaert 1983Go; Decker and Lohmann-Matthes 1988Go; Legrand et al. 1992Go; Allen et al. 1994Go; Sepp et al. 1996Go). Many commercially available kits provide colorimetric detection of dehydrogenase activity either indirectly by LDH released in the supernatant from the cytosol of dying cells [i.e., Cytotoxicity Detection Kit (LDH), Roche Applied Science; LDH Cytotoxicity Detection Kit, MoBiTec; TOX7-1KT, Sigma Aldrich] or directly by demonstration of dehydrogenase activity in viable cells [i.e., Cell Proliferation Kit I (MTT), II (XTT), III (WST1), Roche Applied Science; MTT Cell Proliferation Assay, ATCC (Rockville, MD); Cell Proliferation Assay Kit, Chemicon (Temecula, CA)]. Subsequent quantification can be accomplished by colorimetry of the supernatant in an ELISA plate reader for cell culture suspensions.

In the present study, localization of LDH activity in cryostat sections of OMSs is described as a tumor-responsiveness test. This test provides an assay that is rapid, accurate in quantification, reproducible, transparent by being founded on generally established concepts of tissue viability, enables the use of spatial information, and is available for further analysis of other aspects of tumor responsiveness in serial sections from the same tissue material. Furthermore, an example of sodium azide responsiveness has provided proof of principle for the validity of the VI to detect a cytotoxic response in OMSs.

Some issues remain to be resolved, however, before relevant results can be provided with this OMS tumor model and the LDH activity assay. In the first place, LDH-inactive tissue is interpreted as nonviable tissue based on the rationale that viable cells contain LDH and therefore that absence of LDH in tissue is in accordance with absence of viable cells. Nevertheless, the LDH-inactive tissue areas do not entirely consist of necrosis, according to preliminary analysis (unpublished data). Apparently, part of the LDH-inactive tissue stains positive for picrosirius red, indicating collageneous elements of the extracellular matrix. Other parts stain positive for vimentin IX, indicating vascular elements. In the second place, another important issue is whether the OMS model proves to be sufficiently biologically valid. The superior validity of the OMS model compared with the monolayer cell culture has only been theoretically deduced. In the third place, the outliers in VI in untreated and sodium azide-treated samples illustrate the need to compensate for the heterogeneity of OMSs by inclusion of multiple samples in a treatment group. Apparently, eight OMSs sufficed for statistical analysis in the sodium azide experiment. In general, the consequence of heterogeneity of tumor tissue needs to be addressed for a tumor model to be efficient. Crucial to this point are the minimal numbers of OMSs in a treatment group and the minimal numbers of cryostat sections per OMS required (given a predetermined biologically relevant detectable difference in VI, power, and significance level). These issues need to be addressed for this tumor model in succeeding studies.

We conclude that the viability of OMSs can be quantified in a rapid, reliable, and reproducible way using localization of LDH activity in cryostat sections with automated image cytometric analysis. This is an important advance towards relevant drug screening in this human malignant glioma tumor model.


    Acknowledgments
 
Our gratitude is expressed to Professor Dr D. Troost, head of the Department of Neuropathology, for his contribution to interpretation of the HE-stained sections of OMSs, and to Ing P.J. van Amstel, head of the research laboratory of the Department of Pathology, for facilitation of the culture incubators and reagents.

We also wish to thank K.S. Bosch and W.M. Frederiks, PhD, from the Department of Cell Biology and Histology, for their contribution to the enzyme histochemical laboratory protocols and facilities.

Support with the software development provided by N.O.E. Vischer, PhD, software engineer at the Faculty of Biology, is kindly appreciated.


    Footnotes
 
Received for publication February 27, 2004; accepted August 10, 2004


    Literature Cited
 Top
 Summary
 Introduction
 Materials and Methods
 Results
 Discussion
 Literature Cited
 

Allen M, Millett P, Dawes E, Rushton N (1994) Lactate dehydrogenase activity as a rapid and sensitive test for the quantification of cell numbers in vitro. Clin Mater 16:189–194[Medline]

Basso U, Ermani M, Vastola F, Brandes AA (2002) Non-cytotoxic therapies for malignant gliomas. J Neurooncol 58:57–69[CrossRef][Medline]

Bates RC, Edwards NS, Yates JD (2000) Spheroids and cell survival. Crit Rev Oncol Hematol 36:61–74[Medline]

Bell HS, Whittle IR, Walker M, Leaver HA, Wharton SB (2001) The development of necrosis and apoptosis in glioma: experimental findings using spheroid culture systems. Neuropathol Appl Neurobiol 27:291–304[CrossRef][Medline]

Bjerkvig R, Lund-Johansen M, Edvardsen K (1997) Tumor cell invasion and angiogenesis in the central nervous system. Curr Opin Oncol 9:223–229[Medline]

Bjerkvig R, Tonnesen A, Laerum OD, Backlund EO (1990) Multicellular tumor spheroids from human gliomas maintained in organ culture. J Neurosurg 72:463–475[Medline]

Brandes AA, Basso U, Pasetto LM, Ermani M (2001) New strategy developments in brain tumor therapy. Curr Pharm Res 7:1553–1580

Chang S, Lamm SH (2003) Human health effects of sodium azide exposure: a literature review and analysis. Int J Toxicol 22:175–186[CrossRef][Medline]

Chignola R, Foroni R, Candiani C, Franceschi A, Pasti M, Stevanoni G, Anselmi C, et al. (1994) Cytoreductive effects of anti-transferrin receptor immunotoxin in a multicellular tumor spheroid model. Int J Cancer 57:268–274[Medline]

Chignola R, Foroni R, Franceschi A, Pasti M, Candiani C, Anselmi C, Fracasso G, et al. (1995) Heterogeneous response of individual multicellular tumour spheroids to immunotoxins and ricin toxin. Br J Cancer 72:607–614[Medline]

Decker T, Lohmann-Matthes ML (1988) A quick and simple method for the quantitation of lactate dehydrogenase release in measurements of cellular cytotoxicity and tumor necrosis factor (TNF) activity. J Immunol Methods 115:61–69[CrossRef][Medline]

de Ridder L, Cornelissen M, de Ridder D (2000) Autologous spheroid culture: a screening tool for human brain tumour invasion. Crit Rev Oncol Hematol 36:107–122[Medline]

Egami H, Takeshita I, Fukui M, Kitamura K (1983) Supernumerary lactate dehydrogenase isozymes in human gliomas. J Neurol Sci 61:1–12[CrossRef][Medline]

Fishbein MC, Meerbaum S, Rit J, Lando U, Kanmatsuse K, Mercier JC, Corday E, et al. (1981) Early phase acute myocardial infarct size quantification: validation of the triphenyl tetrazolium chloride tissue enzyme staining technique. Am Heart J 101:593–600[Medline]

Frederiks WM, Fronik GM, Hesseling JM (1984) A method for quantitative analysis of the extent of necrosis in ischemic rat liver. Exp Mol Pathol 41:119–125[CrossRef][Medline]

Frederiks WM, Marx F, Myagkaya GL (1989) The ‘nothing dehydrogenase’ reaction and the detection of ischaemic damage. Histochem J 21:565–573[Medline]

Frederiks WM, Myagkaya GL, Bosch KS, Fronik GM, van Veen H, Vogels IM, James J (1983) The value of enzyme leakage for the prediction of necrosis in liver ischemia. Histochemistry 78:459–472[CrossRef][Medline]

Frederiks WM, Tukkie R, Grundeman PF, Hoebe C, Schellens JP (1995) Combined enzyme histochemical and ultrastructural study on cryostat sections of pig heart to detect early reperfusion damage after ischaemia. J Pathol 175:339–348[Medline]

Freyer JP, Schor PL (1989) Automated selective dissociation of cells from different regions of multicellular spheroids. In Vitro Cell Dev Biol 25:9–19[Medline]

Freyer JP, Sutherland RM (1980) Selective dissociation and characterization of cells from different regions of multicell tumor spheroids. Cancer Res 40:3956–3965[Abstract]

Fujii M, Nishikawa A, Tanaka T, Mori H, Takahashi M, Sakai N, Yamada H (1984) Cytochemical changes in lactate dehydrogenase isoenzymes in human brain tumours. Acta Neurochir (Wien) 71:243–253[Medline]

Gupta T, Sarin R (2002) Poor-prognosis high-grade gliomas: evolving an evidence-based standard of care. Lancet Oncol 3:557–564[CrossRef][Medline]

Hamilton G (1998) Multicellular spheroids as an in vitro tumor model. Cancer Lett 131:29–34[CrossRef][Medline]

Hanash SM, Bobek MP, Rickman DS, Williams T, Rouillard JM, Kuick R, Puravs E (2002) Integrating cancer genomics and proteomics in the post-genome era. Proteomics 2:69–75[CrossRef][Medline]

Hand CM, Vender JR, Black P (1998) Chemotherapy in experimental brain tumor, part 1: in vitro colorimetric MTT assay. J Neurooncol 36:1–6[CrossRef][Medline]

Jonker A, Geerts WJ, Chieco P, Moorman AF, Lamers WH, Van Noorden CJ (1997) Basic strategies for valid cytometry using image analysis. Histochem J 29:347–364[CrossRef][Medline]

Jung HW, Berens ME, Krouwer HG, Rosenblum ML (1991) A three-dimensional micro-organ culture system optimized for in vitro growth of human malignant brain tumors. Neurosurgery 29:390–398[CrossRef][Medline]

Kaaijk P, Troost D, Das PK, Leenstra S, Bosch DA (1995) Long-term culture of organotypic multicellular glioma spheroids: a good culture model for studying gliomas. Neuropathol Appl Neurobiol 21:386–391[Medline]

Kaaijk P, Troost D, de Boer OJ, Van Amstel P, Bakker PJ, Leenstra S, Bosch DA (1996) Daunorubicin and doxorubicin but not BCNU have deleterious effects on organotypic multicellular spheroids of gliomas. Br J Cancer 74:187–193[Medline]

Kaaijk P, Troost D, Sminia P, Hulshof MC, van der Kracht AH, Leenstra S, Bosch DA (1997) Hypofractionated radiation induces a decrease in cell proliferation but no histological damage to organotypic multicellular spheroids of human glioblastomas. Eur J Cancer 33:645–651[CrossRef][Medline]

Kolchinsky A, Roninson IB (1997) Drug resistance conferred by MDR1 expression in spheroids formed by glioblastoma cell lines. Anticancer Res 17:3321–3327[Medline]

Korzeniewski C, Callewaert DM (1983) An enzyme-release assay for natural cytotoxicity. J Immunol Methods 64:313–320[CrossRef][Medline]

Kunz-Schughart LA, Kreutz M, Knuechel R (1998) Multicellular spheroids: a three-dimensional in vitro culture system to study tumour biology. Int J Exp Pathol 79:1–23[CrossRef][Medline]

Laws ER, Parney IF, Huang W, Anderson F, Morris AM, Asher A, Lillehei KO, et al. (2003) Survival following surgery and prognostic factors for recently diagnosed malignant glioma: data from the Glioma Outcomes Project. J Neurosurg 99:467–473[Medline]

Legrand C, Bour JM, Jacob C, Capiaumont J, Martial A, Marc A, Wudtke M, et al. (1992) Lactate dehydrogenase (LDH) activity of the cultured eukaryotic cells as marker of the number of dead cells in the medium. [Published erratum appears in J Biotechnol 1993 Nov;31(2):234] J Biotechnol 25:231–243[CrossRef][Medline]

Lie JT, Pairolero PC, Holley KE, Titus JL (1975) Macroscopic enzyme-mapping verification of large, homogeneous, experimental myocardial infarcts of predictable size and location in dogs. J Thorac Cardiovasc Surg 69:599–605[Abstract]

Mahesparan R, Tysnes BB, Read TA, Enger PO, Bjerkvig R, Lund-Johansen M (1999) Extracellular matrix-induced cell migration from glioblastoma biopsy specimens in vitro. Acta Neuropathol (Berl) 97:231–239[CrossRef][Medline]

Marzatico F, Curti D, Dagani F, Silvani V, Gaetani P, Butti G, Knerich R (1986) Enzymes related to energy metabolism in human gliomas. J Neurosurg Sci 30:129–132[Medline]

Mueller-Klieser W (2000) Tumor biology and experimental therapeutics. Crit Rev Oncol Hematol 36:123–139[Medline]

Narla RK, Liu XP, Klis D, Uckun FM (1998) Inhibition of human glioblastoma cell adhesion and invasion by 4-(4'-hydroxylphenyl)-amino-6,7-dimethoxyquinazoline (WHI-P131) and 4-(3'-bromo-4'-hydroxylphenyl)-amino-6,7-dimethoxyquinazoline (WHI-P154). Clin Cancer Res 4:2463–2471[Abstract]

Ohnishi T, Matsumura H, Izumoto S, Hiraga S, Hayakawa T (1998) A novel model of glioma cell invasion using organotypic brain slice culture. Cancer Res 58:2935–2940[Abstract]

Oudar O (2000) Spheroids: relation between tumour and endothelial cells. Crit Rev Oncol Hematol 36:99–106[Medline]

Oudard S, Arvelo F, Miccoli L, Apiou F, Dutrillaux AM, Poisson M, Dutrillaux B, et al. (1996) High glycolysis in gliomas despite low hexokinase transcription and activity correlated to chromosome 10 loss. Br J Cancer 74:839–845[Medline]

Reddy A, Kaelin WG Jr (2002) Using cancer genetics to guide the selection of anticancer drug targets. Curr Opin Pharmacol 2:366–373[CrossRef][Medline]

Santini MT, Rainaldi G, Indovina PL (2000) Apoptosis, cell adhesion and the extracellular matrix in the three-dimensional growth of multicellular tumor spheroids. Crit Rev Oncol Hematol 36:75–87[Medline]

Sepp A, Binns RM, Lechler RI (1996) Improved protocol for colorimetric detection of complement-mediated cytotoxicity based on the measurement of cytoplasmic lactate dehydrogenase activity. J Immunol Methods 196:175–180[CrossRef][Medline]

Smith RP, Louis CA, Kruszyna R, Kruszyna H (1991) Acute neurotoxicity of sodium azide and nitric oxide. Fundam Appl Toxicol 17:120–127[CrossRef][Medline]

Smith RP, Wilcox DE (1994) Toxicology of selected nitric oxide-donating xenobiotics, with particular reference to azide. Crit Rev Toxicol 24:355–377[Medline]

Subhash MN, Rao BS, Shankar SK (1993) Changes in lactate dehydrogenase isoenzyme pattern in patients with tumors of the central nervous system. Neurochem Int 22:121–124[CrossRef][Medline]

Sutherland RM (1988) Cell and environment interactions in tumor microregions: the multicell spheroid model. Science 240:177–184[Medline]

Tremont-Lukats IW, Gilbert MR (2003) Advances in molecular therapies in patients with brain tumors. Cancer Control 10:125–137[Medline]

Van Noorden CJ, Butcher RG (1986) The out-of-range error in microdensitometry. Histochem J 18:397–398[Medline]

Van Noorden CJ, Frederiks WM (1992) Enzyme Histochemistry: A Laboratory Manual of Current Methods. Oxford, Oxford University Press

Van Noorden CJ, Kooij A, Vogels IM, Frederiks WM (1985) On the nature of the ‘nothing dehydrogenase’ reaction. Histochem J 17:1111–1118[Medline]

Van Noorden CJ, Vogels IM (1989a) Cytophotometric analysis of reaction rates of succinate and lactate dehydrogenase activity in rat liver, heart muscle and tracheal epithelium. Histochem J 21:575–583[Medline]

Van Noorden CJ, Vogels IM (1989b) Polyvinyl alcohol and other tissue protectants in enzyme histochemistry: a consumer's guide. Histochem J 21:373–379[Medline]

Walenta S, Doetsch J, Mueller-Klieser W, Kunz-Schughart LA (2000) Metabolic imaging in multicellular spheroids of oncogene-transfected fibroblasts. J Histochem Cytochem 48:509–522[Abstract/Free Full Text]

Wartenberg M, Acker H (1995) Quantitative recording of vitality patterns in living multicellular spheroids by confocal microscopy. Micron 26:395–404[CrossRef][Medline]

Wartenberg M, Hescheler J, Acker H, Diedershagen H, Sauer H (1998) Doxorubicin distribution in multicellular prostate cancer spheroids evaluated by confocal laser scanning microscopy and the "optical probe technique". Cytometry 31:137–145[CrossRef][Medline]

Weber F, Kremer C, Klinkhammer M, Rasier B, Brock M (1994) Response of multicellular tumor spheroids to liposomes containing TNF-alpha. J Neurooncol 18:217–224[Medline]

Wharton SB, McNelis U, Bell HS, Whittle IR (2000) Expression of poly(ADP-ribose) polymerase and distribution of poly(ADP-ribosyl)ation in glioblastoma and in a glioma multicellular tumour spheroid model. Neuropathol Appl Neurobiol 26:528–535[CrossRef][Medline]

Wolff JE, Trilling T, Molenkamp G, Egeler RM, Jurgens H (1999) Chemosensitivity of glioma cells in vitro: a meta analysis. J Cancer Res Clin Oncol 125:481–486[CrossRef][Medline]





This Article
Abstract
Full Text (PDF)
Alert me when this article is cited
Alert me if a correction is posted
Citation Map
Services
Similar articles in this journal
Similar articles in PubMed
Alert me to new issues of the journal
Download to citation manager
Google Scholar
Articles by De Witt Hamer, P. C.
Articles by Van Noorden, C. J.F.
Articles citing this Article
PubMed
PubMed Citation
Articles by De Witt Hamer, P. C.
Articles by Van Noorden, C. J.F.


Home Help [Feedback] [For Subscribers] [Archive] [Search] [Contents]