Assessing the efficacy of molecularly targeted agents on cell line-based platforms by using system identification
© Li et al.; licensee BioMed Central Ltd. 2012
Published: 26 October 2012
Skip to main content
© Li et al.; licensee BioMed Central Ltd. 2012
Published: 26 October 2012
Molecularly targeted agents (MTAs) are increasingly used for cancer treatment, the goal being to improve the efficacy and selectivity of cancer treatment by developing agents that block the growth of cancer cells by interfering with specific targeted molecules needed for carcinogenesis and tumor growth. This approach differs from traditional cytotoxic anticancer drugs. The lack of specificity of cytotoxic drugs allows a relatively straightforward approach in preclinical and clinical studies, where the optimal dose has usually been defined as the "maximum tolerated dose" (MTD). This toxicity-based dosing approach is founded on the assumption that the therapeutic anticancer effect and toxic effects of the drug increase in parallel as the dose is escalated. On the contrary, most MTAs are expected to be more selective and less toxic than cytotoxic drugs. Consequently, the maximum therapeutic effect may be achieved at a "biologically effective dose" (BED) well below the MTD. Hence, dosing study for MTAs should be different from cytotoxic drugs. Enhanced efforts to molecularly characterize the drug efficacy for MTAs in preclinical models will be valuable for successfully designing dosing regimens for clinical trials.
A novel preclinical model combining experimental methods and theoretical analysis is proposed to investigate the mechanism of action and identify pharmacodynamic characteristics of the drug. Instead of fixed time point analysis of the drug exposure to drug effect, the time course of drug effect for different doses is quantitatively studied on cell line-based platforms using system identification, where tumor cells' responses to drugs through the use of fluorescent reporters are sampled over a time course. Results show that drug effect is time-varying and higher dosages induce faster and stronger responses as expected. However, the drug efficacy change along different dosages is not linear; on the contrary, there exist certain thresholds. This kind of preclinical study can provide valuable suggestions about dosing regimens for the in vivo experimental stage to increase productivity.
Drug development is currently an expensive and prolonged process with high attrition rate. The rate of new drug approvals in the U. S. has remained essentially constant since 1950, while the costs of drug development have soared . Industry analysts estimate that it takes $1 billion to $4 billion in R&D and 10-15 years for every new drug brought to market [1–3]. In aggregate, the industrial average rate of attrition measured from first trials in humans to registration seems to be locked at ~85-90% [4, 5]. The situation in oncology drug development is even worse [3, 6, 7]. By contrast, the overall clinical success rate for new anticancer agents (~5%) is much lower than other therapeutic areas (e.g. success rate for cardiovascular diseases is ~20%) . As a result, the American Cancer Society's 2005 statistical report shows that cancer is now the leading cause of death for Americans under age 85 . One common explanation for the recent shrinking of oncology drug pipelines is that discovery is moving into more complex areas of human health [10, 11], such as cancer, which is more likely to result from the interaction of several different genes/pathways [12, 13]. The conundrum confronting the cancer research community is twofold: first, the pharmaceutical industry is facing difficult times owing to low productivity and spiraling cost ; second, on consumers front, patients await better treatments and cancer drugs are an unaffordable luxury for many consumers . To move ahead, scientists realize that they need some fresh thinking in basic, translational and clinical research  to improve R&D productivity and reduce attrition rates, and such efforts calls for joint collaboration from different disciplines [5, 16–20].
The focus of anticancer drug development in recent years has shifted from cytotoxic drugs to targeted therapy [16, 19, 21–23]. The goal of this target-based approach is to improve the efficacy and selectivity of cancer treatment by developing agents that block the growth of cancer cells by interfering with specific targeted molecules needed for carcinogenesis and tumor growth [21, 22]. This approach is different from traditional cytotoxic anticancer drugs, where most compounds are targeted against molecules required for the maintenance of structural and genetic integrity of rapidly dividing cells. However, despite advances in understanding of the molecular mechanisms of cancer, the promise of targeted cancer therapy remains largely unfulfilled [8, 24], with only a few well-known examples, such as imatinib  and trastuzumab , currently approved . Many promising candidates prove ineffective or toxic owing to a poor understanding of the molecular mechanisms of biological systems they target. Different reasons have been proposed to explain this limited effectiveness of anticancer drug development, including insufficient translational research and lack of adequate preclinical models that recapitulate disease complexity and molecular heterogeneity [8, 16, 28, 29]. Ideally, preclinical models should validate the target, provide information about the mechanism of action of the drug, and identify pharmacodynamic markers of activity. Once the target and mechanism of action have been identified using in vitro models, experiments should be undertaken to ensure that inhibition of the target can be achieved at tolerated doses in vivo and to identify possible biomarkers of response. Improved preclinical evaluation of compounds has the potential to augment the detection of activity and toxicity, and to reduce the high attrition rate.
While the lack of specificity of the traditional cytotoxic anticancer agents allows a relatively straightforward, well-established approach, developing a paradigm to better analyze the efficacy of molecularly targeted agents (MTAs) is substantially more complex [18, 22, 30–32]. Many targets are involved in cell signaling pathways, which are most often not linear, but connected and redundant . Control strategies typically involve a higher multiplicity of inputs and a multiple layer of feedback . As a result, strategies traditionally applied to the development of cytotoxic drugs may not be appropriate for MTAs . Current treatment plan and efficacy evaluations are usually designed empirically for MTAs, without adequate knowledge of the optimal dose and the appropriate schedule . A novel preclinical model combining experimental methods and theoretical analysis is proposed in this study to investigate the mechanism of action and identify pharmacodynamic characteristics of the drug. It is expected that through such preclinical study, valuable suggestions about dosing regimens could be furnished for the in vivo experimental stage to increase productivity. We consider several challenges for MTA dosing.
Secondly, the pharmacodynamics (PD) of drugs have been extensively investigated in vitro and in vivo; however, most analyses have reported the relationship of drug exposure to drug effect at a fixed time point. When drug effect is examined at a fixed time point, the drug concentration-effect relationship can be characterized through well established models, such as the Hill equation , also called the sigmoidal E max model . However, characterization of the entire time course of drug effect may provide additional information . For example, it may help to design the optimal schedule for drug administration.
Thirdly, traditional design of the dosing regimen to achieve some desired target goal such as relatively constant serum concentration may not be optimal because MTA targets mostly sit in interacting complex dynamical regulatory networks and such complex target contexts pose significant challenges for assessing mechanisms of action for MTAs . For example, Shah and co-workers  demonstrate that the BCR-ABL inhibitor dasatinib, which has greater potency and a short half-life, can achieve deep clinical remission in CML patients by achieving transient potent BCR-ABL inhibition, while traditional approved tyrosine kinase inhibitors usually have prolonged half lives resulting in continuous target inhibition. A similar study of whether short pulses of higher dose or persistent dosing with lower doses have the most favorable outcomes has been carried out by Amin and co-workers in the setup of inactivation of HER2-HER3 signaling .
In sum, it is difficult and expensive to optimize dosing regimens using strictly empirical methods for MTAs. A novel preclinical model combining experimental methods and theoretical analysis is proposed in this study to investigate the mechanisms of action and identify pharmacodynamic characteristic of MTAs. As a first step, the time courses of drug effect for different doses are quantitatively studied on cell line-based platforms using system identification, where a tumor cell's response to investigational drugs through the use of fluorescent reporters is sampled frequently over a time course. A dynamic model is proposed to study the time course of drug efficacy for MTAs and then the experimental data are analyzed by our proposed model using a Kalman filter. Through such preclinical study, valuable suggestions about dosing regimens may be furnished for the in vivo experimental stage to increase productivity.
The proposed approach is an integration of experiment and theory to investigate regulatory process dynamics by combining multiple complementary disciplines, including: (i) using fluorescent reporters in molecular technology to study cells' transcriptional activities under drug perturbation; (ii) these being captured by an automatic epifluorescent microscope over a time course; and (iii) such data being processed by large-scale image processing for dynamic analysis. A truly multi-dimensional dynamics of tumor cell response to drugs can be characterized through systematic perturbations to test different combinations of cell types, reporters, and drugs/dosages, augmented by iterative systematic theoretical analysis. This methodology differs from high-throughput technique like RNA expression profiling with microarrays, which provide a snapshot of an aspect of the system at one time point.
Understanding cell response to a drug requires experimental designs that ask very specific questions about what is happening in a cell in the absence of a drug and how the cell activities change when the drug is present. The objective of the experimental protocol is to efficiently capture cell process dynamics in response to drugs and thereby obtain a deeper understanding of the genetic regulatory mechanisms, the point being to make preclinical research more predictive. Fluorescent reporters have long been used in molecular technology to study cells' transcriptional activities or the cellular localization of components, either in a population of cells or a single cell [40–42]. In this study, we track the transcriptional activities of particular genes. A fluorescent reporter to serve this purpose can be constructed by fusing the promoter region of a gene of interest with the coding sequence of a fluorescent protein, most commonly a green fluorescent protein (GFP). By delivering a single cassette bearing the promoter/GFP reporter into the genome of each cell in a population of cells, any change in the expression levels of the native coding sequence driven by that promoter will be reflected in the transcriptional activity of the cassette. This allows the estimation of the total fluorescence of the reporter in the cell, captured by imaging with an epifluorescent microscope, which is then used as a relative measure of the transcriptional activity of the native gene. Because this procedure is non-invasive to the cell, it allows tracking of the same cell population for an extended period of time by imaging the same site repeatedly. The recent introduction of automated digital microscopes allows researchers to use multi-well microtiter plates and sequentially capture the transcriptional activities in all wells. In our experimental protocol, a single assay is carried out by epifluorescent imaging of a site at the bottom of each well in a 384 well plate, producing an image of the cells in that region (~200-400 cells) bearing fluorescent reporters. The imaging speed of automated systems easily accommodates sampling an entire 384 well plate at hourly intervals. If needed, the experiment can be extended to multiple plates to cover a wider range of cell types and reporters.
In this experimental set-up, using different wells to test different combinations of cell type, GFP reporter and experimental condition allows this approach to provide a multi-dimensional examination of the cells' responses to a variety of stimuli. Not only can it follow multiple genes simultaneously, but it can also compare cellular activities under various conditions. Furthermore, it captures the dynamics of transcriptional regulation. This produces data on ~200-400 individual cells per well that can be analyzed both individually, as a distribution, or in aggregate, as an average. Fluorescent intensity data can be extracted from these images using specialized image analysis tools developed for this application . This image processing procedures include finding cells, identifying individual cells, and quantifying the fluorescence associated with each cell. The objective is to extract gene expression levels from the fluorescent image and track them over the time course. We approach this goal through morphology-based image processing methods.
The dosing study is carried out on the colon cancer cell-line HCT116 with a reporter for the MKI67 gene, a nuclear antigen tightly correlated with proliferation [46, 47], with responses to lapatinib treatment with 6 dosages (1 to 32 µM). First we infect the HCT116 cell lines with the desired packaged reporter (packaged as lentiviral particles). Then plate cells/reporter pair in a media containing a live-cell nuclear stain. The cells are allowed to attach to the plate and grow overnight. Drugs are added to the appropriate wells (we have 6 wells [biological duplicates] for each dosage). In order to remove environmental effects, such as growth factor depletion, there are 6 control wells for each dosage (no drug added, total 36 wells). We image the plate once an hour for 48 hours to characterize the response of each cell/reporter pair to the drug over time. Note that the fluorescence intensity of cells without a GFP reporter expressed is not zero, since cells have numerous small molecules which fluoresce in the same wavelengths as GFP when excited with 488 nm light. This defines the minimum fluorescence, which is approximately 214. One of the time courses from experiment (dosage = 8µM) is shown in Figure 2. The left panels of Figure 2 show two fluorescent images sampled for the same site in a 48 hour lapatinib treatment for 8 µM dosage. The right panels of Figure 2 show the log2(GFP) intensity histogram for each time point.
Since MKI67 is turned on during proliferation and off when the cells are not cycling, it is expected to show a binary, switch-like histogram of cell intensities, rather than a graded transition. This behavior is observed in Figure 2. We have the readout of the GFP intensity level for each individual cell/dosage pair with 48 time points. These can be compared with a threshold value to determine whether that cell is shifted or not [37, 43]. Such a reporter assay allows one to determine the dynamics of drug responses for different dosages. Consequently, we propose a time-varying model for the cell shifting process where the drug effect coefficient is assumed changing with time. This is in contrast to many existing approaches where the drug effect coefficient is treated as a constant and the experiment just provides one reading rather than time-series characterization.
The experimental results provide information on the percentage of cells shifted as a consequence of the drug activity. The measurements facilitate asking important questions in drug development. For instance, does dosing alter the extent of response, the timing of response, or both? In addition to qualitative questions, we are interested in modeling the drug effect quantitatively, which requires a novel mathematical model that is biologically sound and fits the experimental setup. Our experiments and the proposed modeling has two important features: (i) Our experiment is based on the readout of the intensity level of each individual cell, which is compared with a threshold value to determine whether that cell is shifted or not. Although we count the number of shifted cells at each sampling time point, the proposed model is not a population model merely giving the average readout of all the cells. (ii) Our experiment collects time-series data under drug perturbation for 48 hours, with one sample per hour. A time-varying model is proposed for the cell shifting process, where the drug effect coefficient is assumed changing with time.
Because there are different numbers of cells in different wells (the range is about ~200-400 cells per well), we perform normalization to calculate the percentage of cells shifted. Since there are many factors including drug effect that contribute to the cell shifting, calibration is performed by comparing to the control group to exclude other contributing factors. The notations used in this work are listed below
N: total number of cells
N 1(t): number of shifted cells at time t after applying drug
ρ 1(t) = N 1(t)/N: percentage of cells shifted at time t after applying drug
N c : total number of cells in the control group (no drug applied)
N 1c (t): number of shifted cells at time t in the control group
ρ 1c (t) = N 1c (t)/N c : percentage of cells shifted at time t in the control group
ρ(t) = ρ 1(t) − ρ 1c (t): calibrated percentage of cells shifted at time t after applying drug
ρ av (t) = E[ρ(t)]: mean of the calibrated percentage of cells shifted at time t after applying drug
X i (t): state of cell i at time t after applying drug (either shift-ready or not)
We justify N 1(t) being modeled as a Gaussian process when the number of cells per well is sufficiently large. Then a model is proposed for the cell shifting process, where the calibrated percentage of shifted cells follows a Gaussian process.
When the number of cells per well is large, say N > 100, the PMF of N 1 at any given time instant can be accurately approximated by the Gaussian distribution due to the central limit theorem. Next we show that N 1(t) is a Gaussian process.
Proposition 1. The random process N 1(t) is approximately Gaussian when the number of cells per well is large.
If N − N 1(t j −1) is sufficiently large, N − N 1(t j −1) > 32, then ΔN 1(t j ) is well approximated by a Gaussian random variable. Since N 1(t 0) is Gaussian, N 1(t j ) is Gaussian as well by mathematical induction. □
where is the drug effective coefficient depending on the dosage d, and β > 0 is a balancing factor. ρ av (t) changes along time since the corresponding random process ρ(t) is non-stationary, thus its mean changes with time. Specifically, the change of ρ av (t) follows a linear differential equation (Eq.(5)) that reflects the fact that the change would be positively affected by the product of drug effectiveness and the percentage of cells not shifted (1st term in Eq.(5)), and negatively affected by the percentage of cells already shifted (2nd term in Eq.(5)), thus the term "balancing factor" for β since more shifted cells mean less non-shifted cells that the drug may affect.
The noise terms account for the various uncertainties introduced by the experiment. For instance, the cells may not be at the same cell cycle during the experiments, and thus may not be affected by the drug if some of the cells are actually dormant. This kind of uncertainties are modeled by process noise µ. There also exists another type of uncertainty due to measurement procedures, such as the imperfect photographic device and the image processing software. This type of uncertainty is modeled by measurement noise ν.
To observe the relationship between the drug effect coefficient and the dosage d, we need to estimate for each dosage. Since this is a time-varying model, changes with time.
where the 2-dimensional state vector (containing the parameters to be estimated) is . δ can be calculated as . .
where K(n) is the Kalman filter gain and P is the covariance matrix of the error. The superscripts - and + indicate the a priori and a posteriori values of the variables, respectively. and are the prior and posterior estimates, respectively. Q and R are the covariance matrices of the parameter noise and external noise, respectively. The initial conditions are and .
In general, a Kalman filter may be interpreted as a one-step predictor with an appropriate gain calculator . Specifically, Eq.(10) is the one-step predictor, Eq.(11) calculates the Kalman filter gain, and Eq.(12) solves the corresponding Riccati equation.
Convergence of the Kalman filter is an important issue . The rate of convergence is defined as the number of iterations to obtain the optimum estimates. The convergence of the Kalman filter includes the convergence of the estimates and the convergence of the estimation error e(n). Convergence will be studied in detail in the simulations.
In practice, noise statistics (such as the covariance matrices) may not be known and need to be estimated. The Kalman filter is sensitive to the estimation error of noise statistics. Poor estimates of the noise covariance can result in filter divergence. An alternative would be using an H ∞ filter [50, 51].
Two-step analysis is performed to evaluate the drug effect study for different dosages. Firstly, we performed a proof-of-concept experiment using Monte Carlo simulation to demonstrate that the proposed model can mimic experimental observation. Secondly, we analyzed the time-varying drug effect for different dosages based on real experimental data from Dr. Bittner's lab at Translational Genomics Research Institution (TGen).
It is observed from Figure 5 that in general the drug effect coefficient increases with the applied dosage, as expected. It seems that there exist certain thresholds for . For instance, is much bigger with the dosages above 8µM. It is also observed that increases with time as well. This reveals the time varying nature of the drug effect. Furthermore, Figure 5 shows that higher dosage corresponds to faster response time, e.g., increases earlier and faster for higher dosage starting at ~10 hour. It is worth pointing out that, ideally, the percentage of shifted cells should be more than that in the control group without drug input, i.e., 0 ≤ ρ(t) ≤ 1. However, due to uncertainties and noise in the experiments, we actually observe that ρ(t) may be negative, especially during the first ~10 hours, before the drug is in effect.
Unlike , it is observed in Figure 6 that β remains roughly flat along time for a given dosage, because β is the balancing factor and should not change with time. However, β is different for different applied dosage, since higher dosage requires a higher balancing factor to maintain stability of the system. Again, the uncertainties and noise may dominate the system during the first ~10 hours (before the drug is in effect).
The ultimate goal of target-based cancer drug development is to improve the efficacy and selectivity of cancer treatment by exploiting the differences between cancer cells and normal cells. The current cancer drug development process is confronting huge challenges, such as how to better understand the target in context and develop predictive preclinical models to better understand the molecular mechanisms of the biological systems they target and hence reduce the attrition rate. An integrated experimental and theoretical approach is proposed to assess the efficacy of molecularly targeted agents based on cell-line platforms. As a first step, drug efficacies for different dosages are characterized along time. Specifically, tumor cell's responses are analyzed through the use of fluorescent reporters sampled frequently over a time course; quantification is done by microscopic scanning of cells in culture in multi-well plates using the automated epifluorescent imager; fluorescent intensity data are extracted from these images using specialized large-scale image analysis tools developed for this application; the dynamics of drug efficacy for different dosages are studied using dynamic modeling; and time-varying parameters are estimated using system identification techniques. It is observed that the drug efficacy is time and dosage dependent. The objectives are two-fold: (i) The dosing study for MTAs should be based on both efficacy and toxicity consideration to find the biologically effective dose (BED) instead of the maximum tolerated dose (MTD) for cytotoxic agents. The time course of drug effect for different dosages can provide information on the gradient of drug effect vs. dosage, and thus on the BED. (ii) Instead of a fixed time point pharmacodynamics study of MTA, characterization of the entire time course of drug effect provides insight into designing an optimal schedule for drug administration.
Based on a similar experimental set-up and measurements to follow the cell/drug (dosages) dynamics, a truly multi-dimensional dynamics of tumor cell responses to drugs can be characterized through systematic perturbations to test different combinations of cell types, reporters, and drugs/dosages, augmented by iterative systematic theoretical analysis. Such an approach would facilitate the study of optimal dose and schedule, such as whether short pulses of higher dose, persistent dosing with lower dose, or some other regimen would have the most favorable outcomes. Moreover, the complex target context can be inferred with multi-dimensional cell response dynamics with the help of advanced system identification methods. In sum, better intervention strategies can be designed. Such topics are either currently being pursued or will be in future projects.
Based on “Assessing the efficacy of molecularly targeted agents by using Kalman filter”, by Xiangfang Li, Lijun Qian, Michael L Bittner and Edward R Dougherty which appeared in Genomic Signal Processing and Statistics (GENSIPS), 2011 IEEE International Workshop on. © 2011 IEEE .
Xiangfang Li has been supported by the National Cancer Institute (2 R25CA090301-06). The experimental and image analysis work was supported in part by the W. M. Keck Foundation and Predictive Biomarker Sciences.
This article has been published as part of BMC Genomics Volume 13 Supplement 6, 2012: Selected articles from the IEEE International Workshop on Genomic Signal Processing and Statistics (GENSIPS) 2011. The full contents of the supplement are available online at http://www.biomedcentral.com/bmcgenomics/supplements/13/S6.
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.