- Open Access
Innovations in the quantitative virus outgrowth assay and its use in clinical trials
Retrovirology volume 14, Article number: 58 (2017)
A robust measure of the size of the latent HIV reservoir is essential to quantifying the effect of interventions designed to deplete the pool of reactivatable, replication competent proviruses. In addition to the ability to measure a biologically relevant parameter, any assay designed to be used in a clinical trial needs to be reproducible and scalable. The need to quantify the number of resting CD4+ T cells capable of releasing infectious virus has led to the development of the quantitative viral outgrowth assay (VOA). The assay as originally described has a number of features that limit its scalability for use in clinical trials; however recent developments reducing the time and manpower requirements of the assay, while importantly improving reproducibility mean that it is becoming much more practical for it to enter into more widespread use. This review describes the background to VOA development and the practical issues that they present in utilising them in clinical trials. It describes the innovations that have made their usage more practical and the limitations that still exist.
Development of the VOA
The possibility of a reservoir of latently infected CD4+ T cells harbouring proviral DNA but not producing virus was identified in early clinical studies on peripheral blood from HIV infected persons . When antiretroviral therapy later transformed the prognosis for people living with infection it became clear that this reservoir of latently infected cells would be a major barrier to eradicating the virus. The number of resting CD4+ T cells harbouring replication competent viruses has been considered the most accurate measure of the latent pool as it is thought that these cells are the source of the virus which rebounds after cessation of antiviral therapy [2, 3]. The demonstration that a population of CD4+ HLA-DR- T cells from patients on effective treatment could be made to release virus upon stimulation with phytohaemagglutinin (PHA) led to efforts to quantify the latent reservoir [4,5,6]. These studies established the principle of quantitation by seeding resting CD4+ T cells in limiting dilution before activating the cells with a combination of PHA and irradiated allogeneic peripheral blood mononuclear cells (PBMCs). Due to the low frequency of latently infected cells it was necessary to obtain a large volume blood sample (approximately 200 ml) from study participants.
The amount of HIV Gag protein released by reactivating a single latently infected cell is below the limit of detection of a standard p24 ELISA. Therefore the released virus is amplified by co-culture with permissive cells. In the original assay the cells were co-cultured with PHA stimulated, CD8-depleted PBMCs from an HIV-negative donor. Maximum likelihood statistics became the standard to estimate the frequency of latently infected resting CD4+ T cells, expressed as infectious units per million cells (IUPM) .
The use of allogeneic CD8-depleted PBMCs to amplify outgrowth virus has biological and practical limitations. PBMCs from different donors are not equally permissive for HIV infection, leading to different readouts depending on the PBMC donor. This problem is particularly acute when amplifying R5 tropic virus as expression levels of CCR5 vary widely between donors, CXCR4 on the other hand tends to be highly expressed making detection of X4 tropic virus less problematic. One solution is pre-screening of donor PBMCs for CCR5 expression level and selecting for high CCR5-expressing donors only. Another option is using cells from matched donor-patient pairs that are shown in vitro to exhibit robust viral replication, a method that also requires extensive pre-screening prior to the actual assay . Although donor matching reduces inter assay variability for samples obtained from the same HIV-positive donor, it makes the procedure more labour intensive; and together with the need to perform leukapheresis to obtain sufficient latently infected cells, makes it harder for VOA to scale up to meet the needs of a clinical trial.
Developments of VOA for clinical trial use
A number of modifications have been introduced to improve the original viral outgrowth assay. Two new methods utilise cell lines engineered to express high levels of CCR5 [9, 10]. These cell line based assays have been shown to give IUPM readings similar to PBMC based assays [9, 10] and to give highly consistent results when sampling the same patient repeatedly . Cell line based systems are also less labour intensive as the cells do not have to be freshly prepared from blood and stimulated with PHA for each assay. One assay uses a custom antibody cocktail to purify resting CD4+ T cells from PBMCs of HIV positive donors in a single step, significantly reducing processing time from approximately 2 h to 45 min , a huge advantage when scaling up assay numbers for clinical trials. Another recent modification proposed to reduce the work required for each assay is stimulating the resting CD4+ T cells with CD3/CD28 microbeads rather than PHA and irradiated allogeneic PBMCs. Although the results correlated well with those derived from the standard stimulus, the microbead based method appeared to be less sensitive .
Recently a number of strategies have been proposed for optimising the outgrowth assay by improving the sensitivity of the detection system or simplifying the read-out. Besides substituting the PBMC based co-culture with a CD4/CXCR4/CCR5 expressing clonal cell line, we recently reported that the observation of viral cytopathic effect in these cells showed a near-perfect correlation with the detection of p24 from infected cells (Fig. 1) , further simplifying the assay. Alternatively, use of a more sensitive PCR based detection method instead of the p24 ELISA can reduce the co-culture time required to detect replication-competent HIV . The TILDA assay  utilises the detection of an increase in multiply spliced HIV RNA in CD4+ T cells after stimulation. Similar to the VOA, the cells are seeded in limiting dilution to obtain a quantitative measure. It uses total rather than resting CD4+ T cells, which has the advantage of requiring a smaller blood volume than a VOA and it does not need an extended period of culture for detection, however this means that it measures the inducible reservoir in a population of cells different to that used in the VOA. Another new assay, TZA, utilizes TZM-bl cells . These cells produce β-galactosidase in response to viral Tat, enabling the presence of HIV to be determined by the enzymatic cleavage of a luminescent compound. In contrast to TILDA the TZA assay utilises resting CD4+ T cells but also requires a significantly smaller blood volume than the standard VOA. Neither of these assays correlated closely with IUPM measured by a standard VOA implying that they may not measure the same component of the HIV reservoir. Another caveat is that as neither assay requires viral replication to detect reactivated virus, neither provides unequivocal proof that the detected viral products are derived from replication-competent virus.
Another novel technique that significantly shortens the assay time of the VOA, by use of an enhanced sensitivity of p24 detection at ultra-low concentrations, has recently been applied to HIV latency research . This ultrasensitive assay utilises Simoa single molecule automated array technology  which can measure sub-femtomolar concentrations of analytes using a micro-bead based antibody capture system. This promising method allows the detection and quantitation of p24 produced by a single reactivated infected CD4+ T cell . Although this method is very powerful in detecting viral protein production very early after reactivation, it is not yet clear if the measure represents replication-competent virus and how it correlates to the VOA. Therefore, the results of ongoing clinical studies like RIVER (Clinical trial registry identifier: NCT02336074) which employ both a VOA and the ultrasensitive p24 assay, among many other measures of the latent HIV reservoir, will be of tremendous interest in the search for a definitive measure, or combination of measures, of the clinically significant HIV reservoir.
As efforts to cure HIV progress it may become necessary to be able to detect smaller reservoirs with greater confidence. A recent development on the VOA has been the development of the murine outgrowth system [16,17,18]. It involves the injection of PBMCs or CD4 T cells into immunodeficient NSG mice [17, 18] or humanised mice . These systems offer enhanced sensitivity as they are capable of sampling large number of cells. They can also give a semi-quantitative estimate of the reservoir size and outgrowth from patient cells where a standard VOA had been negative . However, these assays are not easily scalable, limiting their deployment.
VOA is generally regarded as the gold standard in estimating the size of the replication-competent latent viral reservoir. Interestingly in the REDUC trial , combinatorial application of a histone deacetylase inhibitor romidepsin, an HIV vaccine, and recombinant human GM-CSF has achieved a statistically significant reduction on the size of the latent reservoir as measured by total HIV DNA and by VOA in resting CD4 T cells, but not by integrated HIV DNA in total CD4 T cells. This illustrates the importance of including a range of outcome measures in clinical trials aimed at perturbing the latent reservoir until a definitive measure is identified. A number of other clinical studies have also included VOA as outcomes (Table 1). These studies represent only a fraction of the cure effort and a recent survey  shows that VOA is being deployed in a only a minority (5 out of 25) of ongoing clinical trials on HIV cure. This highlights how the logistic difficulties outlined above and the associated high costs limit the applicability of the assay.
Although there have been significant improvements in VOAs enhancing their applicability problems remain. Assays of the same patient performed in different laboratories can yield different estimates of reservoir size, in part due to different experimental protocols. As yet there has been no international consensus on the optimum protocol for measuring the latent reservoir, nor have there been efforts to standardise readouts using samples of known latent viral load. Addressing these issues will be essential to enable comparison of the results of clinical trials carried out at different centres. Additional limitations of the VOA stem from the biology of HIV latency. Thus far, no method has been able to activate HIV in all latently infected cells, for which repeated rounds of reactivation may be necessary [21, 22]. It is not known whether the stimuli we have available are capable of reactivating every provirus as our understanding of latency is incomplete and there is emerging evidence of a diversity of mechanisms responsible for viral silencing . Furthermore, cells carrying replication-competent latent HIV are so rare that large volume blood draws, or leukapheresis, may remain a requisite for any VOA, adding to the logistic challenges of deploying and scaling up the assay. The pathophysiological importance of the parameter measured by VOA is the most compelling reason for it still to be considered a sine qua non of clinical trials of virus reactivation. However, as with all assays based on sampling of blood, it does not sample latently infected T cells in the tissue compartment. It is unclear if the latent T cells reservoir in the blood compartment fully recapitulate that in the tissue compartment, as tissue resident T memory cells do not circulate . Critically, there are as yet no robust data on how VOA correlates with the time to viral rebound after withdrawal of ART, which is ultimately the clinically relevant outcome. It is sobering to note that the ‘Mississippi child’ had a undetectable latent viral load after cumulative sampling of 64 million resting CD4+ T cells  prior to rebound. Thus, whilst VOA is a powerful tool as it gives a physiologically relevant readout in clinical trials evaluating the efficacy of latency reversal, developing a simpler and cheaper but still reproducible assay for the latent reservoir and establishing predictive parameters for clinical outcomes remain urgent research priorities.
Schnittman SM, Psallidopoulos MC, Lane HC, Baseler M, Massari F, Fox CH, et al. The reservoir for HIV-1 in human peripheral blood is a T Cell that maintains expression of CD4. Science. 1989;245(4915):305–8.
Brennan TP, Woods JO, Sedaghat AR, Siliciano JD, Siliciano RF, Wilke CO. Analysis of human immunodeficiency virus type 1 viremia and provirus in resting CD4+ T cells reveals a novel source of residual viremia in patients on antiretroviral therapy. J Virol. 2009;83(17):8470–81.
Anderson JA, Archin NM, Ince W, Parker D, Wiegand A, Coffin JM, et al. Clonal sequences recovered from plasma from patients with residual HIV-1 viremia and on intensified antiretroviral therapy are identical to replicating viral RNAs recovered from circulating resting CD4+ T cells. J Virol. 2011;85(10):5220–3.
Chun T-W, Carruth L, Finzi D, Shen X, DiGiuseppe JA, Taylor H, et al. Quantification of latent tissue reservoirs and total body viral load in HIV-1 infection. Nature. 1997;387(6629):183–8.
Finzi D, Hermankova M, Pierson T, Carruth LM, Buck C, Chaisson RE, et al. Identification of a reservoir for HIV-1 in patients on highly active antiretroviral therapy. Science. 1997;278(5341):1295–300.
Wong J, Hezareh M, Günthard H, Havlir D, Ignacio C, Spina C, et al. Recovery of replication-competent HIV despite prolonged suppression of plasma viremia. Science. 1997;278(5341):1291–5.
Myers LE, McQuay LJ, Hollinger FB. Dilution assay statistics. J Clin Microbiol Am Soc Microbiol. 1994;32(3):732–9.
Archin N, Eron J, Palmer S, Hartmann-Duff A, Martinson J, Wiegand A, et al. Valproic acid without intensified antiviral therapy has limited impact on persistent HIV infection of resting CD4+ T cells. AIDS. 2008;22(10):1131–5.
Laird GM, Eisele EE, Rabi SA, Lai J, Chioma S, Blankson JN, et al. Rapid quantification of the latent reservoir for HIV-1 using a viral outgrowth assay. PLoS Pathog. 2013;9(5):e1003398.
Fun A, Mok HP, Wills MR, Lever AM. A highly reproducible quantitative viral outgrowth assay for the measurement of the replication-competent latent HIV-1 reservoir. Sci Rep. 2017;24(7):43231.
Kuzmichev YV, Veenhuis RT, Pohlmeyer CW, Garliss CC, Walker-Sperling VE, Blankson JN. A CD3/CD28 microbead-based HIV-1 viral outgrowth assay. J Virus Erad. 2017;3(2):85–9.
Procopio FA, Fromentin R, Kulpa DA, Brehm JH, Bebin AG, Strain MC, et al. A novel assay to measure the magnitude of the inducible viral reservoir in HIV-infected individuals. EBioMedicine. 2015;2(8):874–83.
Sanyal A, Mailliard RB, Rinaldo CR, Ratner D, Ding M, Chen Y, et al. Novel assay reveals a large, inducible, replication-competent HIV-1 reservoir in resting CD4+ T cells. Nat Med. 2017;23(7):885–9.
Passaes CPB, Bruel T, Decalf J, David A, Angin M, Monceaux V, et al. Ultrasensitive HIV-1 p24 assay detects single infected cells and differences in reservoir induction by latency reversal agents. J Virol Am Soc Microbiol. 2017;91(6):e02296-16.
Rissin DM, Kan CW, Campbell TG, Howes SC, Fournier DR, Song L, et al. Single-molecule enzyme-linked immunosorbent assay detects serum proteins at subfemtomolar concentrations. Nat Biotechnol. 2010;28(6):595–9.
Charlins P, Schmitt K, Remling-Mulder L, Hogan LE, Hanhauser E, Hobbs KS, et al. A humanized mouse-based HIV-1 viral outgrowth assay with higher sensitivity than in vitro qVOA in detecting latently infected cells from individuals on ART with undetectable viral loads. Virology. 2017;507:135–9.
Metcalf Pate KA, Pohlmeyer CW, Walker-Sperling VE, Foote JB, Najarro KM, Cryer CG, et al. A murine viral outgrowth assay to detect residual HIV Type 1 in patients with undectable viral loads. J Infect Dis. 2015;212(9):1387–96.
Yuan Z, Kang G, Lu W, Li Q. Reactivation of HIV-1 proviruses in immune-comprised mice engrafted with human VOA-negative CD4+ T cells. J Virus Erad. 2017;3(1):61–5.
Leth S, Schleimann MH, Nissen SK, Højen JF, Olesen R, Graversen ME, et al. Combined effect of Vacc-4x, recombinant human granulocyte macrophage colony-stimulating factor vaccination, and romidepsin on the HIV-1 reservoir (REDUC): a single-arm, phase 1B/2A trial. Lancet HIV. 2016;3(10):e463–72.
Delagrèverie HM, Delaugerre C, Lewin SR, Deeks SG, Li JZ. Ongoing clinical trials of human immunodeficiency virus latency-reversing and immunomodulatory agents. Open Forum Infect Dis. 2016;3(4):ofw189.
Ho Y-C, Shan L, Hosmane NN, Wang J, Laskey SB, Rosenbloom DIS, et al. Replication-competent noninduced proviruses in the latent reservoir increase barrier to HIV-1 cure. Cell. 2014;155(3):540–51.
Hosmane NN, Kwon KJ, Bruner KM, Capoferri AA, Beg S, Rosenbloom DIS, et al. Proliferation of latently infected CD4+ T cells carrying replication-competent HIV-1: potential role in latent reservoir dynamics. J Exp Med. 2017;214(4):959–72.
Spina CA, Anderson J, Archin NM, Bosque A, Chan J, Famiglietti M, et al. An in-depth comparison of latent HIV-1 reactivation in multiple cell model systems and resting CD4+ T cells from aviremic patients. PLoS Pathog. 2013;9(12):e1003834.
Schenkel JM, Masopust D. Tissue-resident memory T cells. Immunity. 2014;41(6):886–97.
Luzuriaga K, Gay H, Ziemniak C, Sanborn K, Somasundaran M, Rainwater-Lovett K, et al. Viremic relapse after HIV-1 remission in a perinatally infected child. N Engl J Med. 2015;372(8):786–8.
Archin NM, Liberty AL, Kashuba AD, Choudhary SK, Kuruc JD, Crooks AM, et al. Administration of vorinostat disrupts HIV-1 latency in patients on antiretroviral therapy. Nature. 2012;487(7408):482–5.
Archin NM, Bateson R, Tripathy MK, Crooks AM, Yang K-H, Dahl NP, et al. HIV-1 expression within resting CD4+ T cells after multiple doses of vorinostat. J Infect Dis. 2014;210(5):728–35.
Archin NM, Kirchherr JL, Sung JAM, Clutton G, Sholtis K, Xu Y, et al. Interval dosing with the HDAC inhibitor vorinostat effectively reverses HIV latency. J Clin Invest. 2017;127(8):3126–35.
Rasmussen TA, Tolstrup M, Brinkmann CR, Olesen R, Erikstrup C, Solomon A, et al. Panobinostat, a histone deacetylase inhibitor, for latent-virus reactivation in HIV-infected patients on suppressive antiretroviral therapy: a phase 1/2, single group, clinical trial. Lancet HIV. 2014;1(1):e13–21.
Routy JP, Tremblay CL, Angel JB, Trottier B, Rouleau D, Baril JG, et al. Valproic acid in association with highly active antiretroviral therapy for reducing systemic HIV-1 reservoirs: results from a multicentre randomized clinical study. HIV Med. 2012;13(5):291–6.
Spivak AM, Andrade A, Eisele E, Hoh R, Bacchetti P, Bumpus NN, et al. A pilot study assessing the safety and latency-reversing activity of disulfiram in HIV-1-infected adults on antiretroviral therapy. Clin Infect Dis. 2014;58(6):883–90.
Vibholm L, Schleimann MH, Højen JF, Benfield T, Offersen R, Rasmussen K, et al. Short-course toll-like receptor 9 agonist treatment impacts innate immunity and plasma viremia in individuals with human immunodeficiency virus infection. Clin Infect Dis. 2017;64(12):1686–95.
NJN, MB, AF and HPM wrote the original draft. All authors read and approved the final manuscript.
HPM and NJN are both supported by the Medical Research Council, UK (MR/N02043X/1 and MR/M003515/1 respectively). Work in the laboratory is supported by the Medical Research Council (UK), the Biomedical Research Centre and the Cambridge Clinical Academic Reserve.
The authors declare that they have no competing interests.
Availability of data and materials
Consent for publication
Ethical approval and consent to be participate
HPM and NJN are supported by the Medical Research Council (MRC), UK (MR/N02043X/1 and MR/M003515/1 respectively). AF and MB are supported by the NIHR Biomedical Research Centre (BRC). Work in the laboratory is supported by the MRC, BRC and the Cambridge Clinical Academic Reserve.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Norton, N.J., Fun, A., Bandara, M. et al. Innovations in the quantitative virus outgrowth assay and its use in clinical trials. Retrovirology 14, 58 (2017) doi:10.1186/s12977-017-0381-2
- Viral outgrowth assay