- Open Access
Prediction of HIV-associated neurocognitive disorder (HAND) from three genetic features of envelope gp120 glycoprotein
Retrovirologyvolume 15, Article number: 12 (2018)
HIV-associated neurocognitive disorder (HAND) remains an important and yet potentially underdiagnosed manifestation despite the fact that the modern combination antiretroviral therapy (cART) has achieved effective viral suppression and greatly reduced the incidence of life-threatening events. Although HIV neurotoxicity is thought to play a central role, the potential of viral genetic signature as diagnostic and/or prognostic biomarker has yet to be fully explored.
Using a manually curated sequence metadataset (80 specimens, 2349 sequences), we demonstrated that only three genetic features are sufficient to predict HAND status regardless of sampling tissues; the accuracy reached 100 and 94% in the hold-out testing subdataset and the entire dataset, respectively. The three genetic features stratified HAND into four distinct clusters. Extrapolating the classification to the 1619 specimens registered in the Los Alamos HIV Sequence Database, the global HAND prevalence was estimated to be 46%, with significant regional variations (30–71%). The R package HANDPrediction was implemented to ensure public availability of key codes.
Our analysis revealed three amino acid positions in gp120 glycoprotein, providing the basis of the development of novel cART regimens specifically optimized for HAND-associated quasispecies. Moreover, the classifier can readily be translated into a diagnostic biomarker, warranting prospective validation.
Neurocognitive impairments during the course of chronic HIV infection, called HIV-associated neurocognitive disorder (HAND), remain as an unconquered clinical entity despite the improvement of combination antiretroviral therapy (cART) over the last 20 years [1, 2]. HAND is a comprehensive concept encompassing the broad spectrum of motor, cognitive, and neuropsychiatric impairment, in which persistent HIV infection in the central nervous system (CNS) plays a fundamental role. According to the criteria proposed by the HIV Neurobehavioral Research Center (HNRC), HAND is stratified into three conditions, namely, asymptomatic neurocognitive impairment (ANI), mild neurocognitive disorder (MND), and HIV-associated dementia (HAD) . In a large cohort study from the U.S., prevalence estimates of ANI, MND and HAD were inferred at 33, 12 and 2%, respectively . Other cohort studies yielded similar estimates [5,6,7]. Despite its wide prevalence, diagnostic and therapeutic strategies are quite limited; currently, there is no molecularly defined biomarkers, and prompt initiation of cART is the only clinically available treatment, though its effectiveness on preventing the progression of neurocognitive impairment is still in hot controversy [8, 9]. Indeed, as cART has become more accessible in resource-limited settings worldwide, thereby extending the expected lifespan of HIV-infected patients, the global burden of HAND is expected to be steadily on the rise. Recently, accumulating evidence suggests that persistent viral replication and ongoing diversification in the CNS compartment even in patients with undetectably suppressed viremia could lead to the emergence of neurotoxic quasispecies and thereby contribute to the progression of HAND [10, 11]. In this context, defining etiologically relevant diagnostic and/or prognostic biomarkers and optimal regimens based on those biomarkers in the era of modern cART is an inevitable step forward to improve current clinical practice.
Neurotoxic HIV viral quasispecies have been hypothesized to play an indispensable role in HAND pathogenesis. Although the mechanisms of HIV neurotoxicity has yet to be thoroughly clarified, several studies have suggested that there is a link between HAND and the neurotoxicity exerted by the orchestrated actions of several HIV proteins including trans-activating protein (Tat) and envelope glycoprotein (Env) . Particularly, gp120, a fragment proteolytically cleaved from the Env protein, may mediate neuronal damage via direct induction of apoptosis both in rodents and primary human brain tissue culture [13,14,15]. On the other hand, hypervariable region 3 (V3) located at the middle of gp120 is primarily responsible for the genotypic and phenotypic diversity of HIV. A loop structure formed by V3 (V3 loop) interacts with chemokine coreceptors CCR5 and/or CXCR4, thereby determining multifaceted viral phenotypes including cell tropism . Studies of CNS-derived viral isolates have indicated the links between CCR5 tropism, macrophage/microglia tropism, and the compartmentalization and persistent replication of viruses in the CNS [17,18,19]. Considering these insights, it is plausible to hypothesize that the gp120 glycoprotein serves as a primary, if not exclusive, determinant of both neurotropism, i.e., the ability to cross the blood–brain barrier and maintain replicative capacity in the CNS compartment, and neurotoxicity, i.e., the capability of igniting and/or fueling neurocognitive impairments. In this context, Pillai et al.  studied the C2V3 env subregion, and reported that the fifth residue of the V3 loop significantly correlated with neurocognitive deficit, although they did not explore the predictive significance of this signature. Indeed, a single amino acid signature is unlikely to be adequate to explain HIV adaptation during the course of HAND progression; thus, the combination of various signatures should be explored.
Machine learning (ML) is a highly promising technique for exploring a vastly large set of parameters to yield a potent classifier without prespecifying mathematical models. To gain optimized predictive accuracy, ML algorithms iteratively evaluate three types of error: training errors, validation errors (i.e., in-sample errors), and generalization errors (i.e., out-of-sample errors). The ultimate goal of ML-based prediction is to construct a classifier which has minimal generalization errors to unobserved real-world data. When a training dataset is provided, ML algorithms internally evaluate training errors to find the best set of parameters specific to the algorithm, and validation errors are evaluated by methods such as cross-validation (CV). When multiple algorithms with different sets of parameters are compared, the classifier with the smallest validation errors is selected. Then, the generalization errors should be evaluated with a testing dataset independent from model construction and selection.
Holman and Gabuzda applied ML-based approach to a manually collected metadataset of env C2V3C3 sequences derived from patients with or without HIV-associated dementia (HAD), reporting 75% accuracy for predicting HAD-associated env sequences . Although their work provided intriguing insights into HIV neuropathogenesis, its generalizability is limited by several caveats. First, they reported the predictive accuracy via leave-one-out cross-validation. However, this corresponds to the validation error and may be a too optimistic estimation of the generalization error because of overfitting of the model against the training dataset. Rather, hold-out validation with no classifier retraining is necessary to correctly evaluate the generalization error. Second, although they only tested a simple rule-based classification algorithm, this could be outperformed by several recently implemented machine learning algorithms and an ensemble of those classifiers. Lastly, they attempted to construct a sequence-level classifier, and they empirically set a threshold at 95% of the patient’s sequences for classifying the patient as having HAD. However, such empirical criteria should be carefully interpreted for potential overfitting. Moreover, since it is plausible to assume that even patients with HAD harbor non-neurotoxic quasispecies, and vice versa for patients without clinically apparent neurocognitive impairments, a patient-level set of features capturing the diversity of intrapatient quasispecies could be more predictive rather than a sequence-level set of features.
The purpose of this retrospective analysis is to propose a potential biomarker for HAND. To this end, the most predictive genetic signatures were explored by generating an ML-based HAND prediction model. A thorough literature search led to the construction of the most comprehensive metadataset to date, comprised of 2494 env C2V3C3 sequences from 9 studies involving 85 specimens from 43 patients. Iterative ML and stepwise feature reduction yielded three genetic features. A final ensemble classifier achieved accuracy of 100 and 94% in the hold-out testing subdataset and as a whole, respectively. Specimens from various sampling sources were classifiable using the same genetic features. Clustering analysis stratified HAND into four distinct clusters. The datasets, the main analysis workflow, and the in-house functions were made publicly available so as to maximize the reproducibility of the entire work.
Construction of annotated HIV env sequence metadataset
A large, curated sequence dataset annotated with relevant clinical information is indispensable for ML-based prediction of the HAND status. Initially, we considered using The HIVBrainSeqDB  (http://hivbrainseqdb.dfci.harvard.edu/HIVSeqDB/) or The HAND Database  (http://www.handdatabase.org/). However, because these databases did not seem comprehensive, we decided to conduct a manual literature review. A thorough literature search resulted in the construction of a manually curated metadataset derived from 9 studies involving 40 patients, and consisting of 2494 HIV env C2V3C3 sequences (see “Methods” section for details), among which 2358 were unique (Additional file 1: Table 1). Sequences isolated from HAND and NonHAND cases formed several phylogenetically distinct clusters (Additional file 1: Fig. 1). Supported by this observation, we decided to further explore ML-based approach to construct a classifier predicting the HAND status from the C2V3C3 sequences.
Machine learning for predicting HAND status
The 2349 C2V3C3 sequences derived from HAND or NonHAND patients were converted into a numerical matrix using the 76 AAIndex schemes relevant to the physicochemical properties of amino acids. Patients diagnosed as either HIV-associated encephalitis (HIVE) or non-specific neuropsychiatric disorder (NPD) were excluded. Next, sequences were grouped by patient and sampling source, and representative statistics (e.g. mean and standard deviation) were calculated for each alignment position. Features with little variance, and a set of highly correlated features were excluded. In this manner, a total of 3169 patient-level predictive features were generated for 80 specimens. We performed ML with five distinct algorithms with ten different random seeds for hold-out data splitting. Stacking of the five classifiers was also attempted.
The mean and the best accuracy of the stacked classifiers trained using all features were 63 and 78%, respectively, in the hold-out validation subdataset (Fig. 1a and Additional file 1: Table 2). However, since this is extremely over-parametrized analysis, we attempted to reduce the number of features. First, algorithm-specific feature importance was calculated for each classifier, and the 20 most important ones were screened (Additional file 1: Table 3). Next, features selected by two or more distinct algorithms were selected. Finally, distributions between HAND and NonHAND cases were compared. P values were calculated by Welch’s t test, and adjustment for multiple comparisons was done according to the method controlling the false discovery rate (FDR) originally reported by Benjamini and Hochberg . Features with adjusted P values of lower than 0.05 were retained. In this manner, seven important features were uncovered (Additional file 1: Fig. 2). Encouraged by the observation that feature reduction did improve the predictive accuracy, we further deciphered the best set of features by means of stepwise feature reduction (Table 1 and Additional file 1: Table 4). Surprisingly, we observed the highest accuracy being 100% in the testing subdataset in two different algorithms (Fig. 1b). These classifiers used only three features. The mean and the best accuracy of the stacked classifiers were 76 and 100%, respectively (Fig. 1b and Additional file 1: Table 5). The accuracy of the best stacked classifier for the whole dataset was 94%, where the HAND status was predicted correctly in 75 out of 80 specimens. The distributions of Bayesian posterior probabilities showed that this classifier is expected to work well when the prior probability of HAND lies within the range from ~ 25% to ~ 50% (Additional file 1: Figure 3). Finally, as an external validation, all of the three specimens obtained from two patients with NPD were classified as HAND. One specimen was obtained from Patient 196, who was not diagnosed as HAD due to lack of information in the original paper despite the evidence of neuropsychiatric impairment . The other two specimens were obtained from Subject 7115 at July 8th, 2002 . Although the diagnosis of HAD could not be made due to confounding conditions at that moment, the same patient was diagnosed as moderate to severe HAD 2 years later. These two cases highlight the potential utility of our sequence-based HAND classifier as a diagnostic aid.
The distributions of the most important features were significantly different between the HAND and NonHAND cases (Fig. 2a). At position 291 (Pos291), the maximum value of the AAIndex DIGM050101, which represents a hydrostatic pressure asymmetry index, was shown to be the most predictive. The difference between the HAND and NonHAND cases was explained by the decrease of the frequency of 291S in the HAND group (Fig. 2b). Meanwhile, the other two important AAIndices, namely, KARP850102 and BHAR880101, are related to the flexibility of the residue. Variants enriched in the HAND cases such as 315 K/S and 340D/K/S contributed to the different feature distributions (Fig. 2).
Molecular stratification of HAND through the minimal set of genetic features
HAND is a diagnosis of exclusion, thus inherently harboring some heterogeneity. We noticed that, although the stacked classifier predicts the HAND status with high confidence, the subordinate classifiers returned considerably varied probabilities to the same cases, indicating that each of the classifiers captures distinct aspects of the triad of the genetic features. Indeed, clustering analysis revealed four distinct HAND-rich clusters (H1-H4) with characteristic genetic landscapes (Fig. 3a). Clusters enriched with NonHAND cases were combined as N. Random forest algorithm successfully constructed a classifier for these five categories, with the estimated accuracy from internal CV being 94%. A representative decision tree with the median number of nodes was shown in Fig. 3b. The tree understandably reflects the similarities between H2 and H4, and those between H1 and H3. When each amino acid variants were considered to be features, no apparent cluster-specific enrichment occurred, underscoring the effectiveness of our AAIndex-based feature generation framework (Additional file 1: Fig. 3).
To unveil the characteristics of each of the HAND clusters, we next applied the random forest classifier to the entire dataset obtained from The HAND Database (http://www.handdatabase.org/), which is a recently published, manually curated database of HIV sequences with clinical metadata  (Fig. 4). Collectively, 26 out of 33 (79%) HAD cases were classified into one of the HAND clusters, whereas all of the twenty cases originally annotated as not neurocognitively impaired were predicted as such (100%). Interestingly, nine out of eleven (82%) HIVE cases were predicted as N. Moreover, remaining two HIVE cases and the 6 cases with HAD and overlapping HIVE were classified as H2. These observations highlight the uniqueness of H2, potentially bridging the two distinct disease entities, namely, HAND and HIVE.
Estimation of the global burden of HAND
One major obstacle against the epidemiological study regarding HAND is the dearth of molecularly defined biomarkers. Currently, a careful neuropsychiatric examination is the only solid basis; in addition to this, various tests including brain CT/MRI and the cerebrospinal fluid (CSF) analysis are frequently required to exclude various mimicking diseases such as meningoencephalitis, toxoplasmosis, and primary CNS lymphoma. Biomarkers measurable from peripheral plasma could greatly reduce the burden for diagnostic procedures, and thereby facilitate epidemiological and other clinical studies particularly in resource-limited settings.
In view of this application, we retrospectively estimated the global burden of HAND from the entire sequence dataset deposited in the Los Alamos HIV Sequence Database (https://www.hiv.lanl.gov/content/sequence/HIV/mainpage.html), the largest database to date. Collectively, 46% of the cases were predicted as HAND, which was slightly higher than estimates from historical cohorts [4,5,6,7] (Fig. 5a). Among the predicted HAND cases, H1 was the most common cluster, followed by H2, H3, and H4 (Fig. 5a). Geographically dissecting, Caribbean region was the region with the largest predicted HAND burden (71%), whereas Sub-Saharan Africa was the lowest prevalence (30%). Among HAND clusters, H1 was dominant in Sub-Saharan Africa and Asia/Middle-East/Oceania (97 and 85%, respectively). In other regions, no single dominant cluster was noted. Caribbean region was characterized by the high prevalence of H3 (59%). Europe and North America regions had relatively high prevalence of H2 (54 and 38%, respectively). These regional differences in viral genetic landscape might be associated with various factors such as ethnicity and human leucocyte antigen (HLA) allele frequencies. Among the HAND clusters, H1 had a moderately higher viral load and lower CD4+ T-cell count compared to H2. Meanwhile, H3 had a statistically higher CD4+ T-cell count compared to H1 (Additional file 1: Figure 5). These trends were unchanged even when the P values were adjusted according to the FDR-based method .
Data and code availability for future research
Both the datasets and the in-house functions created in this study were bundled as the R package HANDPrediction, and distributed on GitHub (https://github.com/masato-ogishi/HANDPrediction). To facilitate future research, the entire analysis workflow was also publicly distributed as an HTML document (Additional file 2).
In this work, the three genetic features of the HIV env gene most predictive of the HAND status were identified through the construction of a highly accurate classifier via machine learning (ML). The surprisingly small number of features, three, strongly counter-argues the possibility of overfitting and supports the generalizability of the model to external datasets. The set of features stratified the 37 specimens derived from HAND cases into four clusters. The stratification process was successfully recapitulated by random forest algorithm, which enabled extrapolation of the genetic feature-based classification of HAND status. Estimation of global burden of HAND was demonstrated using the Loa Alamos HIV sequence database. The regional differences in the relative frequencies of HAND clusters probed by this retrospective analysis underscore the potential usefulness of our framework as an aid for epidemiological research, thereby warranting prospective validation.
In contrast to previous studies, neurotoxicity was stringently distinguished from neurotropism during the construction of the metadataset in this study. This is because it is inappropriate to discuss those two distinct phenotypes interchangeably, since neurotoxic viral quasispecies that may trigger neurocognitive impairment could reside both inside and outside the CNS, and viral quasispecies harbored in the CNS do not necessarily exert neurotoxicity. Indeed, as shown in Fig. 3a, HAND-associated genetic signatures were shared among specimens derived from the CNS, lymphatic system, and peripheral circulation. This indicates that selection pressure outside the CNS is not a major driver for quasispecies evolution, which is consistent with a recent observational study led by Stefic et al. .
It is an exciting possibility that viral sequences obtained from peripheral circulation could be used as a diagnostic biomarker of HAND. Whether these genetic biomarkers provide clues to HAND at asymptomatic stage is of great interest, as many neuropsychiatric tests suffer from lower diagnostic performance at this stage [28, 29]. However, one caveat of this study is that the sequences were mainly obtained from AIDS patients without viremia suppression by modern cART. In contrast, prompt initiation of cART is the gold standard of contemporary clinical practice . In this setting, immune reconstitution due to cART may affect viral quasispecies with HAND-associated signatures and alter their systemic distributions. Meanwhile, CNS penetration effectiveness score of cART compound is another consideration, since higher penetration score has been associated with lower neurocognitive impairment . However, how the architecture of HIV quasispecies is affected by various cART regimens, and what roles these alterations may play in the pathogenesis of HAND, should be elucidated in future research.
Patient-level features are more informative than sequence-level features for predicting patient-level phenotypes . Consistent with this viewpoint, the summary statistics representing the distribution of physicochemical properties of intrapatient viral quasispecies were used as the features on the basis of which ML was performed. One caveat of this approach is the sequence depth per patient; observed relative frequencies of each of the amino acid variants at each of the positions may not reflect true intrapatient abundance with limited sequencing depth. Alternatively, next-generation sequencing platform could allow researchers to estimate relative abundance of variants with remarkably improved accuracy. We have previously shown that intrapatient abundances of viral quasispecies could be reliably estimated bioinformatically from short-read sequence datasets generated by the Illumina MiSeq platform . This process is known as “quasispecies reconstruction”. Integration of high-throughput sequencing technology and quasispecies reconstruction could enable more accurate estimations of intrapatient quasispecies abundance with augmented scalability. Such large-scale datasets could bolster the precision and accuracy of the HAND prediction framework presented in this work.
A number of gp120 variants have been associated with neurotropism and/or neurotoxicity. For example, Dunfee et al.  reported T283N as a neurotoxic variant causing enhanced macrophage infectivity and neuronal degeneration. Duenas-Decamp et al.  showed that the otherwise non-macrophage-tropic strain LN40 can be transformed into a macrophage-tropic strain by introducing 283 N substitution. However, in an already macrophage-tropic strain (B33), substitution of 283 N into 283T did not alter tropism, indicating the existence of other determinants . In our analysis, three positions, namely, Pos291, Pos315, and, Pos340, were identified to be the most predictive for HAND status (Fig. 2b). Holman and Gabuzda also reported the involvement of Pos315 in HAND-predicting signature . Pos315 resides in the tip of the V3-loop, and various variants such as R315K, R315T, and R315Q have been associated with reduced efficacy of neutralizing antibodies (NAbs) [35,36,37,38]. In our analysis, R315K and R315Q were enriched in the HAND and NonHAND cases, respectively (Fig. 2b). Although the other two positions, Pos291 and Pos340, were less intensively studied, S291 (enriched in NonHAND) has been associated with decreased infectivity to macrophages in R5 virus . Meanwhile, compartmentalization of N340, a variant enriched in NonHAND in our analysis, to the CNS was observed in some cases . Both S291 and N340 were also identified in this study (Additional file 1: Figure 4).
The current concept of HAND is heterogeneous due to its nature of being diagnosed on the basis of symptomatic criteria and by exclusion of other confounding conditions. To our knowledge, there is no attempt to date to molecularly stratify the disease entity. In this work, four HAND clusters were identified based on a clustering analysis. Particularly, H2 is interesting because it was associated with HIVE (Fig. 4). Since H2 and the closest cluster H4 were distinguished by the Pos340 feature (Fig. 3), and H4 was associated with both HAD and HAD + HIVE (Fig. 4), Pos340 might be important in separating HAND and HIVE. Moreover, geographically speaking, both H2 and H4 seemed to be enriched in Europe and North America (Fig. 5). Such geographical difference, if is the case, should be taken into consideration when interpreting various research on HAND from various nations. The biological and epidemiological relevance of those variants and clusters has yet to be elucidated, thus warranting further research.
This study has some limitations, similarly to prior studies. First, since this is a retrospective observational study, no causative link can be definitively established. Amino acid signatures detected could be relevant to the neurotoxicity of HIV, but should not be interpreted as causative of HAND. Second, although unprecedented size, the numbers of unique specimens and patients were fairly small. Although we successfully reduced the number of required genetic features down to three, the risk of overfitting to the entire dataset should not be negated. Prospective collection of the adequate size of specimens would be the only strategy to effectively resolve this concern. Third, since most of the currently available env sequences were derived from HAD cases, the most severe form of HAND, the utility of our analysis in predicting early-stage HAND has yet to be fully verified. Similarly to this point, the effect of cART regimens on the evolutionary trajectory of viral quasispecies should also be taken into consideration in future research. We do not argue that our analysis provides all answers; rather, we hope this work could be a starting point. Therefore, we made publicly available the datasets, the custom codes, and the entire analysis workflow for the community.
In this study, robust prediction of HAND status from three genetic features derived from the HIV env sequences was demonstrated. Furthermore, based on the combination of these three genetic features, we stratified HAND into four clusters with unique characteristics. These results could be utilized as a diagnostic aid after prospectively validation. Finally, the biological and epidemiological significance of newly discovered genetic features, potentially providing the basis of the development of novel cART regimens specifically optimized for HAND-associated quasispecies, are to be elucidated in future research.
All computational analyses were conducted using R ver. 3.4.1 (https://www.r-project.org/) . The latest versions of R packages were consistently used. The dataset and the scripts generated in this study are available as the R package HANDPrediction on GitHub (https://github.com/masato-ogishi/HANDPrediction). The entire analysis workflow is also available as an HTML document (Additional file 2).
Assembly of the HIV env sequence metadataset
A thorough literature search was conducted to collect previously published studies on HIV neurotoxicity and/or neurotropism. Sequences and accompanying metadata were retrieved from the Los Alamos HIV Sequence Database (http://www.hiv.lanl.gov/content/sequence/HIV/mainpage.html/) and manually curated. Diagnoses of HIV-associated neurological conditions were retrieved from original publications for all of the cases. The sub-categories of HAND (AMI, MND, and HAD) were combined as ‘HAND’, and the AIDS-dementia complex (ADC) was also considered ‘HAND’ in this study. HIVE and other NPDs were labeled as such. Cases with no neurocognitive impairments were labeled as ‘NonHAND’ regardless of other CNS diseases including bacterial meningitis, toxoplasmosis, and CNS lymphoma. The sample sources were categorized into one of the following categories: ‘CNS’, ‘Blood’, ‘Lymph’, and ‘Others’.
Alignment of HIV env sequences
The HXB2 HIV-1 sequence (accession: K03455) was used as a reference. The env region was identified by mapping sequences to the reference sequence using Geneious ver 8.1.8 (www.geneious.com). The built-in Geneious mapper was used with the “Medium Sensitivity” option selected. Default parameters were used. Sequences not mapped to the reference were discarded from the metadataset. The env C2V3C3 regions were manually determined, clipped, and re-aligned with MAFFT . The alignment was refined and translated using the HIVAlign tool with the HMM-align option selected (https://www.hiv.lanl.gov/content/sequence/VIRALIGN/viralign.html). Alignment gaps shared by the reference sequence and more than 75% of the aligned sequences were manually removed. Sequences containing stop codons inside the C2V3C3 region were discarded.
AAIndex metrics (http://www.genome.jp/aaindex/)  were adopted as quantitative measures of biophysicochemical properties of each amino acid. A total of 531 AAIndices were retrieved from the BioSeqClass package available in Bioconductor . The 76 AAIndices whose names matched with one of the following phrases were selected for machine learning: ‘Hydro’, ‘Charge’, ‘Polar’, ‘Distribution’, and ‘Flexi’. A C2V3C3 sequence was converted to a numerical vector comprising a set of AAIndex values corresponding to each amino acid residue at each alignment position. For all gaps and ambiguities (i.e., two or more amino acid residues indicated), values for all AAIndices were set to zero. In this manner, all sequences were converted to a numerical matrix, which had 76 × 189 (188 alignment positions plus one gap) columns.
The metadataset was split into the training and testing subdatasets at a ratio of 4:1. Note that the metadataset was split at the patient level, not at the sequence level. Sequence-level data splitting is inappropriate because the HAND vs NonHAND status is assigned to patients, not to individual sequences, and the genetic relatedness of the sequences derived from the same patient will likely lead to biased classification.
In the training subdataset, columns with zero variance and near-zero variance were removed using the preProcess function with the ‘zv’ and ‘nzv’ method implemented in the caret package . Then, highly correlating columns were filtered using preProcess with the ‘corr’ method. After these filtration steps, 3169 unique features were retained. Finally, the features were centered and scaled using preProcess with the ‘center’ and ‘scale’ methods. All preprocessing steps were carried out with default parameter settings. In the testing phase, the same preprocessing conditions prepared in the training phase were applied.
Machine learning with different algorithms
For simplicity, binary classification was attempted, i.e., HAND vs NonHAND. The following algorithms were compared for performance: support vector machine (SVM), random forest (RF), gradient boosting machine (GBM), extreme gradient boosting with linear booster (XGBL), and extreme gradient boosting with tree booster (XGBT), all of which are implemented in the caret package. “Stacking” of the classifiers was done using XGBT as a supervised learning algorithm. Ten-fold repeated three-fold CV was conducted in the training phase to improve the generalizability of the classifiers. Their predictive performances, i.e., sensitivity, specificity, and overall accuracy, were estimated using the testing subdataset.
Feature importance analysis
Model-specific feature importance was estimated using the varImp function implemented in the caret package. All models except SVM tested in this study have their own feature importance measures. The 20 most important features from each of the models were combined, and features detected in two or more different models were selected. Next, the distribution of the feature values among the HAND and NonHAND groups were compared by Welch’s t test, and P values were adjusted by the FDR-based method by Benjamini and Hochberg . Features whose adjusted P values were less than 0.05 were selected. Finally, stepwise feature reduction was iteratively performed. ML was performed on the training subdataset with one of the features removed, and the accuracy in the testing subdataset. The removed feature giving the highest accuracy of the stacked classifier was removed for the next iteration.
K-means clustering was performed on the minimal set of the most important features, and the predicted probabilities by each of the classifiers. Visualization of the heatmap and dendrograms were performed using the ComplexHeatmap package . Clusters enriched with the HAND cases were identified by manual inspection of the dendrogram. Clusters enriched with the NonHAND cases were combined and labeled as ‘N’. The minimal set of the most important features was used to construct a multiclass random forest classifier classifying the HAND clusters and N using the entire dataset.
Characterization of HAND clusters using The HAND Database
The HAND Database  (http://database.handdatabase.org/) was used to characterize each of the HAND clusters. The entire dataset was downloaded as is. A total of 1687 env sequences from 68 specimens were obtained. Sequences were aligned to the HXB2 reference sequence, converted to a numerical matrix, preprocessed using the preprocessing models prepared in the training phase. For each specimen, the corresponding HAND cluster was assigned by the multiclass random forest classifier trained during the clustering analysis. The original labels of neuropathological conditions and the prediction results were linked and visualized as a Sankey plot using the googleVis package .
Estimation of the global burden of HAND using the Los Alamos HIV Sequence Database
The Los Alamos HIV Sequence Database (https://www.hiv.lanl.gov/content/sequence/HIV/mainpage.html) was used to demonstrate a retrospective estimation of the global burden of HAND. The sequences whose “culture method” were either “primary” or “uncultured” were downloaded. A total of 19800 env sequences from 1619 specimens were obtained. HAND status was predicted as described above.
human immunodeficiency virus type 1
HIV-associated neurocognitive disorder
combination antiretroviral therapy
the central nervous system
HIV Neurobehavioral Research Center
asymptomatic neurocognitive impairment
mild neurocognitive disorder
non-specific neuropsychiatric disorder
false discovery rate
acquired immunodeficiency syndrome
support vector machine
gradient boosting machine
extreme gradient boosting with linear booster
extreme gradient boosting with tree booster
Saylor D, Dickens AM, Sacktor N, Haughey N, Slusher B, Pletnikov M, et al. HIV-associated neurocognitive disorder—pathogenesis and prospects for treatment. Nat Rev Neurol. 2016;12:234–48.
Clifford DB, Ances BM. HIV-associated neurocognitive disorder. Lancet Infect Dis. 2013;13:976–86.
Antinori A, Arendt G, Becker JT, Brew BJ, Byrd DA, Cherner M, et al. Updated research nosology for HIV-associated neurocognitive disorders. Neurology. 2007;69:1789–99.
Heaton RK, Clifford DB, Franklin DR, Woods SP, Ake C, Vaida F, et al. HIV-associated neurocognitive disorders persist in the era of potent antiretroviral therapy: Charter Study. Neurology. 2010;75:2087–96.
Chan LG, Kandiah N, Chua A. HIV-associated neurocognitive disorders (HAND) in a South Asian population—contextual application of the 2007 criteria. BMJ Open. 2012;2:e000662.
Yusuf AJ, Hassan A, Mamman AI, Muktar HM, Suleiman AM, Baiyewu O. Prevalence of HIV-associated neurocognitive disorder (HAND) among patients attending a tertiary health facility in Northern Nigeria. J Int Assoc Provid AIDS Care. 2014;116:1477–90.
Sacktor N, Skolasky RL, Seaberg E, Munro C, Becker JT, Martin E, et al. Prevalence of HIV-associated neurocognitive disorders in the Multicenter AIDS Cohort Study. Neurology. 2015;86:334–40.
Crum-Cianflone NF, Moore DJ, Letendre S, Roediger MP, Eberly L, Weintrob A, et al. Low prevalence of neurocognitive impairment in early diagnosed and managed HIV-infected persons. Neurology. 2013;80:371–9.
Oliveira MF, Chaillon A, Nakazawa M, Vargas M, Letendre SL, Strain MC, et al. Early antiretroviral therapy is associated with lower HIV DNA molecular diversity and lower inflammation in cerebrospinal fluid but does not prevent the establishment of compartmentalized HIV DNA populations. PLoS Pathog. 2017;13:e1006112.
Simioni S, Cavassini M, Annoni J-M, Rimbault Abraham A, Bourquin I, Schiffer V, et al. Cognitive dysfunction in HIV patients despite long-standing suppression of viremia. AIDS. 2010;24:1243–50.
Peluso MJ, Ferretti F, Peterson J, Lee E, Fuchs D, Boschini A, et al. Cerebrospinal fluid HIV escape associated with progressive neurologic dysfunction in patients on antiretroviral therapy with well controlled plasma viral load. AIDS. 2012;26:1765–74.
Toggas SM, Masliah E, Rockenstein EM, Rall GF, Abraham CR, Mucke L. Central nervous system damage produced by expression of the HIV-1 coat protein gp120 in transgenic mice. Nature. 1994;367:188–93.
Jana A, Pahan K. Human immunodeficiency virus type 1 gp120 induces apoptosis in human primary neurons through redox-regulated activation of neutral sphingomyelinase. Neuroscience. 2004;24:9531–40.
Zhang K, Rana F, Silva C, Ethier J, Wehrly K, Chesebro B, et al. Human immunodeficiency virus type 1 envelope-mediated neuronal death: uncoupling of viral replication and neurotoxicity. J Virol. 2003;77:6899–912.
Bachis A, Cruz MI, Mocchetti I. M-tropic HIV envelope protein gp120 exhibits a different neuropathological profile than T-tropic gp120 in rat striatum. Eur J Neurosci. 2010;32:570–8.
Hartley O, Klasse PJ, Sattentau QJ, Moore JP. V3: HIV’s switch-hitter. AIDS Res Hum Retroviruses. 2005;21:171–89.
Rossi F, Querido B, Nimmagadda M, Cocklin S, Navas-Martín S, Martín-García J. The V1-V3 region of a brain-derived HIV-1 envelope glycoprotein determines macrophage tropism, low CD4 dependence, increased fusogenicity and altered sensitivity to entry inhibitors. Retrovirology. 2008;5:89.
Albright AV, Shieh JT, Itoh T, Lee B, Pleasure D, O’Connor MJ, et al. Microglia express CCR5, CXCR4, and CCR3, but of these, CCR5 is the principal coreceptor for human immunodeficiency virus type 1 dementia isolates. J Virol. 1999;73:205–13.
Gorry PR, Taylor J, Holm GH, Mehle A, Morgan T, Cayabyab M, et al. Increased CCR5 affinity and reduced CCR5/CD4 dependence of a neurovirulent primary human immunodeficiency virus type 1 isolate. J Virol. 2002;76:6277–92.
Pillai SK, Pond SLK, Liu Y, Good BM, Strain MC, Ellis RJ, et al. Genetic attributes of cerebrospinal fluid-derived HIV-1 env. Brain. 2006;129:1872–83.
Holman AG, Gabuzda D. A machine learning approach for identifying amino acid signatures in the HIV env gene predictive of dementia. PLoS ONE. 2012;7:e49538.
Holman AG, Mefford ME, O’Connor N, Gabuzda D. HIVBrainSeqDB: a database of annotated HIV envelope sequences from brain and other anatomical sites. AIDS Res Ther. 2010;7:43.
Griffin TZ, Kang W, Ma Y, Zhang M. The HAND Database: a gateway to understanding the role of HIV in HIV-associated neurocognitive disorders. BMC Med Genomics. 2015;8:70.
Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc Ser B. 1995;57:289–300.
Shapshak P, Segal DM, Crandall KA, Fujimura RK, Zhang BT, Xin KQ, et al. Independent evolution of HIV type 1 in different brain regions. AIDS Res Hum Retroviruses. 1999;15:811–20.
Schnell G, Joseph S, Spudich S, Price RW, Swanstrom R. HIV-1 replication in the central nervous system occurs in two distinct cell types. PLoS Pathog. 2011;7:e1002286.
Duenas-Decamp MJ, Peters PJ, Burton D, Clapham PR. Determinants flanking the CD4 binding loop modulate macrophage tropism of human immunodeficiency virus type 1 R5 envelopes. J Virol. 2009;83:2575–83.
Bloch M, Kamminga J, Jayewardene A, Bailey M, Carberry A, Vincent T, et al. A screening strategy for HIV-associated neurocognitive disorders that accurately identifies patients requiring neurological review. Clin Infect Dis. 2016;63:687–93.
Krista J, Siefried BJB, Brew BJ, Siefried KJ, Draper B, Cysique LA. Is the HIV dementia scale a reliable tool for assessing HIV-related neurocognitive decline? J AIDS Clin Res. 2014;5:1–7.
INSIGHT START Study Group, Lundgren JD, Babiker AG, Gordin F, Emery S, Grund B, et al. Initiation of antiretroviral therapy in early asymptomatic HIV infection. N Engl J Med. 2015;373:795–807.
Smurzynski M, Wu K, Letendre S, Robertson K, Bosch RJ, Clifford DB, et al. Effects of central nervous system antiretroviral penetration on cognitive functioning in the ALLRT cohort. AIDS. 2011;25:357–65.
Vignuzzi M, Stone JK, Arnold JJ, Cameron CE, Andino R. Quasispecies diversity determines pathogenesis through cooperative interactions in a viral population. Nature. 2006;439:344–8.
Ogishi M, Yotsuyanagi H, Tsutsumi T, Gatanaga H, Ode H, Sugiura W, et al. Deconvoluting the composition of low-frequency hepatitis C viral quasispecies: comparison of genotypes and NS3 resistance-associated variants between HCV/HIV coinfected hemophiliacs and HCV monoinfected patients in Japan. PLoS ONE. 2015;10:e0119145.
Dunfee RL, Thomas ER, Gorry PR, Wang J, Taylor J, Kunstman K, et al. The HIV Env variant N283 enhances macrophage tropism and is associated with brain infection and dementia. Proc Natl Acad Sci USA. 2006;103:15160–5.
Pantophlet R, Wilson IA, Burton DR. Improved design of an antigen with enhanced specificity for the broadly HIV-neutralizing antibody b12. Protein Eng Des Sel. 2004;17:749–58.
Pantophlet R, Wrin T, Cavacini LA, Robinson JE, Burton DR. Neutralizing activity of antibodies to the V3 loop region of HIV-1 gp120 relative to their epitope fine specificity. Virology. 2008;381:251–60.
Pantophlet R, Aguilar-Sino RO, Wrin T, Cavacini LA, Burton DR. Analysis of the neutralization breadth of the anti-V3 antibody F425-B4e8 and re-assessment of its epitope fine specificity by scanning mutagenesis. Virology. 2007;364:441–53.
Kuwata T, Enomoto I, Baba M, Matsushita S. Incompatible natures of the HIV-1 envelope in resistance to the CCR5 antagonist cenicriviroc and to neutralizing antibodies. Antimicrob Agents Chemother. 2015;60:437–50.
Strain MC, Letendre S, Pillai SK, Russell T, Ignacio CC, Günthard HF, et al. Genetic composition of human immunodeficiency virus type 1 in cerebrospinal fluid and blood without treatment and during failing antiretroviral therapy. J Virol. 2005;79:1772–88.
R Core Team. R: a language and environment for statistical computing. Vienna: R Foundation for Statistical Computing; 2016.
Katoh K, Misawa K, Kuma K, Miyata T. MAFFT: a novel method for rapid multiple sequence alignment based on fast Fourier transform. Nucleic Acids Res. 2002;30:3059–66.
Kawashima S, Pokarowski P, Pokarowska M, Kolinski A, Katayama T, Kanehisa M. AAindex: amino acid index database, progress report 2008. Nucleic Acids Res. 2008;36:202–5.
Gentleman RC, Carey VJ, Bates DM, Bolstad B, Dettling M, Dudoit S, et al. Bioconductor: open software development for computational biology and bioinformatics. Genome Biol. 2004;5:R80.
Kuhn M. Building predictive models in R using the caret package. J Stat Softw. 2008;28:1–26.
Gu Z, Eils R, Schlesner M. Complex heatmaps reveal patterns and correlations in multidimensional genomic data. Bioinformatics. 2016;32:2847–9.
Gesmann M, de Castillo D. Using the google visualisation API with R. R J. 2011;3:40–4.
Di Giulio M. A comparison of proteins from Pyrococcus furiosus and Pyrococcus abyssi: barophily in the physicochemical properties of amino acids and in the genetic code. Gene. 2005;346:1–6.
Karplus PA, Schulz GE. Prediction of chain flexibility in proteins. Naturwissenschaften. 1985;72:212–3.
Bhaskaran R, Ponnuswamy PK. Positional flexibilities of amino acid residues in globular proteins. Int J Pept Protein Res. 2009;32:241–55.
MO and HY designed the study; MO performed data analyses, prepared figures and tables, and drafted the manuscript; MO and HY, wrote the manuscript. Both authors read and approved the final manuscript.
We thank Dr. Couture-Cossette for thoughtful comments.
The authors declare that they have no competing interests.
Availability of data and materials
The dataset and the scripts generated in this study are available as the R package HANDPrediction on GitHub (https://github.com/masato-ogishi/HANDPrediction). The entire analysis workflow is summarized as an HTML document (Additional file 2).
Ethics approval and consent to participate
This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.