This article was originally published in Microbiome and is being distributed by Global Biodefense under the terms of the Creative Commons Attribution 4.0 International License. The article is © The Author(s) 2018.
- Jacquelyn S. Meisel,
- Daniel J. Nasko,
- Brian Brubach,
- Victoria Cepeda-Espinoza,
- Jessica Chopyk,
- Héctor Corrada-Bravo,
- Marcus Fedarko,
- Jay Ghurye,
- Kiran Javkar,
- Nathan D. Olson,
- Nidhi Shah,
- Sarah M. Allard,
- Adam L. Bazinet,
- Nicholas H. Bergman,
- Alexis Brown,
- J. Gregory Caporaso,
- Sean Conlan,
- Jocelyne DiRuggiero,
- Samuel P. Forry,
- Nur A. Hasan,
- Jason Kralj,
- Paul M. Luethy,
- Donald K. Milton,
- Brian D. Ondov,
- Sarah Preheim,
- Shashikala Ratnayake,
- Stephanie M. Rogers,
- M. J. Rosovitz,
- Eric G. Sakowski,
- Nils Oliver Schliebs,
- Daniel D. Sommer,
- Krista L. Ternus,
- Gherman Uritskiy,
- Sean X. Zhang,
- Mihai Pop and
- Todd J. Treangen
The Mid-Atlantic Microbiome Meet-up (M3) organization brings together academic, government, and industry groups to share ideas and develop best practices for microbiome research. In January of 2018, M3 held its fourth meeting, which focused on recent advances in biodefense, specifically those relating to infectious disease, and the use of metagenomic methods for pathogen detection. Presentations highlighted the utility of next-generation sequencing technologies for identifying and tracking microbial community members across space and time. However, they also stressed the current limitations of genomic approaches for biodefense, including insufficient sensitivity to detect low-abundance pathogens and the inability to quantify viable organisms. Participants discussed ways in which the community can improve software usability and shared new computational tools for metagenomic processing, assembly, annotation, and visualization. Looking to the future, they identified the need for better bioinformatics toolkits for longitudinal analyses, improved sample processing approaches for characterizing viruses and fungi, and more consistent maintenance of database resources. Finally, they addressed the necessity of improving data standards to incentivize data sharing. Here, we summarize the presentations and discussions from the meeting, identifying the areas where microbiome analyses have improved our ability to detect and manage biological threats and infectious disease, as well as gaps of knowledge in the field that require future funding and focus.
- Pathogen detection
- Longitudinal analysis
Strong public health and biodefense research is essential for the prevention, detection, and management of biological threats and infectious disease. Over the last century, the focus of biodefense research has shifted in response to modern advances in biotechnology. Specifically, a biological revolution is underway, generating promising new gene editing and synthetic biology technologies that may transform modern medicine, but also present a threat to public health if misappropriated . As biotechnology becomes increasingly globalized, it is important that we establish new strategies and tools for infectious disease detection and surveillance that will help us protect against bioterrorism and manage disease outbreaks.
Rapid advances in next-generation sequencing (NGS) technologies have helped advance biodefense research by enabling the development of new methods for identifying and characterizing pathogens. Amplification and sequencing of the 16S rRNA gene allow for high-throughput detection of prokaryotic communities, while shotgun metagenomic sequencing approaches capture the composition and functional potential of multi-domain populations. Metagenomic analyses used for pathogen detection and identification are often time sensitive. The results help inform high-stakes decision-making, such as choosing an appropriate medical treatment, deciding if a food product should be recalled due to contamination, or determining if an area should be shut down due to a suspected act of bioterrorism. In addition, geospatial and temporal metagenomic analyses are essential for tracking the dynamic responses of microbial populations to changes in environmental or human health. However, improvements in precision, sensitivity, speed, cost, and accuracy of NGS and downstream analyses are necessary for effective utilization in biodefense research [2, 3, 4, 5, 6].
On January 10, 2018, the Mid-Atlantic Microbiome Meet-up (M3) organization held a conference aimed at understanding how the biodefense and pathogen detection fields are transformed by new biological and computational technologies. While biodefense was broadly discussed, the participants focused primarily on emerging infectious disease applications. The meeting took place in the STAMP Student Union at the University of Maryland campus in College Park. The M3consortium brings together microbiome researchers from different sectors to discuss challenges, develop standards and best practices, and help connect data generators with data analysts . The M3 community is constantly growing and, as of this publication, has 140 members from over 25 different institutions. The conference was attended by 67 participants from academia, government, and industry (Fig. 1), with expertise in areas such as biodefense, computer science, genomics, microbiology, and public health. There were two talks given by invited speakers, 15 oral presentations selected from submitted abstracts, and several posters displayed at the meeting (Additional file 1: Table S1) . Additionally, there were three interactive breakout sessions to address the challenges of the field and encourage networking (Additional file 1: Table S2). The event was sponsored in part by CosmosID, Inc., but they did not participate in the organization of the event nor in the selection of speakers and topics being discussed.
The tone for the meeting was set by the keynote address presented by Dr. Tara O’Toole, Executive Vice President of the non-profit strategic investor In-Q-Tel, Inc. Pointing to the problems in detection, containment, and treatment during the recent H1N9 pandemic and Ebola epidemic, Dr. O’Toole shared that current progress in the field is disappointing because biodefense is not a priority for any single government agency, funding support is irregular, and epidemics are becoming more common. Increasing international competition for biotechnology advancements and leadership make it even more important to stimulate progress.
Dr. O’Toole outlined several keys to innovation and policy, which were echoed by the presentations and discussions throughout the remainder of the meeting, including (1) the willingness to think anew, (2) development of new tools and instruments, (3) implementation of a technology-focused biodefense strategy, (4) delivery of near real-time situational awareness for existing epidemics by leveraging modern data analytics and networked communications, and (5) establishment of rich human networks and cross-sector partnerships between government agencies, the private sector, and academia.
We start by highlighting the key conclusions and recommendations identified by the participants in the meeting:
- 1. Sequencing-based assays frequently face challenges related to limits of detection and technical biases, and culturing or other enrichment strategies remain necessary in many applications. The accurate quantification of viable organisms or metabolic activity within complex metagenomic samples remains an open challenge that is unlikely to be solved through sequencing alone.
- 2. Current sample processing approaches tend to exclude viral and fungal/eukaryotic components of microbial communities. In the case of viruses, this problem is compounded by poor taxonomies and database resources.
- 3. Analytical approaches, community standards, and software for temporal data analysis have lagged behind the rapidly increased generation of such data.
- 4. Robust bioinformatics tools are critical for future progress. These tools must be developed to better match the needs of end users and must be subject to critical validation.
- 5. Data standards are essential for ensuring the quality and usefulness of shared datasets, but overly onerous reporting requirements discourage sharing. In cases where privacy is a concern, we must also develop solutions that allow for secure storage and processing of sensitive data.
These key recommendations are summarized in Table 1 and more extensively discussed below.
Outline of current research gaps and future goals discussed at the January 2018 M3 Meeting
Tracking microbial communities across time and topography (Key Conclusions 1 and 3)
Importance: studies incorporating temporal and/or spatial sampling allow us to detect important shifts in community dynamics
Application example: detecting the spread of infection in a hospital or of a pathogen contaminating crops and spreading food-borne illness
• Sequencing strategies are not able to quantify viable organisms (which is essential for biodefense applications)
• Lack of well-established statistical approaches for exploring longitudinal microbiome data
• Increased sample size makes these studies more expensive and harder to obtain sufficient statistical power for all subjects/time points/regions
• Collection, sequencing, and sharing of more time series datasets
• Development of statistical methods and tools to help analyze longitudinal and/or geospatial microbiome datasets
Looking beyond bacterial pathogens (Key Conclusion 2)
Importance: viral and fungal components of the microbiome are often under-explored, despite their potential implications in biodefense
Application example: better understanding the transmission of infectious viruses, like influenza
• Lack of a universally distributed marker gene (viruses)
• Difficult to obtain sufficient material from low biomass environments
• High levels of host contamination
• Incomplete databases
• More consistent database curation and maintenance (potentially incentivized financially or with publications)
• Improved gene function identification
Development and application of metagenomic analysis tools (Key Conclusion 4)
Importance: computational tools need to be developed to help improve the utility of high-throughput sequencing strategies for biodefense problems
Application example: improved metagenome assembly methods could better delineate between different strains of a pathogen in samples
• Tools for metagenome pre-processing, assembly, and binning are not always sensitive or fast enough for detection of pathogens in a sample
• As sequencing technologies advance, we need new tools to handle output from long- and short-read technologies, as well as single-cell metagenomics approaches
• Easy to install, open-access software with comprehensive documentation detailing best and worst use cases
• Defined metrics for critical assessment and validation of existing tools
• Software and database versions should be more consistently reported in the literature and preserved for future replication of analyses
Navigating the trade-off between speed and accuracy (Key Conclusion 4)
Importance: metagenomic analysis used for pathogen detection and identification are time-sensitive
Application example: deciding if a food product should be recalled due to contamination
• Current algorithms vary in speed and accuracy (often sacrificing one for the other)
• Large datasets, error-prone heuristics, and coarse resolution of k-mer-based methods present challenges
• Better documentation of available tools to help users optimize their software choice based on their available resources
• Improvements in sequencing technologies and tools/algorithms to improve both speed and accuracy
Storing and sharing data (Key Conclusion 5)
Importance: access to publicly available datasets will help in verification of results and advance of scientific knowledge. Scientists need to be encouraged to move their data out of private silos and into shared databases
• Not all data can be shared because it is important to protect personally identifiable information or intellectual property rights
• Lack of sufficient infrastructure or manpower to upload or store datasets at scale
• Defined quality standard to maintain usable, open repositories
• Improved ways for secure interrogation of genomic datasets that cannot be openly shared due to privacy regulations
Sequencing-based assays frequently lack sensitivity
While the biodefense community has benefited from high-throughput sequencing strategies, these methods are not always as sensitive as required. In some cases, culturing is still the most reliable method for detecting pathogens because standard sequencing pipelines are not always available, and achieving required sequencing depths may be cost-prohibitive. Dr. Sarah Allard (UMD SPH) shared her work from CONSERVE (Center of Excellence at the Nexus of Sustainable Water Reuse, Food, and Health), whose mission is to enable the safe use of non-traditional irrigation water sources on food crops . Dr. Allard used both culture-based and sequence-based methods to detect foodborne pathogens in water samples. She concluded that culture-based techniques are currently the most sensitive pathogen detection strategies and that sequencing analysis sensitivity and stringency vary strongly by method.
From a public health perspective, quantification of viable organisms contributing to disease is essential but cannot be achieved with metagenomic analysis alone. Culturing and other approaches are important for gaining insight into the metabolic activity of the microbes in a community . Additionally, researchers must often make a trade-off between the sensitivity of their detection methods and the computational costs of analyzing increasingly deep sequencing datasets. Even partial culturing of select organisms or samples can help shift this trade-off. As commented during a breakout session, “you can’t always sequence your way out of it.”
Few studies look beyond bacterial pathogens
Shotgun metagenomics and a decrease in the cost of DNA sequencing have enabled researchers to analyze the genetic potential of microorganisms directly from an environmental sample. However, the majority of microbiome and metagenome studies focus only on the prokaryotic component of the community, while few have explored the roles of fungi or viruses in these microbial communities. This is due, in large part, to limitations in resources, laboratory procedures, and in the case of viruses, the lack of a universally distributed marker gene. Additional barriers to mycobiome and virome studies include the ability to obtain sufficient material from low biomass environments, high levels of host contamination, incomplete databases, and a lack of available wet lab protocols and computational analysis pipelines. At the meeting, it was noted that central repositories for shared protocols do exist (e.g., protocols.io ), and a concerted effort in viral protocol sharing has been made by the Gordon and Betty Moore Foundation, which funds VERVE Net . Proposed goals to address other barriers included providing financial and/or publication incentives for database curation and maintenance and focusing work on gene function identification. Since the NCBI SRA already contains many metagenomic sequencing datasets, it may be worthwhile to identify novel fungal and viral genomes from existing datasets to optimize data usage, as this approach has been employed in previous studies of environmental viruses .
Despite the aforementioned barriers to fungal and viral metagenomics, additional research in this area can significantly contribute to biodefense. One such important topic is the spread of viral pathogens. Invited seminar speaker Dr. Don Milton (UMD SPH) presented his work on the transmission of the influenza virus in college dormitories . The Centers for Disease Control and Prevention (CDC) suggests that human influenza transmission mainly occurs by droplets made when people with flu cough, sneeze, or talk. However, Dr. Milton explained that dueling reviews have disputed the importance of airborne transmission [15, 16, 17, 18, 19, 20]. He presented NGS data showing that exhaled breath of symptomatic influenza cases contains infectious virus in fine particles, suggesting that aerosol exposures are likely an important mode of transmission.
Tracking microbial communities across time and topography
Temporal and biogeographic sequencing studies provide increased resolution of microbial community shifts. In the context of biodefense, this is important for detecting and containing outbreaks. Additionally, these studies provide insight into environmental changes, which may contribute to epidemics by causing shifts in disease vectors and/or spurring human migration to new regions or densely populated urban areas. Several presentations at the meeting shared spatiotemporal microbiome analyses of different environments. Dr. Sean Conlan (NIH, NHGRI) presented his work using metagenomics to study outbreaks of nosocomial infections and identified the transfer of plasmids from patients to the hospital environment [21, 22]. Gherman Uritskiy (JHU) and Dr. Sarah Preheim (JHU) used a combination of marker gene and metagenomics approaches to characterize the changes in environmental microbiomes in response to perturbations. Uritskiy studied halite endoliths from the Atacama Desert in Chile over several years and showed how they were significantly impacted by rainstorms. Dr. Preheim compared a biogeochemical model to microbial communities’ changes in a lake over the spring and summer to reveal the influence of energy availability on microbial population dynamics.
While time series datasets provide valuable information, they are much more difficult to analyze with current statistical methods and models than cross-sectional sampling strategies [23, 24]. Among other reasons, this is because it is difficult to identify the optimal sampling frequency, the compositional nature of microbiome data frequently violates assumptions of statistical methods, and the commonly available software tools are often insufficient for required complex comparisons. Addressing this, Dr. J Gregory Caporaso (NAU) presented QIIME 2 (https://qiime2.org) and shared his team’s QIIME 2 plugin, q2-longitudinal, which incorporates multiple methods for characterizing longitudinal and paired-sample marker gene datasets .
Development and application of metagenomic analysis tools is critical for progress
Computational methods required for metagenomic analyses include taxonomic abundance profiling, taxonomic sequence classification and annotation, functional characterization, and metagenomic assembly. Many of the presentations at the meeting shared new and/or improved tools for different aspects of microbiome studies. Victoria Cepeda (UMD) described how her tool, MetaCompass, uses reference genomes to guide metagenome assembly , and Gherman Uritskiy (JHU) presented his pipeline, metaWRAP, for the pre-processing and binning of metagenomes . Furthermore, Brian Ondov (UMD, NIH, NHGRI) shared his implementation of the MinHash containment estimation algorithm to screen metagenomes for the presence of genomes and plasmids . Data visualization is important for accurately interpreting microbiome data analyses, and Dr. Héctor Corrada-Bravo (UMD) demonstrated how to use his lab’s tool, Metaviz , for interactive statistical analysis of metagenomes.
Conventional metagenomic analyses often reflect the most abundant elements from a complex sample and cannot detect rare elements with confidence. Dr. Nicholas Bergman (NBACC) shared a more sensitive single-cell metagenomics approach that allows for increased detection of all elements of a community sample. Dr. Bergman’s talk also emphasized the necessity of improving sensitivity, preventing contamination, eliminating biases, and increasing efficiency for sequencing-based techniques.
Bioinformatics tools should better match the needs of end users
Many discussions at the meetings focused on how the field can optimize tool utility. It was agreed that scientists should always carefully evaluate the strengths and weakness of available methods, either via existing “bake-off” studies or through the available documentation, to ensure they are using the best tools to address their specific problem. Tool developers should disclose the limits of their methods and advise on the types of data their software is best suited to analyze. Developers should also work towards producing software that is easy to download and install, providing comprehensive documentation for their tools, and ensuring open access for the academic community. As a community, we should encourage that publications list not only cases and data types where methods perform best, but also where they underperform or even fail. Additional studies, like the Critical Assessment of Metagenome Interpretation (CAMI) [30, 31], Microbiome Quality Control project , or challenges run under the aegis of PrecisionFDA , should be conducted to help characterize the strengths and weaknesses of different approaches and evaluate their impact on data analysis and interpretation.
Some meeting attendees are currently contributing to these goals. Dr. Nathan Olson (UMD, NIST) presented his evaluation of different 16S rRNA marker gene survey bioinformatic pipelines using mixture samples. Additionally, Dr. Daniel Nasko (UMD) characterized how genomic database growth affects study findings, showing that different versions of the RefSeq database strongly influenced species-level taxonomic classifications from metagenomic samples . Because the version of software and databases used can significantly affect the findings, this information should be reported more consistently in the literature. Furthermore, we should consider strategies to preserve previous software and database versions to enable future replication of analyses.
Bioinformatics tools must better navigate the trade-off between speed and accuracy
Metagenomic analysis methods vary in the central processing unit (CPU) time, memory, and disk resource usage, and this is not always clearly reported in software publications. Additionally, method scalability relative to size or type of input data also varies considerably. Optimizing speed and accuracy is especially important for biodefense applications. For instance, improvements in NGS analysis allowing for collection and analysis of samples in a clinically relevant time frame can help effectively track hospital outbreaks and prevent the spread of infection . Furthermore, confidence in the accuracy of these analyses is required to execute appropriate plans of action and prevent panic. Recently, findings of Bacillus strains on the International Space Station that were genomically similar to pathogenic Bacillus anthracis required more detailed characterization to ensure that their presence was not a concern for the health of the crew [36, 37, 38]. B. anthracis was also initially reported to be found in the NYC subway system, along with Yersina pestis, the pathogen responsible for the plague . After public attention prompted further analysis, the authors found no evidence that these organisms were present and found no evidence of pathogenicity [40, 41], again highlighting the importance of careful evaluation and interpretation of results, especially those with severe public health consequences.
Many different strategies for speeding up analyses were discussed at the meeting, including hardware, software, and algorithm choice. Some hardware considerations for the speed of analyses include balancing CPUs with co-processors such as graphics processing units (GPUs) or field-programmable gate arrays (FPGAs), server configuration in terms of the amount of random access memory (RAM), or disk storage type and speed. Programs and algorithms vary in accuracy as well as ease of parallelization. Often a slower yet parallelizable algorithm is preferred to one that is not parallelizable. If a program supports parallelism, consideration should be given to the type of hardware required. For example, some available options include large multicore servers for multithreaded applications, cluster nodes for distribution of compute jobs, or cloud computing solutions. Other strategies might involve analyzing only a subset of the data or using a smaller, application-specific reference database.
Finally, strategies discussed for speeding up time-critical analyses included employing a multi-tiered approach (e.g., a quick first pass followed by more detailed analyses ) and considering the suitability of various sequencing platforms for certain applications. Interventions or optimizations were discussed with regard to their impact on analysis accuracy and interpretation of results. Preferred solutions are the ones that provide both the desired speed and accuracy, though more often than not there is a trade-off between the two. The optimal balance also depends on the use case. Assessment and validation methods are required to characterize a method’s speed and accuracy. It will be up to the subject matter experts to determine the desired accuracy level for each case and the extent to which they can sacrifice accuracy for speed.
Data needs to be moved out of private silos and into public repositories
Data sharing is continually a challenge that gets raised within the biological community, especially as DNA/RNA sequencing becomes more ubiquitous and tangible outside of core facilities . This challenge is prevalent across multiple scientific disciplines and was recently highlighted by the National Research Council as a priority for microbial forensics . There are numerous reasons data are not being shared, including the need to protect personally identifiable information or intellectual property rights prior to publication and the lack of sufficient infrastructure or manpower to upload at scale. However, leveraging this diversity and breadth of data will be important for an effective biodefense capacity, as well as other bioscience applications like healthcare, pharmaceuticals, agriculture, and industry. In order to incentivize data sharing, we need to evaluate and improve publicly available resources for storing and processing data.
Inherent altruism or obligation to share data should be met with as little friction as possible, and we need to incentivize openness. One incentive is academic credit through authorship on publications, though this will require combined efforts of researchers, journal editors, and funding agencies to better define what contributions constitute data authorship and what responsibilities data authors have [45, 46]. Another potential incentive is the availability of free software for data analysis and meeting participants debated the desirability and sustainability of service-based options (e.g., MG-RAST ) compared to user-installable software options (e.g., QIIME , mothur ). At the meeting, Dr. Nur A. Hasan (CosmosID, Inc.) highlighted the cloud-based metagenome tools and databases his company has to offer. There are also strong movements towards software sharing, such as the Astrophysics Source Code Library  and the Materials Resource Registry at NIST .
It is expected that some quality standard is needed to maintain usable, open repositories. Where that standard is set can affect how much data is shared. For example, a high bar may ensure high-quality sequences and comprehensive metadata but minimize sharing, while a lower quality bar will more likely move data out of silos. The solution may be a combination of repositories with varying standards or a single repository which allows for varying degrees of annotation completeness and allows the user to modify searches based on that feature. It is important to note that a single repository may be difficult to reliably curate and manage at scale. Another option is distributed but federated systems, like used by the US Virtual Astronomical Observatory . Groups like the Genomic Standards Consortium [53, 54] are working towards improving data quality by supporting projects such as Minimum Information about any Sequence (MIxS) , which establishes standards for describing genomic data and provides checklists to help with annotation. We need to build a community consensus on how much metadata is required to make reporting less onerous for data providers but ensure data usability by others in the field.
Incentivizing open data sharing should not be the only solution, as some sensitive data cannot be openly shared due to privacy regulations (e.g., human genomes and Health Insurance Portability and Accountability Act regulations). Other sectors, such as the financial industry, have long been working on solutions to enable storage, transit, and operations of protected data. These solutions include software-based approaches (e.g., homomorphic encryption, Yao’s protocol, secure fault-tolerant protocols, oblivious transfer) and hardware-based approaches (e.g., AES full disk encryption for data storage, Intel® Software Guard Extension for secure operations). Dr. Stephanie Rogers presented the GEMStone 2.0 project from B. Next, an IQT Lab, called SIG-DB, which explores homomorphic encryption and Intel Software Guard Extension (SGX) to securely search genomic databases . Early results of applying these solutions to biological data are promising and should be explored more fully.
Overall, this meeting successfully brought together scientists from academia, government, and industry to present their research and discuss how high-throughput genomics methods have stimulated interest and progress in biodefense and pathogen detection. Notably, meeting participants used NGS tools to identify the transfer of microbes from patients to their hospital environments, track the transmission of influenza in a community living space, study environmental shifts over time, and evaluate the safety of using non-traditional water sources on food crops. These studies, and others, have been partly driven by cheaper, more reliable sequencing technologies and improvements in computational analysis tools. Open-source software for sequence processing and quality control, taxonomic annotation, metagenomic assembly, and binning, and data visualization have been essential for growth. Continued development of these resources will result in significant scientific advances.
Despite this progress, there are several limitations to using NGS approaches for biodefense problems. First and foremost, sequencing methods are unable to accurately quantify viable organisms from metagenomic samples, which is essential for identifying potential threats to public health. Beyond that, applications for which NGS approaches are well-suited still present many challenges. Although sequencing costs are steadily declining, it remains expensive to process, computationally analyze, and store the increasingly large datasets that are generated. Confident detection of infectious, but potentially rare pathogens in a community often requires very deep sequencing, and scientists must make the appropriate speed, cost, and accuracy trade-offs to best answer their research questions. In many cases, sequencing experiments may need to be complemented with culturing, enrichment, or other targeted approaches. Because of these limitations, and others, researchers must be extremely careful when interpreting data to identify biothreats; reporting false positives without critical validation can have significant fiscal and public health consequences. Developing the capacity to identify not only when a potential pathogen is present but also at what levels it is actively contributing to an infectious disease will greatly improve our response to biothreats. Another area that requires further investigation is the detection of antimicrobial resistance. While only briefly highlighted in the meeting talks about influenza and nosocomial tracing, antimicrobial resistance poses a significant threat to public health and biodefense. Current metagenomic sequencing methods allow us to identify antimicrobial resistance genes from different environments; however, these techniques cannot determine whether these genes are actively being expressed and are currently not practical for wide-spread adoption in clinical settings .
To date, few microbiome studies have focused on viral and fungal/eukaryotic organisms, despite their potentially important community interactions and roles in pathogenesis. In order to generate relevant virome and mycobiome datasets, we must improve sample processing techniques and dedicate resources to effectively curate and maintain publicly available databases. We also need to develop advanced statistical toolkits for analyzing longitudinal studies. In general, tool developers should focus on creating user-friendly, adaptable resources, with comprehensive documentation and clear descriptions of default settings and optional parameters. These tools must be critically evaluated for their appropriate use cases; however, when looking for emerging threats, it will be necessary to develop validation approaches that do not require the use of gold standards.
In order to encourage additional growth, the greater scientific community should invest in expanding and enforcing clear standards for genomic datasets. If set appropriately, these standards will help incentivize data sharing and improve the quality and usability of public repositories. Additional focus should be on strengthening best practices and solutions for handling sensitive datasets that are subject to privacy regulations. Moving forward, active conversations between researchers and policymakers will be essential to expand and implement these ideas in biodefense.
- CBCB: Center for Bioinformatics and Computational Biology
- CONSERVE: Center of Excellence at the Nexus of Sustainable Water Reuse, Food, and Health
- CPU: Central processing unit
- FPGA: Field-programmable gate array
- GPU: Graphics processing unit
IQT: In-Q-Tel, Inc.
- JHU: Johns Hopkins University
- M3 : Mid-Atlantic Microbiome Meet-up
- NAU: Northern Arizona University
- NBACC: National Biodefense Analysis and Countermeasures Center
- NGS: Next-generation sequencing
- NHGRI: National Human Genome Research Institute
- NIH: National Institutes of Health
- NIST: National Institute of Standards and Technology
- RAM: Random access memory
- SPH: School of Public Health
- UMD: University of Maryland
We would like to thank all those who helped make this meeting a success, especially Barbara Lewis (UMD) who organized the administrative aspects of the program, and CosmosID, Inc. for funding the event. We would also like to thank Dr. Jayne Morrow and Dr. Robert Hanisch for providing helpful feedback on the manuscript.
Opinions expressed in this paper are the authors’ and do not necessarily reflect the policies and views of NIST or affiliated venues. Certain commercial equipment, instruments, or materials are identified in this paper in order to specify the experimental procedure adequately. Such identification is not intended to imply recommendations or endorsement by NIST nor is it intended to imply that the materials or equipment identified are necessarily the best available for the purpose. Official contribution of NIST; not subject to copyrights in the USA.
The meeting was supported in part by the Center for Health-related Informatics and Bioimaging, a Center organized under the MPowering the State Partnership between the University of Maryland Baltimore and College Park campuses. JSM, BB, VCE, MF, JG, KJ, NS, and MP were supported in part by grants to MP, including grant R01-AI-100947 from the NIH and grant IIS-1513615 from the NSF. DJN and TJT were supported in part by the FunGCAT program from the Office of the Director of National Intelligence (ODNI), Intelligence Advanced Research Projects Activity (IARPA), via the Army Research Office (ARO) under Federal Award No. W911NF-17-2-0089. HC was supported by the NIH, R01 grant GM114267. The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, of the ODNI, IARPA, ARO, or the US Government. The contributions of ALB, NHB, MJR, DDS, and SR were funded under Contract No. HSHQDC-15-C-00064 awarded by the Department of Homeland Security (DHS) Science and Technology Directorate (S&T) for the operation and management of the National Biodefense Analysis and Countermeasures Center (NBACC), a Federally Funded Research and Development Center. The views and conclusions contained in this document are those of the authors and should not be interpreted as necessarily representing the official policies, either expressed or implied, of the DHS or S&T. In no event shall DHS, NBACC, S&T, or Battelle National Biodefense Institute have any responsibility or liability for any use, misuse, inability to use, or reliance upon the information contained herein. DHS does not endorse any products or commercial services mentioned in this publication. JGC was supported in part by the National Cancer Institute of the National Institutes of Health under the awards for the Partnership of Native American Cancer Prevention U54CA143924 (UACC) and U54CA143925 (NAU) and by the National Science Foundation award 1565100. SC was supported by NIH Intramural Research. JD and GU were supported in part by the NSF, grant DEB1556574 to JD. BDO was supported by the Intramural Research Program of the National Human Genome Research Institute and National Institutes of Health and utilized the computational resources of the NIH HPC Biowulf cluster (https://hpc.nih.gov).
Availability of data and materials
TT and MP organized the meeting. JK, JSM, and DN reviewed abstracts, and SMR, NHB, and JD selected abstracts for the sessions they chaired. All listed authors contributed to the writing of the report or met at least one of the following requirements: they (1) gave an oral presentation, (2) presented a poster, and/or (3) attended and contributed to the interactive breakout sessions. All authors read and approved the final manuscript.
Table S1. Outline of oral presentations at the January 2018 M3 Meeting. Table S2.Outline of interactive breakout sessions at the January 2018 M3 Meeting.
The conference was partly supported through funding from CosmosID, Inc. The sponsor did not participate in the organization of the event or the selection of speakers and topics.
- Drew TW, Mueller-Doblies UU. Dual use issues in research – a subject of increasing concern? Vaccine. 2017;35:5990–4.View Article Google Scholar
- Gardy JL, Loman NJ. Towards a genomics-informed, real-time, global pathogen surveillance system. Nat Rev Genet Nature Publishing Group. 2018;19:9–20.View Article Google Scholar
- Robinson ER, Walker TM, Pallen MJ. Genomics and outbreak investigation: from sequence to consequence. Genome Med. BioMed Central. 2013;5:36.View Article Google Scholar
- Miller RR, Montoya V, Gardy JL, Patrick DM, Tang P. Metagenomics for pathogen detection in public health. Genome Med. BioMed Central. 2013;5:81.View Article Google Scholar
- Lipkin WI. The changing face of pathogen discovery and surveillance. Nat Rev Microbiol. 2013;11:133–41. https://www.ncbi.nlm.nih.gov/pubmed/23268232.View Article Google Scholar
- Forbes JD, Knox NC, Ronholm J, Pagotto F, Reimer A. Metagenomics: the next culture-independent game changer. Front Microbiol. Frontiers. 2017;8:1069.View Article Google Scholar
- Mid-Atlantic Microbiome Meet-up main groups.io Group [Internet]. [cited 2018 May 4]. Available from: https://m3.groups.io/g/main/.
- Winter 2018 Mid-Atlantic Microbiome Meetup Biodefense and Pathogen Detection Agenda [Internet]. [cited 2018 May 4]. Available from: https://cpb-us-e1.wpmucdn.com/blog.umd.edu/dist/d/418/files/2017/10/WinterM3_agenda_final-27afpqx.pdf
- CONSERVE: A Center of Excellence at the Nexus of Sustainable Water Reuse, Food, and Health, year 1 achievements (March 2016–February 2017) [Internet]. Available from: https://static1.squarespace.com/static/578101761b631b1a87aa0a3c/t/59f8f8e8e31d19ae528310e9/1509488877173/CONSERVE_annual_report.pdf
- Singer E, Wagner M, Woyke T. Capturing the genetic makeup of the active microbiome in situ. ISME J. Nature Publishing Group; 2017;11:1949–1963.View ArticleGoogle Scholar
- Teytelman L, Stoliartchouk A, Kindler L, Hurwitz BL. Protocols.io: virtual communities for protocol development and discussion. Plos Biol. Public Library of Science. 2016;14:e1002538.View ArticleGoogle Scholar
- VERVE Net [Internet]. protocols.io. Available from: protocols.io/g/verve-net.
- Paez-Espino D, Eloe-Fadrosh EA, Pavlopoulos GA, Thomas AD, Huntemann M, Mikhailova N, et al. Uncovering Earth’s virome. Nature Nature Research. 2016;536:425–30.View Article Google Scholar
- Yan J, Grantham M, Pantelic J, Bueno de Mesquita PJ, Albert B, Liu F, et al. Infectious virus in exhaled breath of symptomatic seasonal influenza cases from a college community. Proc Natl Acad Sci U S A. 2018;115:1081–6.View Article Google Scholar
- Killingley B, Nguyen-Van-Tam J. Routes of influenza transmission. Influenza Other Respir Viruses Wiley/Blackwell (10.1111). 2013;7(Suppl 2):42–51.View Article Google Scholar
- Tellier R. Aerosol transmission of influenza A virus: a review of new studies. J R Soc Interface The Royal Society. 2009;6(Suppl 6):S783–90.View Article Google Scholar
- Bridges CB, Kuehnert MJ, Hall CB. Transmission of influenza: implications for control in health care settings. Clin Infect Dis. 2003;37:1094–101.View Article Google Scholar
- Tellier R. Review of aerosol transmission of influenza a virus. Emerging Infect Dis Centers for Disease Control and Prevention. 2006;12:1657–62.View Article Google Scholar
- Lemieux C, Brankston G, Gitterman L, Hirji Z, Gardam M. Questioning aerosol transmission of influenza. Emerging Infect Dis. 2007;13:173–4 –authorreply174–5.View Article Google Scholar
- Brankston G, Gitterman L, Hirji Z, Lemieux C, Gardam M. Transmission of influenza A in human beings. Lancet Infect Dis Elsevier. 2007;7:257–65.View Article Google Scholar
- Conlan S, Park M, Deming C, Thomas PJ, Young AC, Coleman H, et al. Plasmid Dynamics in KPC-Positive Klebsiella pneumoniae during long-term patient colonization. mBio. 2016;7:e00742–16.View Article Google Scholar
- Weingarten RA, Johnson RC, Conlan S, Ramsburg AM, Dekker JP, Lau AF, et al. Genomic analysis of hospital plumbing reveals diverse reservoir of bacterial plasmids conferring carbapenem resistance. Bonomo RA, editor. mBio. American Society for Microbiology; 2018;9:e02011–e02017.Google Scholar
- Faust K, Lahti L, Gonze D, de Vos WM, Raes J. Metagenomics meets time series analysis: unraveling microbial community dynamics. Curr Opin Microbiol Elsevier Current Trends. 2015;25:56–66.View Article Google Scholar
- Gerber GK. The dynamic microbiome. FEBS Lett Wiley-Blackwell. 2014;588:4131–9.View Article Google Scholar
- Bokulich N, Zhang Y, Dillon M, Rideout JR, Bolyen E, Li H, et al. q2-longitudinal: a QIIME 2 plugin for longitudinal and paired-sample analyses of microbiome data. bioRxiv Cold Spring Harbor Laboratory. 2017:223974. https://doi.org/10.1101/223974.
- Cepeda V, Liu B, Almeida M, Hill CM, Koren S, Treangen TJ, et al. MetaCompass: reference-guided assembly of metagenomes. 2017. https://doi.org/10.1101/212506.
- Uritskiy GV, DiRuggiero J, Taylor J. MetaWRAP – a flexible pipeline for genome-resolved metagenomic data analysis. Microbiome. BioMed Central. 2018;6:158. Google Scholar
- Ondov BD, Treangen TJ, Melsted P, Mallonee AB, Bergman NH, Koren S, et al. Mash: fast genome and metagenome distance estimation using MinHash. Genome Biol. BioMed Central. 2016;17:132.View Article Google Scholar
- Wagner J, Chelaru F, Kancherla J, Paulson JN, Zhang A, Felix V, et al. Metaviz: interactive statistical and visual analysis of metagenomic data. Nucleic Acids Res. 2018;514:59.Google Scholar
- Sczyrba A, Hofmann P, Belmann P, Koslicki D, Janssen S, Dröge J, et al. Critical assessment of metagenome interpretation—a benchmark of metagenomics software. Nat Methods Nature Publishing Group. 2017;14:1063–71.View Article Google Scholar
- Bremges A, AC MH. Critical assessment of metagenome interpretation enters the second round. mSystems. Am Soc Microbiol J. 2018;3:537.Google Scholar
- Sinha R, Abu-Ali G, Vogtmann E, Fodor AA, Ren B, Amir A, et al. Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium. Nat Biotechnol Nature Publishing Group. 2017;35:1077.PubMed PubMed Central Google Scholar
- Altman RB, Prabhu S, Sidow A, Zook JM, Goldfeder R, Litwack D, et al. A research roadmap for next-generation sequencing informatics. Sci Transl Med American Association for the Advancement of Science. 2016;8:335ps10.View Article Google Scholar
- Nasko DJ, Koren S, Phillippy AM, Treangen TJ. RefSeq database growth influences the accuracy of k-mer-based species identification. bioRxiv. 2018. https://www.biorxiv.org/content/early/2018/04/19/304972, https://doi.org/10.1186/s13059-018-1554-6.
- Snitkin ES, Zelazny AM, Thomas PJ, Stock F, NISC Comparative Sequencing Program Group, Henderson DK, et al. Tracking a hospital outbreak of carbapenem-resistant Klebsiella pneumoniae with whole-genome sequencing. Sci Transl Med. American Association for the Advancement of Science. 2012;4:148ra116.View Article Google Scholar
- Venkateswaran K, Singh NK, Checinska Sielaff A, Pope RK, Bergman NH, van Tongeren SP, et al. Non-toxin-producing Bacillus cereus strains belonging to the B. anthracis clade isolated from the International Space Station. Bik H, editor. mSystems. 2017;2:e00021–e00017.Google Scholar
- van Tongeren SP, Roest HIJ, Degener JE, Harmsen HJM. Bacillus anthracis-like bacteria and other B. cereus group members in a microbial community within the International Space Station: a challenge for rapid and easy molecular detection of virulent B. anthracis. Schuch R, editor. PLoS ONE. Public Library of Science; 2014;9:e98871.Google Scholar
- Venkateswaran K, Checinska Sielaff A, Ratnayake S, Pope RK, Blank TE, Stepanov VG, et al. Draft genome sequences from a novel clade of Bacillus cereus sensu lato strains, isolated from the International Space Station. Genome Announc. American Society for Microbiology Journals. 2017;5:e00680–17.Google Scholar
- Afshinnekoo E, Meydan C, Chowdhury S, Jaroudi D, Boyer C, Bernstein N, et al. Geospatial resolution of human and bacterial diversity with city-scale metagenomics. CELS Elsevier. 2015;1:1–16.Google Scholar
- Ackelsberg J, Rakeman J, Hughes S, Petersen J, Mead P, Schriefer M, et al. Lack of evidence for plague or anthrax on the New York City subway. CELS. 2015;1:4–5.Google Scholar
- Afshinnekoo E, Meydan C, Chowdhury S, Jaroudi D, Boyer C, Bernstein N, et al. Modern methods for delineating metagenomic complexity. CELS. 2015;1:6–7.Google Scholar
- Bazinet AL, Ondov BD, Sommer DD, Ratnayake S. BLAST-based validation of metagenomic sequence assignments. PeerJ. PeerJ Inc; 2018;6:e4892.Google Scholar
- Langille MGI, Ravel J, Fricke WF. “Available upon request”: not good enough for microbiome data! Microbiome. BioMed Central. 2018;6:8.Google Scholar
- National Research Council. Science needs for microbial forensics. Developing initial international research priorities. Washington: National Academies Press; 2014.Google Scholar
- Bierer BE, Crosas M, Pierce HH. Data authorship as an incentive to data sharing. N Engl J Med. 2017;376:1684–7.View Article Google Scholar
- Credit for Data Sharing [Internet]. 2018 [cited 6 Aug 2018]. Available from: https://www.aamc.org/initiatives/research/485818/datasharing.html
- Meyer F, Paarmann D, D’Souza M, Olson R, Glass EM, Kubal M, et al. The metagenomics RAST server – a public resource for the automatic phylogenetic and functional analysis of metagenomes. BMC Bioinformatics. BioMed Central. 2008;9:386.View Article Google Scholar
- Caporaso JG, Kuczynski J, Stombaugh J, Bittinger K, Bushman FD, Costello EK, et al. QIIME allows analysis of high-throughput community sequencing data. Nat Methods. 2010;7:335–6.View Article Google Scholar
- Schloss PD, Westcott SL, Ryabin T, Hall JR, Hartmann M, Hollister EB, et al. Introducing mothur: open-source, platform-independent, community-supported software for describing and comparing microbial communities. Appl Environ Microbiol American Society for Microbiology. 2009;75:7537–41.View Article Google Scholar
- ACSL.net [Internet]. [cited 2018 Aug 6]. Available from: http://ascl.net
- Materials Resource Registry [Internet]. [cited 2018 Aug 6]. Available from: https://materials.registry.nist.gov
- Hanisch RJ, Berriman GB, Lazio TJW, Emery Bunn S, Evans J, McGlynn TA, et al. The virtual astronomical observatory: re-engineering access to astronomical data. Astron Comput. 2015;11:190–209.View Article Google Scholar
- Field D, Sterk P, Kottmann R, De Smet JW, Amaral-Zettler L, Cochrane G, et al. Genomic standards consortium projects. Stand Genomic Sci Michigan State University. 2014;9:599–601.View Article Google Scholar
- Field D, Amaral-Zettler L, Cochrane G, Cole JR, Dawyndt P, Garrity GM, et al. The Genomic Standards Consortium. Plos Biol. Public Library of Science. 2011;9:e1001088.View Article Google Scholar
- Yilmaz P, Kottmann R, Field D, Knight R, Cole JR, Amaral-Zettler L, et al. Minimum information about a marker gene sequence (MIMARKS) and minimum information about any (x) sequence (MIxS) specifications. Nat Biotechnol Nature Publishing Group. 2011;29:415–20.View Article Google Scholar
- Titus AJ, Flower A, Hagerty P, Gamble P, Lewis C, Stavish T, et al. SIG-DB: Leveraging homomorphic encryption to securely interrogate privately held genomic databases. Markel S, editor. PLoS computational biology. Public Library of Science. 2018;14:e1006454.Google Scholar
- Ellington MJ, Ekelund O, Aarestrup FM, Canton R, Doumith M, Giske C, et al. The role of whole genome sequencing in antimicrobial susceptibility testing of bacteria: report from the EUCAST subcommittee. Clin Microbiol Infect Elsevier. 2017;23:2–22.View Article Google Scholar