The EMBL-EBI Job Dispatcher sequence analysis tools framework in 2024.
Madeira F, Madhusoodanan N, Lee J, Eusebi A, Niewielska A, Tivey ARN, Lopez R, Butcher S. · 2024
Read The EMBL-EBI Job Dispatcher sequence analysis tools framework in 2024. by Madeira F, Madhusoodanan N, Lee J, Eusebi A, Niewielska A, Tivey ARN, Lopez R, Butcher S. (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc11223882.txt.
Introduction
Madeira and colleagues describe updates to a European framework that runs sequence analysis tools in this 2024 paper. The EMBL-EBI Job Dispatcher lets scientists run popular bioinformatics applications without installing them. Free access comes through web pages and through program interfaces for automated use. The tools are woven into major resources such as UniProt, InterPro, and Ensembl Genomes.
Recent improvements include a brand new website and documentation, the authors report. Visualisations of results were enhanced, and job management was improved. Use of the service is rising notably from low- and middle-income regions, a trend the paper highlights. The framework covers a diverse range of sequence analyses, from similarity searches to protein feature scans. The authors present the update as keeping a heavily used community service current and reachable.
Catalog record
| CREATOR | Madeira F, Madhusoodanan N, Lee J, Eusebi A, Niewielska A, Tivey ARN, Lopez R, Butcher S. |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20 KB |
| LICENSE | CC BY 4.0 |
| RIGHTS | CC BY |
| SOURCE | Europe PMC |
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The EMBL-EBI Job Dispatcher sequence analysis tools framework in 2024 By Fábio Madeira, Nandana Madhusoodanan, Joonheung Lee, Alberto Eusebi, Ania Niewielska, Adrian R N Tivey, Rodrigo Lopez, Sarah Butcher Published in: Nucleic Acids Research DOI: 10.1093/nar/gkae241 ABSTRACT Abstract The EMBL-EBI Job Dispatcher sequence analysis tools framework (https://www.ebi.ac.uk/jdispatcher) enables the scientific community to perform a diverse range of sequence analyses using popular bioinformatics applications. Free access to the tools and required sequence datasets is provided through user-friendly web applications, as well as via RESTful and SOAP-based APIs. These are integrated into popular EMBL-EBI resources such as UniProt, InterPro, ENA and Ensembl Genomes. This paper overviews recent improvements to Job Dispatcher, including its brand new website and documentation, enhanced visualisations, improved job management, and a rising trend of user reliance on the service from low- and middle-income regions. INTRODUCTION The European Bioinformatics Institute (EMBL-EBI) is one of the world's leading sources of public biomolecular data (1). A wealth of deposition databases, experimental data archives, and added-value knowledge bases that provide annotation, curation, reanalysis, and integration of deposited data are provided by EMBL-EBI resources and portals. Data are made freely available for use by the scientific communities and serve as foundations for countless scientific studies, research programmes, external resources and applications. EMBL-EBI also provides access to software systems that can be downloaded and installed locally, as well as popular ‘on-demand’ bioinformatics services. Examples of such services include EBI Search (2), which provides a free text search and powerful cross-referencing engine powered by EMBL-EBI datasets, and the Job Dispatcher (JD) framework (2). JD is powered by the EMBL-EBI high-performance computing (HPC) infrastructure and provides integrated access to a comprehensive catalogue of bioinformatics applications and related dataset indices. The catalogue of tools includes some of the most popular powerhouses in bioinformatics, from pairwise- and multiple sequence alignment (MSA) tools, such as Clustal Omega (3), Kalign (4) and Mafft (5), sequence similarity search (SSS) applications, such as NCBI BLAST+ (6) and FASTA (7), tools for functional prediction and annotation such as InterProScan 5 (8) and HMMER 3 (9), RNA analysis tools such as R2DT (10), to sequence analysis utilities from the EMBOSS suite (11). JD applications can be freely accessed via webpage interfaces but also through OpenAPI-compliant Application Programming Interfaces (APIs). These APIs are integrated into popular EMBL-EBI resources such as UniProt (12), InterPro (13), ENA (14) and Ensembl Genomes (15). Sequence similarity search tools enable access to sequence indices covering reference proteomes and genomes, all the way to specialised datasets from major database resources hosted at EMBL-EBI. In this paper, we overview the recent improvements and updates made to the Job Dispatcher framework, highlighting JD’s brand new website and documentation and the increasing relevance of the service for users from low- and middle-income countries. NEW WEBSITE A brand new Job Dispatcher website is available at https://www.ebi.ac.uk/jdispatcher. The redeveloped website reorganises the tool and documentation pages and adds new features with an emphasis on enriching the experience for both new and advanced users. It utilises a contemporary frontend framework, following responsive design and high accessibility practices. It has been created as a separate frontend application integrating with the backend via JD’s REST API, as opposed to the previous model in which pages were generated server-side in the monolithic application. The new design allows for greater flexibility in the future development of both the frontend and the backend. Landing page The newly introduced landing page (see Figure 1), something that the previous version of the system was missing, offers a user-friendly user interface (UI) that simplifies the navigation of tools across tool categories. This page acts as a one-stop-shop page to access JD bioinformatics tools and results. In addition to expandable tool categories, a job retrieval by Job ID search field and a new recent jobs history view, allows users to search and quickly find their job results. The landing page displays the five most recent jobs allowing users to get instant access to their latest analysis. This page provides sections with relevant service updates and news, a list of JD collaborators and how to cite the service. [Figure: The Job Dispatcher website landing page is available at https://www.ebi.ac.uk/jdispatcher.] Your jobs A new ‘Your Jobs’ page provides a history of jobs recently launched by the user. All job IDs are listed for seven days, which matches how long the results are retained for retrieval from the server. It also gives improved information about the job status, which now distinguishes jobs in the HPC ‘queued’ and subsequent ‘running’ states, as well as ‘completed’ and ‘failed’. To improve the findability of individual job IDs, these can be filtered by tool name. Individual or even ‘all’ job IDs can be also removed from the list. Tool webforms To help users identify the most appropriate tool for their analysis, detailed tool descriptions are provided for each linked tool in tool category pages. The tool webforms UI were redesigned to improve the user experience (UX). Relevant information about tool parameters is now provided directly in the form via information popovers, which are displayed on mouse hovering. This information was previously provided via hyperlinks to external documentation pages, therefore simplifying page navigation and improving overall UX. Input validation is performed before job submission. An error message is provided in the webform if the required inputs are not provided or any parameter values are invalid. Result pages The result pages ‘look and feel’ were streamlined across the tools. Several improvements were introduced to all SSS result pages, including a new interactive summary table. The SSS hits can be easily selected and unselected. This enables, for example, downloading the chosen hit sequences in fasta format or launching an MSA tool such as Clustal Omega, using them as input directly from the summary table. Other features include showing or hiding sequence annotations and the hit-query pairwise sequence alignments. The table provides pagination by default, which improves the display of very long tables in the browser. ‘Organisms’ facets are also provided, allowing for quickly filtering the sequence hits by originating species. Table sorting, EBI Search (2) cross-references and hyperlinks to the relevant sequence resources are also provided. Interactive visualisations Several interactive visualisations are now available throughout the result pages of MSA and SSS tools. The Nightingale (16) MSA viewer is provided as the default view for MSA result pages (see Figure 2A). The MSA viewer provides zoom and navigation controls. It also provides alternative colouring scheme options and the corresponding colour legend. Interactive phylogenetic tree and dendrogram visualisations powered by phylotree.js (17) are also available (see Figure 2B). In addition to general zoom, the visualisation provides several interactive functions, including the selection of terminal, internal and incident branches, in addition to tree branch collapsing and re-rooting. New interactive visualisations are provided for SSS results. Interactive graphical representations of SSS tool outputs and functional predictions provided by InterPro (13) have been developed by us (https://github.com/ebi-jdispatcher/jdispatcher-viewers—see Figure 2C and D, respectively). These can be visualised by clicking on the ‘Visual Output’ and ‘Functional Predictions’ tabs of the SSS result pages, respectively, and provide toggleable colouring and prediction tracks. [Figure: Example interactive visualisations available from JD result pages: (A) MSA viewer; (B) phylogenetic tree viewer; (C) SSS visual output; (D)