Part laboratory, part repository, the Edinburgh International Data Facility (EIDF) provides computational and storage services to support data-driven innovation for the Edinburgh and South-East Scotland region and beyond. Data science services: the laboratoryThe EIDF Data Service Cloud is designed to support data scientists, and data scientists are not (exclusively) programmers. The Data Service Cloud has to support a wide set of users, from the casual data browser to the hard-core machine-learning researcher. It also has to be flexible: tools for data science can and will change all the time.The Data Service Cloud provides a self-service catalogue for users to select their base virtual machine(s) and customise them with standard data science and engineering tools. It supports:Browser-based access. From Jupyter-notebook-style dynamic webpages to full virtual desktop interfaces – a computer desktop running inside your web browserCommand-line access: Traditional secure-shell login access for those comfortable with the Linux command lineAPI access: Direct programmatic access to openly accessible dataGPU hardware: Specialised processors for machine learning workloads.data hosting and preservation servicesData hosting and preservation services: the repositoryEIDF works with partners from the DDI Programme and beyond to store, preserve and make available digital data assets of all kinds. To guard against data loss, EIDF follows the 3-2-1 principle, with a layered approach to its data architecture and a redundancy-by-replication approach to data durability. EIDF maintains multiple copies of data objects as follows.Data Lake: two copies, one primary, one secondaryOnsite backup: one copyOffsite backup: at least one copy (see below).Safe Haven servicesEIDF provides Safe Haven services to health and government users, following best practice in independent governance and supporting the linkage of complex personal data for public benefit research and policy-making under national and regional safeguards. Safe haven services can also be created for organisations wishing to host and govern access to their data assets in a highly secure environment. Our Governance and Security section gives more information.Service catalogue and roadmapStandard servicesAvailabilityData Science Cloud Pre-configured analytics VMsQ3 2021High-performance Spark clusterQ4 2021High-performance R Studio clusterQ4 2021High-performance Jupyter clusterQ4 2021OpenStack IaaS2022Safe Haven Services Safe Haven cloud environmentQ4 2021Protected data access cloud environmentQ4 2021Data Access & Discovery Data catalogueQ2 2021Analytics-ready datasetsQ2 2021Data Hosting Long-term data hosting2022 High-Performance Computing Ultra2 large memory serviceQ2 2021Cerebras CS-1 serviceQ2 2021Archer2 UK Tier 1 serviceavailableCirrus Tier 2 serviceavailableBespoke Development & Project Services Data science developmentavailableApplications developmentavailableSystems developmentavailable Co-designed servicesIn productionNational Safe HavenTrusted research environment for approved public benefit research, operated on behalf of Public Health Scotland.https://www.isdscotland.orgAdministrative Data Research CentreSecure data hosting, linkage and analysis environment operated on behalf of the Scottish Government.https://www.scadr.ac.ukScottish Covid-19 Research DatabaseSecure data hosting, linkage and analysis environment supporting covid-19 research across Scotland and the UK. ISARIC4C research serviceSecure data hosting, linkage and HPC environment supporting covid-19 genetic research by the ISARIC4C consortium.https://isaric4c.netScottish Genome Partnership research serviceData hosting and HPC re-processing environment.www.scottishgenomespartnership.org Early-adopter interim service programme 2021In pre-production: co-designed services in operation, supported by projectsGlobal Open Finance Centre of ExcellenceSecure data hosting and analysis environment.www.globalopenfinance.comScotGov SPACeAnalytics workbench and confidential data workbench environments; public data hosting service.iCAIRD research serviceSecure data hosting and dissemination service for digital pathology research data.https://icaird.comData SlipStreamSatellite and EO data ingest, processing, hosting and dissemination services. In developmentActive projects for future servicesIoT data serviceData ingest and hosting services for the DDI Programme Internet of Things data network.http://iot.ed.ac.ukNational Collection of Aerial PhotographyData ingest and processing, data hosting and data dissemination services for Historic Environment Scotland.https://ncap.org.ukThe DataLochSecure data hosting and analysis environments for SE Scotland health and social care data.www.ed.ac.uk/usher/dataloch In planningFuture servicesResearch Data ScotlandScottish public sector research data catalogue; open and secure data hosting services.https://researchdata.scotSCONeScottish Ophthalmology Network data hosting and analysis services.http://www.ed.ac.uk/clinical-sciences/ophthalmology/sconeHDDISecure data hosting and analysis environment for the Human Dignity Data Institute.CMVM Data ConsolidationData hosting and discoverability across the University’s College of Medicine and Vet Medicine.www.ed.ac.uk/medicine-vet-medicine Links3-2-1 principle This article was published on Friday 24 November 2023
