Fusion Metadata Registry

SDMX Structural Metadata Registry

Fusion Metadata Registry is a free to use structural metadata registry for SDMX supporting EDI, SDMX 1.0, 2.0 and 2.1.

  • Structural Metadata Registry.
  • Author and maintain SDMX structures using the web user interface or programmatically through the REST API.
  • Data validation - validates that data files are correctly structured.
  • SDMX structure mapping - transform SDMX data to a different DSD and coding.
  • SDMX data conversion - convert data files between SDMX data formats and versions.
  • Download and install the Java web application, or deploy as a container.

Sponsored by the Bank for International Settlements

Download Free

Fusion Metadata Registry is 100% compatible with Fusion Registry 10 and shares many of its structural metadata features.
Function Feature Fusion Metadata Registry Fusion Registry 10
Internal Information Model SDMX 2.1
SDMX Input / Output Support SDMX-ML(1.0, 2.0, 2.1), SDMX-JSON(1.0), SDMX-EDI
Structural Metadata Management Author and maintain structural metadata using the web interface
Author and maintain structural metadata using FusionXL addin for Excel
ACID structure repository
Structural metadata import / export as SDMX
Structural metadata import / export as Excel
SDMX structures REST API
Structure storage (no limits)
Structure comparison
Structure validation on import
Structure referential integrity enforcement
Time dependant constraints
Structure-level validity
Item-level validity
Subscription / notification of changes to structures via email or HTTP POST
Structure update transaction journalling
Rollback structure changes to a specified journalled transaction
SDMX Structures Agency Schemes
Attachment Constraints
Categorisations
Category Schemes
Codelists
Concept Schemes
Data Consumer Schemes
Data Provider Schemes
Data Structure Definitions
Dataflows
Hierarchical Codelists
Metadata Structure Definitions
Metadataflows
Organisation Unit Schemes
Processes
Provision Agreements
Reporting Taxonomies
Structure Sets
Fusion Registry 'Extended' Structures Validation Schemes
Reporting Templates
Structural Metadata Storage Options MySQL
Oracle
Microsoft SQL Server
Identity and Access Management Microsoft Active Directory service integration
OpenLDAP directory service integration
Fusion Security directory service integration
Single-user mode (no directory service required)
Certificate authentication
Data Load From File or URL SDMX Data Formats (SDMX-ML, SDMX-JSON, SDMX-CSV, EDI)
Excel
Fusion CSV (non-SDMX variant)
Interactive data load using the web user interface
Interactive store (publish) of loaded data through the web user interface
Programmatic data load and store using the REST API
Plugin interface for adding custom data readers
Data Validation Structural compliance
Compliance of data values with the DSD
Compliance with constraint rules
Duplicate observations or series checks
Mandatory attributes
Validation Schemes - basic business rule validation expressions
Validation Schemes - advanced business rule validation expressions
Validation rules configuration - set what rules are applied and whether they prevent conversion or data publication
Plugin interface for adding custom validators
Data validation processing (load data, validate it against the defined structure and business rules, return a validation report plus valid and invalid series as separate output datasets)
Data validation REST API
VTL 2.0 Storage of VTL programs as SDMX structural metadata Unsupported in the current release
Execution of VTL programs for validation or transformation of data Unsupported in the current release
SDMX Structure Maps Concept Scheme Maps
Codelist Maps
Data Structure Maps
Dataflow Maps
Regex pattern mapping rules
N-to-N data maps
N-to-1 data maps
1-to-N data maps
1-to-1 data maps
Mapped Datasets Mapped Datasets (like SQL 'views', create new datasets in the statistical data warehouse by applying SDMX Structure Maps to existing datasets)
Data Transformation Data transformation processing (load data, transform it to a different structure using SDMX Structure Mapping and return the result)
Data transformation REST API
Data Conversion Between SDMX formats and versions (SDMX-ML, SDMX-JSON, SDMX-CSV, EDI)
From Excel Reporting Template to SDMX formats
Quick convert to SDMX-ML 2.1 Structure Specific format
Conversion to and from Fusion CSV (non-SDMX variant)
Conversion to and from Fusion Excel (non-SDMX variant)
Data Reporting Excel Reporting Templates - definition and generation
Excel Reporting Templates - validation and conversion of reported data
Excel Reporting Templates - load and storage of reported data
Content Security Structure creation and maintenance controls (Agency privileges)
Data load and modification controls (Data Provider privileges)
Data access controls at the dataflow, series or observation level
Structure access controls at the structure or item level
Auditing SDMX structure transaction auditing
User activity auditing
Enterprise Deployment Load balancer support (clustering multiple Registry instances behind a load balancer for resilience and load tolerance)
Apache Kafka Integration Kafka 'Structure Notification' Producer for publishing changes to structural metadata on a definable topic
Client-side API IM-JS JavaScript client-side programming library
SDMX-UI TypeScript client-side programming library (higher-level abstraction)
Command Line Interface Fusion Command Line Interface for managing structural metadata

What does Fusion Metadata Registry do?

Its primary function is a structural metadata registry to the SDMX 2.1 specification.

There are also a range of additional features to assist with metadata maintenance and data processing.

Key Features
SDMX structure storage
SDMX-ML 1.0,2.0,2.1, SDMX-JSON, SDMX-CSV and EDI
Support for all main SDMX artefacts including Data Structure Definitions, Dataflows, Codelists, Concepts, Constraints and Provision Agreements
Web user interface for authoring and maintaining structural metadata
FusionXL Excel addin support for browsing, authoring and maintaining structures
Data conversion between SDMX formats (XML, JSON, EDI, CSV)
Data transformation between DSDs and coding schemes using SDMX Structure Maps
Data Validation - check that data is compliant with the DSD and any reporting constraints
SDMX-compliant REST API for structures
Data transformation REST API
Data validation REST API
Automated generation of Excel spreadsheet data reporting forms using definable templates
Structure comparison – check for differences between two structures
Synchronisation of structural metadata between Fusion Metadata Registry installations
Subscription / notification of changes to structural metadata by email
Auditing – audit changes to structures and general user activity
Structure Rollback – rollback the Registry’s structural metadata content to a chosen point in time
Kafka integration – publication of changes to structural metadata on definable Kafka topics to which other processes can subscribe
Microsoft Active Directory support for user authentication and authorisation
Key use cases
Structural metadata management
  • Centralise and control structural metadata
  • Author and maintain structural metadata
  • Drive statistics production using centrally-controlled metadata
  • Provide an SDMX-compliant a REST structure API
Statistics production
  • Validate data for compliance with structural metadata, constraints and business rules (not VTL)
  • Execute complex data mapping (SDMX structure maps, not VTL)
  • Convert data between formats (convert between SDMX formats)
Data collection
  • Collect data using metadata-driven Excel forms
  • Map incoming data into standardised structures
Data reporting
  • Prepare SDMX data for reporting
  • Validate data for compliance with the data collector's specifications prior to reporting
Capacity and Limits
  • No fixed limits on the number of users
  • No fixed limits on the volume of structures

License Terms
Public license agreement

Support
Technical support contracts are available - please contact us for details.

Availability
Free for all.

A self-contained Fusion Metadata Registry image complete with a MySQL database suitable for testing, personal use and light production work loads.
1. Install Docker Desktop
Execute the following commands using the Windows Command App, Windows PowerShell, Linux terminal or Mac terminal.
2. Download the Fusion Metadata Registry Docker image
docker pull metadatatechnology/fmr-mysql:latest
3. Create a container called 'fmr'
docker container create --name fmr --publish 8080:8080 metadatatechnology/fmr-mysql:latest
4. Start the container
docker start fmr

Point your browser at http://localhost:8080

The container will take between 1 and 2 minutes to start - so be patient!

There is a single Root User Account:
Username: root
Password: password

Log in to administer the system, and create, load and maintain SDMX structures.

5. When finished - stop the container
docker stop fmr

More on Docker Hub.

Install on Windows, Linux or Apple Mac

Fusion Metadata Registry is a Java web applications that will run on most Windows, Linux or Apple Mac machines with a minimum of 4GB memory.

There are three key pre-requisities:

  • A Java Runtime Environment (JRE or JDK) - Amazon Corretto 8 is a good free-to-use choice
  • A Java web application server - we recommend Apache Tomcat 8.0, 8.5 or 9.0
  • A database service - MySQL, Oracle or SQL Server are supported

Take a look at the quick start guide

Quick Start Guide