NoDI : No-code Data Ingestion

A Metadata Driven Data Ingestion Framework

Data movement is an inevitable process in most organizations these days. With a huge surge in the amount and variety of data, an organization is not limited to having a single source and destination in its data pipeline. There will be (scenarios) various instances where source data arrives from multiple sources, then undergoes some transformation and gets transported (persisted) to one or more destinations. Litmus7’s Metadata Driven Data Ingestion Framework or NoDI, a no-code metadata-driven data ingestion framework makes these (scenarios) transitions easier. It is an innovative solution that streamlines the entire data movement and simplifies the data ingestion process. 

How does NoDI function? 

In NoDI, we have an easy-to-use user interface which will accept source and destination details and then register it as ingestion metadata. Apart from the source and destination details, there are options to provide scheduling and CDC details as well, to support incremental load. Once the metadata is registered, ingestion jobs can be triggered based on the requirement by passing the unique metadata identifier used during registration. This will thus facilitate seamless data movement ensuring fast, accurate, and consistent data movement from any source to any destination.

Key Features

 

The framework currently supports multiple source/destination types like local file system, RDBMS, Azure, AWS, and also supports multiple common file formats like csv, parquet, json, avro, xml.  

Value Benefits

  • Accurate and reliable data:  Ensures that all the information you’re working with is accurate and reliable, which enhances efficiency and faster data transfers.  
  • Enhanced agility : The ability to handle multiple sources and destinations makes it easier to access and analyze data, facilitating data driven decision making and enhanced business agility 
  • Speed and cost saving : Having all the data in one place speeds up processing times. With a no-code solution, the company can reduce development time and eliminate the need for costly custom ingestion solutions.  
Request a Meeting