Data lineage visualizes how different elements of a data structure are connected and how data flows between them. In Dawiso, information about object relations can be provided using several methods, depending on the underlying technology and customer preferences:

  • Platform-based ingestion: Metadata and lineage are extracted directly from supported platforms
  • Development framework: Information is collected from transformation tools like dbt or pipelines.
  • Script parsing: Lineage is derived by parsing scripts or queries
  • Manual input: Users define relations directly within Dawiso.

Platform-based ingestion

Some Metadata apps in support direct scanning of data flows from the underlying platform. When available, this is the most accurate and straightforward way to retrieve lineage, as the lineage data is automatically ingested during metadata extraction.

Tip

To learn which platforms support lineage ingestion, refer to the platform-specific documentation.

Development framework

When your organization uses development tools such as dbt, Dawiso can integrate with them to retrieve lineage information directly. While this requires connecting to a third-party tool, it typically offers high precision and aligns well with modern data engineering practices.

Script parsing

If no built-in platform support or development framework is available, Dawiso can obtain lineage by parsing SQL scripts used in your ETL/ELT pipelines (creating data loads and transformations). SQL script parsing is provided by a selection of third-party parsers with limitations based on script volume and complexity.

Parsing results (relations between objects and the relation type) are stored in a database.

Tip

Parsing is not enabled by default, it is a feature available for enterprise clients upon evaluation with our implementation team.

Contact our Customer Success team to assess feasibility if you wish to use parsing for lineage ingestion.

Supported technologies for parsing include:

Custom or client-provided parsers can also be supported upon request.

Manual input

If no automated options are available, you can also define lineage manually within Dawiso:

This method offers maximum flexibility, especially for documenting non-technical or conceptual lineage, though it requires more manual effort.