For a list of all new, running, and completed ingestions navigate to Settings inline-svg-1 > Data Ingestion > Ingestions.

Ingestion details

The ingestion page offers the following information on individual ingestion jobs:

ColumnDescription
IDUnique ID of the ingestion. Click on it for a detailed log (see Ingestion log).
Data SourceName of the data source for which the ingestion was running.
ConnectionConnection used for ingestion.
SpaceTarget space for ingested data.
StateCurrent state of the ingestion. For a full list, see Ingestion states.
StartedWhen the Ingestion was started.
FinishedWhen the Ingestion was completed.
Data Source UUIDUnique ID of the related data source. You can use it as a reference to the Dawiso Integration Runtime instance for private connections.
Tip

For manually initiated ingestions, it may take some time before they become visible in the list.

Ingestion states

An ingestion goes through several phases. Load To MR Succeeded is the final state of a successfully completed ingestion.

StateDescription
NewIngestion was created and is waiting for processing.
ScheduledIngestion is scheduled for the next execution.
Ingestion RunningData is being extracted from the source system.
Ingestion SucceededExtraction of data from the source has been completed.
Ingestion FailedThere was an error reading data from the source (e.g., timeout or invalid credentials). Review the detailed ingestion log and correct the error if possible. For assistance, contact your Account Manager.
Processing RunningDawiso is cleaning, validating, and transforming the data obtained from the source.
Processing SucceededProcessing has been completed.
Processing FailedProcessing has failed. The support team will be notified automatically and will get in touch with you.
Transferring RunningIngested data is being moved to the staging area in your Dawiso instance.
Transferring SucceededTransfer of the data has been completed.
Transferring FailedTransferring data has failed. The support team will be notified automatically and will get in touch with you.
Load To MR RunningIngested data is being moved from the staging area to the target space (Metadata Repository). You can monitor the progress directly in the target space (see Monitoring the progress).
Load To MR SucceededIngestion has been completed successfully. The ingested metadata is up-to-date with the source and ready for documentation.
Load To MR FailedIngested data cannot be moved to the target space. The support team will be notified automatically and will get in touch with you.

Ingestion log

When you click on the ID of a selected ingesion, you will be redirected to its Ingestion log. Here, you will find all information, including error messages, for the ingestion.

Use this information to debug errors or optimize the speed and impact of the ingestion process.

The log provides the following information:

ColumnDescription
IDID of the log record.
TimestampData and time of the record.
Severity1 - Informative 2 - Warning 3 - Error
MessageDetailed information on specific actions.

Monitoring the progress

If there is an ingestion running into your space, there will be a % number next to your application’s name. Once finished or failed, it will be replaced with a green or red mark and a message.

Hover over the message:

  • For a quick overview of the ingestion process, including information on the ingestion start and finish times, and how many objects were inserted, updated, or deleted.

  • At the bottom of the overview popup, click the:

    • Show details button: For a detailed list of all ingestions.
    • Ingest button: Easily ingest data from the overview page without going to the settings.