options

The options property allows you to configure additional settings of the specified data source definition’s version.

Example JSON

{
    "batchSize": true,
    "convertBooleanToNumeric": true,
    "createChangeLogs": true,
    "createVersions": false
}

Nested properties: Options available to all providers

Property	Description	Values	Mandatory
batchSize	Size of a data extraction batch (number of rows per extraction).	integer	Yes
convertBooleantoNumeric	Converts boolean values to numeric format.	boolean	Yes
createChangeLogs	Determines whether a changelog, which records a list of all changes made, is maintained.	boolean	Yes
createVersions	Determines if versions of data source definitions are created and stored. Default value is false.	boolean	Yes
ingestionFormat	Format of the ingestion.	string	No

Provider-specific options

Below, you will find the list of settings that can be configured during data source creation in the UI depending on the provider.

The last column, Template, indicates which of these options need to be configured in the Additional Settings field in the last data source creation step (= they are NOT in the data source creation template).

dbt

Property	Description	Values	Mandatory	Default	Template
Account Id	dbt account ID.	string	Yes	-	Yes
Project Filter RegExp	List of projects to scan. Use regular expressions, e.g.,  Project 1	Project 2	Project 3.	string	No
Environment Filter RegExp	List of environments to scan.	string	No	-	Yes
Scan Only Production Deployment Type	Determines if only production environments are scanned.	boolean	No	-	Yes
Job Filter RegExp	List of dbt jobs to scan.	string	No	-	Yes
createChangeLogs	Determines whether a changelog, which records a list of all changes made, is maintained.	boolean	No	true	No
createVersions	Determines if versions of data source definitions are created and stored.	boolean	No	false	No

Google Big Query

Property	Description	Values	Mandatory	Default	Template
Datasets	List of databases to ingest.	array	Yes	-	Yes
batchSize	Size of a data extraction batch (number or rows per extraction).	integer	No	5000	No
convertBooleanToNumeric	Converts boolean values to numeric format.	string	No	true	No
createChangeLogs	Determines whether a changelog, which records a list of all changes made, is maintained.	boolean	No	true	No
createVersions	Determines if versions of data source definitions are created and stored.	boolean	No	false	No

Keboola

Property	Description	Values	Mandatory	Default	Template
Projects Filter RegExp	List of projects to scan. Use regular expressions, e.g.,  Project 1	Project 2	Project 3.	string	No
Include Lineage	Determines if lineages should be included.	boolean	No	false	Yes
createChangeLogs	Determines whether a changelog, which records a list of all changes made, is maintained.	boolean	No	true	No
createVersions	Determines if versions of data source definitions are created and stored.	boolean	No	false	No

Power BI

Property	Description	Values	Mandatory	Default	Template
Included Workspaces	List of integrated workspaces, separated by commas.	array	No	-	Yes
Excluded Workspaces	List of excluded workspaces, separated by commas.	array	No	-	Yes
Remove Empty Fields	Determines if empty fields should be removed.	boolean	No	-	Yes
Workspace Filter Expression	Case-sensitive filter. Use simple like-style expressions, e.g., %finance% to integrate all workspaces with “finance” in the name.	string	No	-	Yes
Workspace Filter Regular Expression	Full-featured regex-based filtering for more granular workspace name selection.	string	No	-	Yes
Workspace Types	Types of workspaces.	string	No	-	Yes
createChangeLogs	Determines whether a changelog, which records a list of all changes made, is maintained.	boolean	No	true	No
createVersions	Determines if versions of data source definitions are created and stored.	boolean	No	false	No
dataSetSchema	Extracts the schema of the dataset, including tables, columns, and data types.	boolean	No	true	No
dataSetExpressions	Extracts DAX expressions used in calculated columns, measures, and calculated tables.	boolean	No	true	No
dataSourceDetails	Extracts metadata about the underlying data sources (e.g., SQL Server, Snowflake, API connections) used in Power BI.	boolean	No	true	No
getArtifactUsers	Extracts user access permissions for datasets, reports, and workspaces.	boolean	No	true	No
lineage	Extracts data lineage information, showing how data flows from sources to reports and dashboards.	boolean	No	true	No
loadDatasetRefreshSchedule	Extracts the dataset refresh schedule, including frequency and last refresh details.	boolean	No	true	No
logResponses	Logs API responses related to the extraction process (useful for debugging).	boolean	No	-	No
usePowerBiAnalyticServer	Determines if Power BI’s internal analytic server is used to extract data	boolean	No	false	No

SQL providers (Amazon Redshift, SQL Server, MySql, Oracle, PostgreSQL, Snowflake)

Property	Description	Values	Mandatory	Default	Template
Databases	List of databases to ingest.	array	Yes	-	Yes
batchSize	Size of a data extraction batch (number or rows per extraction).	integer	No	5000	No
convertBooleanToNumeric	Converts boolean values to numeric format.	boolean	No	-	No
createChangeLogs	Determines whether a changelog, which records a list of all changes made, is maintained.	boolean	No	true	No
createVersions	Determines if versions of data source definitions are created and stored.	boolean	No	false	No

Tableau

Property	Description	Values	Mandatory	Default	Template
Download Images	Determines if images should be downloaded.	boolean	No	false	Yes
Ignored Projects	List of projects that should be ignored (not ingested).	array	No	-	Yes
createChangeLogs	Determines whether a changelog, which records a list of all changes made, is maintained.	boolean	No	true	No
createVersions	Determines if versions of data source definitions are created and stored.	boolean	No	false	No