Now that you have created a connection for your endpoint, you can create a sync.
Go to 'New Sync' to begin. Creating a sync is a four step process with sub-steps depending on your selections.
Select your target app from the list of installed plugins.
Select the connection that you configured previously.
Choose the sync direction. Omnata can sync data both Inbound to Snowflake and Outbound from Snowflake, but a sync only operates in one direction.
Configure the source.
For inbound syncs: the source will be objects in the connected app or database. You will select the objects to sync from the list.
For outbound syncs: the source will be Snowflake tables and views. You must grant the Omnata app access to source table(s).
Use the following commands to grant access to a source table:
grant usage on database <database_name> to application {app_database};
grant usage on schema <database_name>.<schema_name> to application {app_database};
grant select on table <database_name>.<schema_name>.<table_name> to application {app_database};You will need the MANAGE_GRANTS privilege to run these commands. If you do not have this privilege, you can:
Have an ACCOUNTADMIN to grant you access to the table(s).
Have an ACCOUNTADMIN grant you the MANAGE_GRANTS privilege.
Configure the sync. This is where you choose the sync behaviour. The exact behaviours that are supported are determined by the plugin. See Inbound Sync Strategies For inbound syncs, you will set how the selected objects are stored in the destination Snowflake table. Once the sync is running, inbound data is stored in the application database OMNATA_SYNC_ENGINE. The schemas INBOUND_RAW and INBOUND_NORMALIZED will contain raw and normalized data, respectively. There is a table for each stream (object) with the naming convention <sync-name>_main>. See Inbound Storage Location. For outbound syncs, you will create a mapping between your Snowflake table and the fields in the target app. See Outbound Sync Strategies and the section for each supported application.
Deploy the sync. Set the schedule to run the sync on or make the sync depend on another sync. To deploy with dbt, read dbt.
Hit 'Start sync' and it will save the configuration and run at the next scheduled time. You can trigger a run immediately on the Sync page > Status tab.
Last updated