📘Release History
V1.75
Created: 2024-04-23
Fixed an issue where id-only deletions in run results resulted in an empy record rather retaining the previous value of the record
Added cursor field and primary key field to the sync home page summary
V1.74
Created: 2024-04-22
Disabled client side encryption on plugin results stage, so that results can be streamed
If plugin application has been uninstalled, show a warning message when creating a new connection
V1.73
Created: 2024-04-17
Plugins are now provided with an internal stage to upload run results to
V1.72
Created: 2024-04-17
Fixed an error where ngrok resources are not cleaned up when connections are deleted
Fixed error that may occur when editing connections with ngrok tunnels
Removed the requirement that plugins return a list of errored streams from the SYNC_INBOUND operation. This simplifies deferring the operation to other languages like java.
V1.71
Created: 2024-04-10
ngrok tunnel limits can now be increased centrally by Omnata
V1.70
Created: 2024-04-10
Fixed an issue where an error occurs if an inbound stream does not report state before ending
Added support for ad-hoc consumer-facing functions that can be shipped with plugins and invoked using a connection slug
Fixed an issue where an error can occur when customizing streams
Fixed an issue where ngrok-based connections may display an error during initial creation
V1.69
Created: 2024-04-03
If the native app doesn't own an inbound raw table, it will no longer error on configuration save when attempting to run grant statements
V1.68
Created: 2024-03-28
When hovering on the help text for a custom cron schedule, a human readable description is now shown instead of the cron expression
All streamlit dependencies are now pinned to specific package versions, to ensure Anaconda availability
V1.67
Created: 2024-03-27
Fixed an issue where outbound sync pre-flight checks would fail due to source table not being quoted correctly
Provided a fallback configuration option for new streams when the plugin runtime is less than 0.3.19
Provided a maintenance process which deletes Sync Record State History older than a configurable number of days, to reduce storage costs at high record volume
Fixed an issue where outbound syncs could not have record transformation applied due to table names not being quoted
Created all Sequences with the ORDER attribute set, to ensure identifiers increment
Included the application's own database in the list of outbound source databases
Reverted the UI back to Streamlit 1.22.0
V1.66
Created: 2024-03-25
Fixed an issue where results deduplication did not work correctly for inbound syncs
Fixed an issue where the append storage behaviour would create duplicate records
V1.65
Created: 2024-03-25
During post run processing, added some exception logging logic so that transaction rollback errors don't cause the original error to be lost
V1.64
Created: 2024-03-22
On the Syncs list, custom schedules now display the cron string without needing to hover on the help text
Inbound syncs no longer offer a choice of Incremental or Full Refresh unless you choose the Customize option. Instead, Auto mode will choose incremental where possible, and fall back on full refresh.
Storage behaviour is still a choice, but it is now "Merge changes" or "Keep history" in the UI and an explanatory diagram is included.
For full refreshes, the term "Replace" has been deprecated in favour of "Merge"
Upgraded the UI to Streamlit 1.26.0
Fixed streamlit warning on pre-populated checkboxes on sync configuration forms
V1.63
Created: 2024-03-21
Syncs list now has a column for Sync Schedule
Fixed issue where multi-select dropdown with required value allowed the user to continue without any values selected
Added some extra columns to the SYNC_RUN view, relating to inbound record counts
Fix issue where deletion by criteria with the append storage behaviour could append multiple delete records for the same identifier
Added a button on the inbound sync run screen to refresh the list of streams
V1.62
Created: 2024-03-19
The total number of inbound records for a run is now logged pre and post deduplication. A warning is logged if deduplication removed records.
Fixed an issue with the new deletion functionality, where the new sync engine version was not compatible with older runtime versions
Fixed an issue where non-empty inbound runs were hidden by the "Hide empty completed runs" checkbox
V1.61
Created: 2024-03-17
After clearing state for an inbound sync, the table is truncated when applying the results for the next run
V1.60
Created: 2024-03-15
The "Append" inbound storage behaviour now only stores changed records, making it much more storage efficient when used with the Full Refresh strategy.
Inbound sync tables now contain a flag which indicates when the record has been deleted at the source. When using the Full Refresh strategy, this is maintained automatically via the absence of previous records.
Inbound sync tables now contain the run id that the most recent change for each record belongs to.
Plugins can now provide individual record deletions, and also deletions by criteria for inbound incremental syncs. This requires omnata-plugin-runtime version 0.3.15 or greater.
When processing results of inbound syncs at the end of the run, the engine will commit the data and latest state of each stream individually, so that if errors are encountered then progress is not lost.
When a sync runs for longer than its configured limit, it is assumed failed and can be re-ran. The previous run will be marked as failed when this occurs.
Sync run id is now included in event span attributes, to make it easier to filter event table queries
When comparing branch stream configurations, the stream state is no longer included in the comparison.
Fixed issue with Sync History tab where incomplete outbound syncs did not render correctly
Inbound stream cursor field now has the default value applied to it at initial sync creation, so that plugins don't need to check both values
Fully deprecated the internal Sync Run Log table in favour of event tables
V1.59
Created: 2024-03-07
Added the PLUGIN_UPDATE_API_CONFIGURATION stored procedure, which can reset the integrations and secret bindings for plugin udfs/procedures
Fixed Streamlit error when switching between full and incremental inbound sync strategy for a single stream
Provided a button in the Advanced area of Settings which re-binds all plugin integration and secret objects
Ensure default cursor field is applied for incremental syncs
Fixed issue where Streamlit could not show information about an SSL certificate because the pyopenssl library was no longer available
V1.58
Created: 2024-03-06
Fixed streamlit UI error on sync home screen when production connection is not yet configured for inbound syncs in branch mode
Fixed issue when nominating a production connection for inbound syncs
When presenting dbt model configuration for streams, handled the scenario where JSON schema is not available
Inbound stream schemas are now fetched when syncs or branches are created or updated, so that the schema is visible in the UI prior to the first run
V1.57
Created: 2024-03-06
In normalized views, object fields are now supported as columns
V1.56
Created: 2024-03-05
Fixed issue where refreshing inbound stream schemas manually resulted in an error
V1.55
Created: 2024-03-03
This is the first version to contain release notes.
Changes in this version:
Reset page number when stream search changes
Killing sync runs no longer attempts to kill the Snowflake query
Added a refresh button to the Syncs page
Inbound sync history is now paginated
Added a refresh button to the Connections page
Fixed error when recreating views for inbound syncs
Removed sync engine billing from daily billing run in preparation for switch to plugin-only billing
Added consumer facing views of internal app state
Last updated