Integrate.io logo

Integrate.io Release Notes & Product Updates

An overview of the latest updates and product improvements. Got a product update or feature you'd like to see supported? Let us know - support@integrate.io

May 2026: New Connectors, Smarter Notifications & Expression Functions

ETL & Reverse ETL
May's release cycle focused on expanding connector coverage, adding text and date normalization functions to the expression editor, and tightening notification control across workspaces and packages.

Introducing Service Hook Filters
Service hook notifications can now be scoped to specific packages and workspaces, so users receive alerts only for the work relevant to them. The hook filter editor includes a scope picker, improved loading for large accounts, and accurate match counts during search - making it practical to manage notifications even in accounts with hundreds of packages.

New Zendesk Connector
The ETL platform now supports Zendesk as a source, letting users extract tickets, users, and organizations via OAuth - with automatic token refresh and support for both full and incremental load. Teams that rely on Zendesk for customer support workflows can now pull that data directly into their pipelines without manual exports.

New Features
  • INITCAP(): A new expression editor function capitalizes the first letter of each word in a string and lowercases the rest, covering a common text normalization step that previously required custom transformations.
  • NormalizePhone(): Standardizes phone numbers into E.164 format, handling a wide range of input formats and providing configurable behavior for invalid numbers - removing the need for manual cleaning logic in pipelines that ingest contact data.
  • NormalizeDate(): Accepts datetime inputs and returns the date portion, validating against multiple formats so users can reliably extract dates from mixed-format fields without writing custom expressions.
  • NormalizeLanguage(): Normalizes language codes in the expression editor, expanding the set of standardization tools available when working with localization or audience data.
  • Excel Sheet Selection for Large File Ingestion: When the "ingest large Excel file" option is enabled, users can now specify which sheet to load, supporting workbooks where the target data is not on the default sheet.
  • Inline SFTP Key per Connection: Each SFTP connection can now carry its own Ed25519 key pair inline, giving users connection-level key management without relying on shared credentials.
  • Create New Option in Cluster and Connection Pickers: Dropdowns for cluster and connection selection in the Job form and component editors now include a "Create new" option, letting users add a resource without leaving the current context.
  • Package Variable Persistence: Saving package variables now immediately persists them to the database and triggers draft validation, so newly added variables are recognized in the package without requiring an additional save cycle.

Improvements
  • The Mouseflow connector has been updated to move the website ID input from the connection form into the source component, aligning configuration with where it is most relevant.
  • Gmail source now extracts full email bodies, replacing the previous snippet-only behavior and supporting a dedicated "Email body" field option for ingesting content without attachments.
  • The Snowflake connection form has been updated from Account identifier to Account locator, reflecting the current Snowflake authentication model and reducing configuration errors.
  • Azure REST API pagination is now supported for the management.azure.com endpoint, enabling reliable ingestion of paginated Azure resource data.
  • AI error summaries now anchor on the deepest root cause in stack traces rather than the first exception, producing cleaner, more actionable explanations for Salesforce timeouts, S3 access errors, schema mismatches, and cluster failures.
  • The Package Designer now opens the relevant component editor when a user clicks on an error in the Package Errors panel, reducing the steps needed to navigate from an error to the fix.

Fixes
  • Component previewer row ordering now matches schema preview ordering.
  • Sort and Window components now return rows in the correct sequence during preview.
  • Window component no longer adds "stitched::" prefixes to field names in the component previewer.
  • Limit component previewer now works correctly.
  • Window and Union component validation no longer incorrectly disables save and preview buttons after input updates.
  • Universal OAuth connector reconnection for Google OAuth now works correctly - missing parameters that previously broke the request have been restored.
  • Facebook Ads destination now shows the correct operation type options for the Customers object when reopening a saved configuration.
  • AI Assistant popup no longer appears behind the expression editor and other modals.
  • Expression Console search in the functions popup now returns correct results.
  • Multi-line CSV parsing in Cloud Storage and SharePoint sources now works correctly when a text qualifier (" or ') is set.
  • Google Sheets source headers containing commas or newlines no longer shift downstream columns, and duplicate-header columns now render their values correctly.
  • Renaming a workspace no longer incorrectly updates the Last Modified date on every package inside it.
  • Salesforce proxy traffic now routes through the correct region for proxy-enabled accounts.

Performance Enhancements
  • The hook filter editor now uses lazy loading for package and workspace lists, reducing memory usage and keeping the UI responsive in large accounts.
  • JSON extraction functions have been optimized to handle a wider range of data types more efficiently, reducing processing overhead for pipelines that work with complex nested structures.

Keep exploring what shipped this month - there's a lot in here, and we'd love to hear what's making a difference for your team.

3 days ago

May 2026: Auth0 SSO, Salesforce Formula Sync & Ad Reporting

ELT & CDC
May's release cycle focused on deepening ad platform reporting coverage, expanding Salesforce sync control, and hardening pipeline reliability across connectors and notification workflows.

Introducing Auth0 SSO
Users can now sign in via SSO using Auth0, and organization admins can configure SSO and enforce IdP-only logins for their accounts, also giving teams a centralized, secure authentication path without managing individual credentials.

Salesforce Formula Field Sync
Salesforce formula fields can now be synced either globally for the entire source or on a per-table basis, giving teams granular control over which calculated fields are included in their pipelines. Formula fields are clearly marked in the UI, so users can identify and configure them without additional documentation lookups.

New Features
  • Snowflake Custom Host: Users can now specify an optional custom Snowflake host when configuring a Snowflake destination: supporting non-standard deployments and use cases like those of Yuki Data, a partner who's focused on optimizing data warehouse cost and spend on a custom Snowflake setup.
  • Google Ads Time-Variant Keyword and Budget Reports: Five new KEYWORDS_PERFORMANCE_REPORT streams (daily, weekly, monthly, quarterly, and yearly) are now available, along with a new BUDGET_PERFORMANCE_REPORT_BY_CAMPAIGN collection, making time-segmented keyword and budget data accessible for more granular paid-search analysis.
  • Google Ads All-Time Metrics Collection: A new `_TIMES` collection is now available for every Google Ads report, consolidating all-time aggregated metrics alongside the existing time-windowed streams - removing the need to union multiple reports to get full-range totals.
  • TikTok Ads Expanded Field Coverage: A broad set of additional fields is now available on ad_groups, ads, campaigns, creative_assets_videos, and pixels collections, with metrics and dimensions exposed on most report collections and dimension and metric selections persisted across sessions.
  • Destination Column Default Preservation: Existing column defaults on Redshift and Snowflake destination tables are no longer overwritten during pipeline runs, protecting intentional database-level defaults from being cleared by sync operations.

Improvements
  • When new tables are added to a Salesforce V2 source, their incremental replication key and streaming support are now saved automatically, so incremental syncs and streaming options work correctly for newly added tables without additional configuration.

Fixes
  • Chunking issue on composite string primary keys that could cause rows to be missed or duplicated during chunk-based syncs - now resolved.
  • Snowflake configuration validation no longer rejects pipelines where the custom host field is unset, allowing existing Snowflake pipelines to start normally.
  • PostgreSQL 14+ tables that had not been analyzed no longer stall on resync - reliable initial sync behavior has been restored.
  • Pipeline hooks no longer send duplicate email notifications when the same hook is attached to multiple pipelines.
  • Enterprise SAML users are no longer blocked at login when their identity provider does not set the `email_verified` attribute.
  • Data Observability sync lag alert no longer triggers a false positive when a sync returns no data.

Performance Enhancements
  • DB2 and BigQuery connectors now support parallel chunk workers for initial sync, splitting large tables across concurrent threads and reducing time-to-first-value when onboarding new sources or backfilling historical data.

Let us know what you think of these updates - your input shapes what we build next.

3 days ago

April 2026: Real-time Package Validation & New Connectors

ETL & Reverse ETL
April's release cycle focused on tightening the package authoring loop, expanding connector coverage across CRM and analytics tools, and hardening the platform's secure-access options.

Real-time Package Validation
Package Validation now runs continuously inside the Package Designer, with a status section in the toolbar that reflects the current state of the package as you edit. Auto-validation triggers on component changes without requiring a save, and a new two-tier classification separates 'to configure' warnings from genuine errors so users can see what is actually blocking a run versus what is still in progress.

REST API Connections via SSH Tunnel
A new connection type routes REST API traffic through an SSH tunnel, letting users reach private APIs that sit behind a firewall without exposing them to the public internet. The connection is configured through the standard form and works with existing REST API source, removing the need for custom networking workarounds when integrating with internal services.

Refreshed Package Designer
The Package Designer now ships dedicated components for each database and file storage connection type, replacing the generic Database and File Storage entries on the components list.

New Connectors
  • Stripe Source Connector: Pull payments, subscriptions, customers, and invoices directly from Stripe into the warehouse, giving finance and revenue teams a single source for billing analytics, churn modeling, and reconciliation against the general ledger.
  • SugarCRM Source Connector: Bring accounts, contacts, opportunities, and custom modules from SugarCRM into downstream pipelines, so revenue teams can build pipeline forecasts, attribution models, and customer 360 views without exporting from the CRM by hand.
  • ServiceNow Source Connector: Move incidents, change requests, and service catalog data from ServiceNow into the warehouse, letting IT and operations teams report on SLA performance, ticket volume trends, and team workload alongside the rest of the business.
  • Kantata Source Connector: Pull project, resource, and financial data from Kantata into the warehouse, giving services and PMO teams the inputs they need to track utilization, project profitability, and forecast capacity.
  • Klaviyo Source Connector: Ingest campaign, flow, and subscriber engagement data from Klaviyo, so marketing teams can attribute revenue back to specific sends and join email behavior with web and purchase data already in the warehouse.
  • Mouseflow Source Connector: Bring session replay and heatmap analytics from Mouseflow into pipelines, letting product and growth teams join behavioral signals with conversion data to understand where users drop off and which experiments are working.
  • Crisp Source Connector: Ingest conversation, contact, and helpdesk data from Crisp, so support and product teams can analyze response times, surface recurring issues, and tie customer questions back to product usage.

New Features
  • Postgres JSON Column Support: Postgres destinations can now write directly into JSON columns, removing the need to serialize JSON payloads as text and parse them downstream.
  • Postgres Staging Schema Configuration: Users can now configure staging tables to be created in the destination's target schema instead of the public schema, avoiding permission failures on locked-down databases.
  • REST API String Unwrapping: The REST API source now offers an option to unwrap extracted string values, returning plain strings instead of JSON-quoted strings for downstream consumption.
  • REST API Destination Request Throttling: A configurable sleep interval between requests has been added to the REST API destination, letting users stay within rate limits on target APIs without external throttling.

Improvements
  • The AI Assistant has been migrated to a new engine, providing in-product help that is based on our live product documentation pages.
  • Source component field aliases now consistently replace spaces and special characters with underscores during schema import, producing predictable column names regardless of the upstream field naming convention.
  • The cURL import parser in the REST API source and Expression Editor now recognizes the `--url` flag, so commands copied from a wider range of tools parse correctly without manual editing.
  • The Data Previewer now shows a human-readable timestamp tooltip when hovering over Unix datetime fields, removing the need to convert epoch values manually while inspecting data.
  • Test Connection error messages on connection forms now persist until explicitly dismissed instead of disappearing automatically after seven seconds, giving users time to read and act on the diagnostic.
  • Job error logs and component preview error output have been trimmed to remove stack traces and internal noise, surfacing the operator-relevant message instead of a wall of text.
  • The File Source components now truncate oversized data previews to keep the application responsive when working with very large files.

Bug Fixes
  • Fixed an issue in the SFTP source where seeking inside SFTPInputStream caused records to be silently dropped from the output.
  • Fixed Excel ingestion so that blank cells are treated as null instead of empty strings, matching expected behavior in downstream type-sensitive operations.
  • Fixed `_WORKFLOW_PACKAGE_LAST_SUCCESSFUL_JOB_SUBMISSION_TIMESTAMP` to return the parent workflow's last successful timestamp for sub-packages, where it had previously returned empty.
  • Fixed an issue where Dynamics and SharePoint connectors did not refresh access tokens automatically, causing long-running jobs to fail mid-run.
  • Resolved a scheduler issue where DST offsets were applied incorrectly, shifting scheduled runs by an hour at transition boundaries.

Performance Enhancements
  • Excel file previews from SFTP sources have been optimized to handle larger files without timing out, restoring the previewer's usefulness on multi-megabyte spreadsheets.
  • The File Uploader has been reworked to handle large-size files reliably, eliminating failures that previously occurred above certain size thresholds for some file types.

Alongside this release, our fully updated documentation is now live, with refreshed content and improved accessibility throughout. For quick lookups while you work, use the Ask Assistant button at the top of the UI to surface answers without leaving the tool.

Have a look at what shipped this month and let the team know which improvements are landing well in your day-to-day work.
about 1 month ago

April 2026: Parallel Workers, DB2 Controls, and Analytics Enhancements

ELT & CDC
April's release cycle focused on accelerating initial syncs, expanding ad and analytics coverage, and tightening reliability across long-running CDC pipelines.

Introducing Parallel Workers for Initial Sync
Initial syncs from MySQL, PostgreSQL, Snowflake, and Redshift sources now run with parallel chunk workers, splitting large tables across multiple concurrent threads. The result is materially faster time-to-first-value when onboarding new sources or backfilling history, particularly on wide tables and large row counts where initial sync used to be the bottleneck before incremental CDC could take over.

New Features
  • Custom Table List Fetch for DB2: Users can now select specific tables when configuring a DB2 source instead of pulling the full catalog at connection time, eliminating the schema-fetch timeouts that previously blocked setup against databases with very high table counts. This option is currently feature-flagged and off by default.
  • ELT-to-ETL Initial Sync Script Generator for DB2 to BigQuery: The cross-product Initial Sync Script generator now supports DB2 (LUW) as a source and BigQuery as a destination, letting customers seed a BigQuery warehouse from DB2 through ETL and then hand off to ELT for ongoing CDC.
  • Expanded Google Ads Coverage: The Google Ads connector now exposes additional fields on the ad_group_ads and keyword_view collections, including bidding strategy, negative keyword flags, and a broader set of performance metrics like clicks, impressions, conversions, and view-through conversions for richer paid-search reporting.
  • Google Ads Incremental Reports: ACCOUNT_PERFORMANCE_REPORT, AD_PERFORMANCE_REPORT, and ADGROUP_PERFORMANCE_REPORT now sync incrementally instead of full-refresh, reducing API consumption and shortening sync windows for accounts with long reporting histories.
  • Adobe Analytics OAuth Server-to-Server: The Adobe Analytics connector has migrated from the JWT authentication flow to OAuth Server-to-Server, keeping pipelines compliant with Adobe's authentication roadmap and avoiding the disruption of the JWT sunset.
  • Trial Day Counter: Users without an active subscription now see remaining trial days in the dashboard, making it clearer how much evaluation time is left before a billing decision is needed.

Improvements
  • The TikTok connector now consolidates all `pixel_instant_page_events` collections into a single collection, simplifying downstream modeling and removing the need to union near-duplicate streams.
  • The MySQL connector's GTID handling has been reworked with a `gtidBaseline` value persisted in pipeline state, resolving connection failures when pipelines move to a new source server.
  • The DB2 connector's Generate CDC SQL script generation has been parallelized and the timeout extended from one to five minutes, preventing setup timeouts on larger DB2 schemas.
  • GA4 Export primary key uniqueness has been improved by including `user_pseudo_id`, `event_bundle_sequence_id`, and `batch_event_index` in the `event_custom_id` hash, eliminating duplicate-key collisions on high-volume GA4 streams.

Performance Enhancements
  • DB2 to BigQuery initial sync has been parallelized end-to-end, cutting initial-load wall time on the path most commonly used to seed BigQuery warehouses from DB2 sources.
  • The MySQL connector now uses a ten-second connection timeout by default, eliminating the TLS handshake failures that previously caused intermittent pipeline restarts on higher-latency source networks.

Take a look at what shipped this cycle and tell us which improvements you'd like to see go further.

about 1 month ago

March 2026: New Connectors, Editor Upgrades & More

ETL & Reverse ETL
March's release cycle focused on expanding connector coverage, deepening the Expression Editor's capabilities, and closing reliability gaps across the pipeline.

Introducing the Reworked Expression Editor
The Expression Editor has been redesigned to make building expressions faster - new copy and insert buttons let you add any expression directly, no manual typing required. Clicking any function now opens a detail panel on the right showing its full description, parameters, and usage - no more hunting through documentation. A parameter legend below the syntax line makes it clear at a glance which inputs are required and which are optional, and related functions are now surfaced contextually to help users discover the right tool for the job. We also added a dedicated DateTimeConverter, removing the need to manually locate, input, and convert datetime fields when working with date expressions. A built-in cURL import rounds out the update, letting users utilize pre-build Postman API calls without leaving the editor.

Introducing NetSuite REST API Support
The ETL platform now supports NetSuite via its REST API using SuiteQL, giving users a modern, query-based alternative to the JDBC connector for accessing NetSuite data. This month also includes a JDBC driver upgrade from version 8.10.136.0 to 8.10.184.0, improving compatibility and stability for existing NetSuite JDBC connections.

Introducing the Universal OAuth Connector
The Universal OAuth Connector now supports HTTP Basic Authentication as part of the OAuth 2.0 flow, enabling connections to providers that require this handshake. Automatic token refresh has also been implemented.

Introducing the Native Shopify Source
The native Shopify source component now supports both full load and incremental loading, with pre-defined objects aligned to the approach used by the HubSpot connector. The underlying OAuth connector issue that previously caused Shopify authentication failures has been resolved as part of this work.

New Connectors
  • Gmail Connector: Users can now ingest CSV and Excel attachments directly from a Gmail inbox using service account authentication, with support for both full and incremental load modes and automatic metadata extraction.
  • Google Sheets Connector: A new bidirectional connector lets users read from and write to Google Sheets using service account authentication, supporting both source and destination use cases within the same job.
  • Constant Contact Connector: Users can now connect to Constant Contact via OAuth 2.0, fetch contact objects and email campaigns, and use dynamic field discovery during schema import.
  • SharePoint as a Destination Component: SharePoint can now be used as a write destination within the package designer, in addition to its existing role as a source.

New Features
  • Schedule Webhook Notifications: Users can now receive service hook notifications for schedule lifecycle events - creation, activation, and deactivation - keeping external systems in sync with job schedules.
  • Import cURL from Postman: The REST API source component now includes an import cURL button, allowing users to paste a cURL command directly from Postman to pre-populate the request configuration.
  • Save and Validate Option: A Save and Validate option has been added to the Save button dropdown in the Package Designer, allowing users to trigger validation without leaving the editing context.
  • File Storage Header and Data Row Customization: Users can now specify which row contains headers and which row data begins during CSV and Excel file imports, handling files with non-standard layouts.
  • Previewer Error Detail: The Previewer now displays specific error log output instead of a generic error message, making it easier to diagnose preview failures.

Improvements
  • Schema preview in source components now supports up to 800 fields, up from 500, giving users a more complete view of wide tables.
  • Search inputs have been added to the connections dropdown and the components list in the package designer, reducing navigation time when working with large connector sets.
  • The SharePoint destination editor consolidates the document library and folder path into a single field, with clearer labeling and alignment with the source component layout.
  • The REST API source component now auto-detects and suggests the correct JSONPath after schema load, reducing manual configuration for nested JSON responses.
  • The SFTP connector now supports Ed25519 key pairs for public key authentication and has been upgraded to handle modern OpenSSH servers that require ETM (Encrypt-then-MAC) algorithms.
  • The schema importer timeout has been increased from 30 to 60 seconds, reducing failures on slower or larger schemas.

Bug Fixes
  • Fixed multiple expression editor issues: backdrop clicks closing the underlying modal, the popup reappearing after background dismissal, flickering tooltips, unreliable autocomplete, and incorrect display on smaller screens.
  • Fixed a bug where the Curl() function was not routing through proxy servers, causing preview failures for API endpoints with IP whitelisting.
  • Resolved UTF-8 encoding corruption when ingesting Korean, Chinese, or Japanese characters via the REST API source and the Curl() UDF.
  • Fixed HubSpot source issues where number fields were incorrectly typed as Float instead of Double, and the incremental load date variable was set incorrectly.
  • Fixed a Salesforce source issue where previewing objects with hundreds of fields produced HTTP errors.
  • Fixed an issue where global variables were not applied correctly during component preview, and resolved a package validation failure for File Storage sources using Parquet files.
  • Fixed an issue where error logs in Job Details were truncated, and resolved an OAuth popup that remained open after authentication completed.

Performance Enhancements
  • Salesforce schema fetching now uses concurrent API calls, reducing wait times when loading objects with large field sets.
  • Database queries underlying dataflow exports have been optimized, resolving timeout errors for large packages.
Thanks for using the product - keep the feedback coming and let us know what you'd like to see next!
2 months ago
Loading more updates...