The Microsoft Fabric Blog team shares new features for Copy Job in Fabric Data Factory, helping data engineers with efficient data movement and ingestion workflows.

Simplifying Data Ingestion with Copy Job in Microsoft Fabric Data Factory

Copy Job is becoming a preferred solution in Microsoft Fabric Data Factory for efficiently moving data between diverse environments—including across clouds, from on-premises sources, or between services. The tool now offers multiple delivery styles like bulk copy, incremental copy, and change data capture (CDC) replication, providing flexibility for a variety of enterprise data scenarios.

New Enhancements in Copy Job

Reset Incremental Copy

  • Incremental copy boosts efficiency by transferring only new or updated data after the first full load.
  • Now, users can reset incremental copy to perform a full copy on the next run, useful for resolving data discrepancies between source and destination.
  • Resets can be performed per table, enabling more granular troubleshooting and minimizing disruption.

Auto Table Creation on Destination

  • Copy Job can now auto-create destination tables if they do not exist, automatically setting up the correct schema as part of the data movement process.
  • Supported destination types include:
    • SQL Server
    • Azure SQL Database
    • Fabric Lakehouse table
    • Snowflake
    • Azure SQL Managed Instance
    • Fabric SQL database
  • This feature streamlines setup and minimizes manual intervention.

JSON Format Support

  • High-throughput binary copying is available for any format.
  • Copy Job now supports movement of JSON files alongside familiar formats like CSV and Parquet, widening its usability for modern data exchanges.

Quick Access to Connection Details

  • Instantly view service name and workspace name by hovering over source or destination connections in the Copy Job panel—saving time and improving workflow efficiency.

Additional Resources

Questions or feedback? Join the community and continue the conversation!

This post appeared first on “Microsoft Fabric Blog”. Read the entire article here