Simplifying Data Ingestion with Copy Job: Multiple Scheduler Support in Microsoft Fabric
The Microsoft Fabric Blog outlines recent improvements to Copy Job in Data Factory, with multiple scheduler support enabling advanced data ingestion scheduling and orchestration by the platform team.
Simplifying Data Ingestion with Copy Job: Multiple Scheduler Support in Microsoft Fabric
Copy Job serves as a central solution in Microsoft Fabric Data Factory for seamless data movement. It supports multiple delivery styles, including:
- Bulk copy
- Incremental copy
- Change data capture (CDC) replication
The latest update introduces robust multiple scheduler support, enabling:
- Triggering a single Copy job on different schedules simultaneously (e.g., daily at 6 AM and weekly on Sundays)
- Consolidating previously separate jobs into unified configurations
- More efficient, simplified orchestration of recurring data ingestion tasks
Previously, orchestrating varied schedules required creating separate Copy jobs for each trigger. With the new feature, you now configure all desired schedules directly within a single Copy job.
Integration and Deployment:
Multiple schedulers can be deployed with Copy job using:
- Git integration
- Deployment Pipelines
- Public APIs
This ensures streamlined CI/CD and reproducible data engineering workflows.
Additional Resources:
- Unlocking Flexibility in Fabric: Introducing Multiple Scheduler and CI/CD Support
- Microsoft Fabric Copy Job Documentation
- Fabric Ideas portal
- Microsoft Fabric Community
- Fabric documentation
Feedback:
Have questions or ideas? Share feedback via the Fabric Ideas portal or join the conversation in the Fabric Community.
This post appeared first on “Microsoft Fabric Blog”. Read the entire article here