12,222 questions with Azure Data Factory tags

Sort by: Updated
1 answer

ADF Power Query cannot evaluate Azure SQL source with system-assigned managed identity

Issue In Azure Data Factory Power Query (Data Wrangling), an Azure SQL Database dataset cannot be evaluated in the Power Query Online editor. The following error is displayed: Credentials are invalid or missing, so this query could not be…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,222 questions
asked 2026-08-21T08:38:53.87+00:00
豊田 明 0 Reputation points
answered 2026-08-22T22:45:20.9466667+00:00
Allan Solomon Mejia 5,420 Reputation points
1 answer

Trying to filter csv file based on content

I have an existing ADF pipeline that is creating an error due to some bad (or not acceptable data) displayed on the csv file. Basically, instead of having proper header on the first row with certain amount columns (with data), csv file displays data like…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,222 questions
asked 2026-07-22T21:45:14.68+00:00
Justin Doh 1,000 Reputation points
commented 2026-08-22T20:39:23.4766667+00:00
Pilladi Padma Sai Manisha 11,705 Reputation points Microsoft External Staff Moderator
1 answer

Example for Fabric Data Pipeline CICD with variable substitution.

Hi All, I am hoping someone can help me figure out how to implement CICD with connection substitution for a Fabric Data Factory pipeline. An example would be awesome - All I want to do is to promote a Data Factory pipeline to another environment and…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,222 questions
asked 2026-08-19T17:30:31.26+00:00
John Aherne 156 Reputation points
answered 2026-08-22T05:57:12.0866667+00:00
Nandan Hegde 36,886 Reputation points MVP Volunteer Moderator
0 answers

Azure Data Factory - self-hosted integration runtime - missing metrics in Data Factory (v2) overview

We just noticed, that the metrics from the self hosted integration runtime, like Integration Runtime CPU or Integration Runtime Memory are missing. The last metrics, we have are from Apr. 29 of this year (around 6:00 CEST) - before this time, we have…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,222 questions
asked 2026-08-18T12:15:02.3233333+00:00
von Euw Barbara 1 Reputation point
commented 2026-08-21T10:52:44.8233333+00:00
Smaran Thoomu 415 Reputation points Microsoft External Staff Moderator
0 answers

The specified network name is no longer available - error code - 22852

Hello Team, Today I faced an error, when i am trying to do test connection. Please resolved as soon as possible. I need to resolve please help me to resolve. 

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,222 questions
asked 2024-09-20T12:10:29.63+00:00
Balwant Singh 60 Reputation points
edited a comment 2026-08-20T13:22:39.6333333+00:00
BIRJU VERMA 0 Reputation points
2 answers

Azure Data Factory Data Flow Trigger Runs Successfully but Source File Is Not Updated (Debug Works Fine)

We are currently experiencing an issue with Azure ADF data flows. While the data flow functions as expected in debug mode and correctly updates the storage file in sink, it fails to update the storage file when triggered, even though the logs indicate…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,222 questions
asked 2026-08-14T10:32:32.24+00:00
Saksham Dubey 0 Reputation points
edited a comment 2026-08-20T08:27:14.9933333+00:00
SIVASANKAR YEDDULA 20 Reputation points Microsoft External Staff Moderator
2 answers One of the answers was accepted by the question author.

Vulnerable libcurl.dll detected in Microsoft Integration Runtime 5.0 bundled ODBC drivers - supported remediation?

Hello, Our security vulnerability scanner has identified vulnerable versions of libcurl.dll within the Microsoft Integration Runtime 5.0 installation directory: C:\Program Files\Microsoft Integration Runtime\5.0\Shared\ODBC Drivers\ We verified that the…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,222 questions
asked 2026-08-18T05:13:51.93+00:00
Pawan Bhagat 20 Reputation points
accepted 2026-08-20T08:07:33.5233333+00:00
Pawan Bhagat 20 Reputation points
3 answers

Azure Data Factory Private endpoint for Portal Endpoint

Hi Team, We are looking for recommendations and best practices around configuring the portal private endpoint for Azure Data Factory in a multi-VNET environment. Current setup: We have multiple ADF instances owned by separate teams. Each ADF has its…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,222 questions
asked 2026-06-05T12:04:07.2533333+00:00
Sumit Gaur 475 Reputation points
commented 2026-08-19T17:57:07.2933333+00:00
Alicja Rudnicka 30 Reputation points
1 answer

How to copy image from sqlserver in varbinary to Azure Blob storage using azure data factory

Hi all, “We are looking for a sample Copy Activity in Azure Data Factory to copy image data from Oracle/SQL databases into Azure Blob Storage as image files. The challenge we face is that when copying from relational databases, we are unable to perform a…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,222 questions
asked 2026-08-13T10:11:50.02+00:00
manish verma 516 Reputation points
commented 2026-08-19T15:43:43.04+00:00
manish verma 516 Reputation points
1 answer One of the answers was accepted by the question author.

Does Azure Data Factory support Federated Identity Credential / Workload Identity Federation for ADLS Gen2 linked services?

I am trying to validate whether Azure Data Factory supports a secretless cross-tenant authentication pattern using Federated Identity Credential / Workload Identity Federation. Scenario: We have an Azure Data Factory pipeline / Copy Activity that needs…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,222 questions
asked 2026-08-12T20:23:07.9766667+00:00
Pradeep Ulindala 20 Reputation points Microsoft Employee
accepted 2026-08-18T22:59:42.7733333+00:00
Pradeep Ulindala 20 Reputation points Microsoft Employee
2 answers One of the answers was accepted by the question author.

Can't reach Azure Data Factory

Hi I can't reach adf.azure.com. Clearing cache and cookies or changing to a different browser (Firefox, Chrome, Edge) on the same laptop doesn't work. I can still open the browser on my phone and access just fine. What am I missing?

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,222 questions
asked 2026-08-13T10:48:57.2266667+00:00
Quyen Dang 41 Reputation points
answered 2026-08-17T16:34:30.8633333+00:00
Himaja Y 260 Reputation points Microsoft External Staff Moderator
1 answer

Certain Decimal values from Parquet file are returned as NULL in Data Flow

Hi, when reading a Parquet file in Data Flow, decimal values that exceed a certain size/precision are being returned as NULL instead of being correctly parsed. Example 72232493.28310600000000. The issue is not related to the sink or any downstream…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,222 questions
asked 2026-08-12T06:22:26.8466667+00:00
Trifan, A (Andra) 0 Reputation points
commented 2026-08-17T10:10:33.4133333+00:00
Ganesh Chelluri 190 Reputation points Microsoft External Staff Moderator
1 answer

ADF pipeline is failing while updating the single field COSMOS document

We have similar ADF pipelines in lower & Prod environments! But the pipeline is failing in PROD environment while updating the data to COSMOS document! Below is the error message it uses Dataflow to update: Operation on target…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,222 questions
asked 2026-08-12T04:56:53.02+00:00
shiva patpi 13,396 Reputation points Microsoft Employee Moderator
answered 2026-08-13T18:19:09.1433333+00:00
Manoj Kumar Boyini 19,510 Reputation points Microsoft External Staff Moderator
0 answers

CLOUD_PROVIDER_RESOURCE_STOCKOUT (CLOUD_FAILURE)

I run a pipeline every hour, 24/7. Lately I have been receiving the CLOUD_PROVIDER_RESOURCE_STOCKOUT frequently during business hours.

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,222 questions
asked 2026-08-13T12:02:48.18+00:00
Baker, Rick 0 Reputation points
commented 2026-08-13T12:34:21.1733333+00:00
Smaran Thoomu 415 Reputation points Microsoft External Staff Moderator
3 answers

Azure Data Factory Parameter Limitation Issue

Hi, I am having problem when deploying data factory for my batch data. The error is regarding the parameter limitation of 256 parameters, but the number of parameters were 259. I believe this error root cause is the dependency to ARM which having hard…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,222 questions
asked 2026-08-07T08:22:02.15+00:00
Roime Bin Puniran 0 Reputation points
edited an answer 2026-08-13T01:14:29.0166667+00:00
Roime Bin Puniran 0 Reputation points
2 answers

Migrating varbinary data from onprem SQL table to Azure blob storage.

Hi, I need to move the varbinary data in one of my on Prem SQL data table column Column(binary_data) which needs to be uploaded to azure blob storage. We have 2 million rows in the table and every row should create one file in the blob storage for…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,222 questions
SQL Server Integration Services
SQL Server Integration Services

A Microsoft platform for building enterprise-level data integration and data transformations solutions.

2,805 questions
SQL Server | Other
SQL Server | Other

Additional SQL Server features and topics not covered by specific categories

14,797 questions
asked 2024-10-21T14:22:23.4666667+00:00
Anonymous
commented 2026-08-12T14:26:21.2366667+00:00
manish verma 516 Reputation points
1 answer One of the answers was accepted by the question author.

Transfer documents from sqlserver in varbinary to Azure Blob storage

I am looking to move a large set of documents from a Managed Instance of SQL Server database where the documents are saved in varbinary data type on the sql server table. The ADF dataflow I created doesn't let me select a Azure Blob 'Binary' as the sink…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,222 questions
SQL Server | Other
SQL Server | Other

Additional SQL Server features and topics not covered by specific categories

14,797 questions
asked 2024-05-23T16:42:11.0466667+00:00
Reema DSouza 40 Reputation points
commented 2026-08-12T14:24:13.56+00:00
manish verma 516 Reputation points
2 answers One of the answers was accepted by the question author.

FABRIC ON PREMISED GATEWAY DATA ACCESS USING A COPY DATA ACTIVITY FROM A PIPE LINE

Hello guys i have been facing this issue with my gateway recently on the Fabric data plateform, my gateway appears to be online and updated to the latest version yet, anytime i want to pull data using a pipeline and a copy data activity, i face this…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,222 questions
asked 2026-08-11T09:51:11.7833333+00:00
Ernest WAMBO 40 Reputation points
accepted 2026-08-11T13:56:50.6266667+00:00
Ernest WAMBO 40 Reputation points
2 answers

From AME unable to create ADF Linked Service connection for CORP KUSTO using CORP SPN

Hello Team, I am trying to create a Linked Service in AME ADF for CORP Kusto cluster. For that I have created SPN in AME and marked it as multi-tenant. This SPN is also created in CORP. However, AME ADF is throwing error that SPN USER does not have…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,222 questions
asked 2026-07-20T19:32:22.4233333+00:00
Hemant 61 Reputation points Microsoft External Staff
commented 2026-08-11T04:22:49.1966667+00:00
Smaran Thoomu 415 Reputation points Microsoft External Staff Moderator
1 answer

ADF Cosmos DB Change Feed Connector Missing Intermediate Events/Documents for Separate Records

Hi team, I am experiencing an issue where the Azure Data Factory (ADF) Mapping Data Flow Cosmos DB Change Feed connector is missing specific intermediate document updates. Environment Setup: Source: Azure Cosmos DB (NoSQL API) container. Timestamps are…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,222 questions
asked 2026-08-10T10:15:07.6733333+00:00
Sairam Ganji 1 Reputation point
answered 2026-08-10T12:01:30.59+00:00
Amira Bedhiafi 43,046 Reputation points MVP Volunteer Moderator