New installation - msexports_ExecuteETL fails #1516
Unanswered
butch-albrecht
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I have a new installation of the finops-toolkit .8. I am a MCA customer and have Cost Management & Billing exports setup to go to a storage account. Data Factory connects to the storage account without issues.
I get multiple failures for the msexports_ExecuteETL pipeline, but feel if I fix one the others will get fixed as well. Some msexports_ExecuteETL jobs work - the ones around recommendations are the ones that are failing.
I am new to Data Factory and the toolkit and have tried to go through the troubleshooting guide and common errors, but no luck. I also searched this forum without success.
Problem:
The error I have is:
Operation on target For Each Blob failed: Activity failed because an inner activity failed; Inner activity name: Execute, Error: Operation on target Get Existing Parquet Files failed: ADLS Gen2 operation failed for: Operation returned an invalid status code 'NotFound'. Account: mystorageaccount'. FileSystem: 'ingestion'. Path: 'Recommendations/2025/04/providers/microsoft.billing/billingaccounts/mybillingaccountid/billingprofiles/mybillingprofileID'. ErrorCode: 'PathNotFound'. Message: 'The specified path does not exist.'. RequestId: 'myrequestID#'. TimeStamp: 'Tue, 15 Apr 2025 18:29:29 GMT'.
I can tell you that the storage account does have an ingestion container, but does not have a Recommendations folder.
The msexports_ExecuteETL is configured (I think) to look at the msexports container - but I think that is where I have gone wrong. So this is how msexports_ExectueETL has for settings:
The source dataset for manifest has the linked service of my storage account which I can do a successful Test Connection.

However, the File Path for this connection is:
File Path [blank box]/@{dataset().folderPath}/@{dataset().fileName}
There is a browse button this page and I can browse to the desired folder. But doing a preview data fails.
Not sure I have explained this sufficiently. But any guidance anyone could provide would be appreciated.
Beta Was this translation helpful? Give feedback.
All reactions