Skip to content

[Hub apps] Create the hub-pipeline module for creating ADF pipelines #1494

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 2 commits into
base: dev
Choose a base branch
from

Conversation

flanakin
Copy link
Collaborator

@flanakin flanakin commented Apr 9, 2025

🛠️ Description

Creates a placeholder for the hub-pipeline module that will eventually be used for creating and triggering ADF pipelines.

This is a notional PR right now. I'm not convinced this is the right approach because it would lose typing. However, if we move to maintaining pipeline code in JSON files instead of bicep, this would be acceptable. Sharing it to get others' thoughts.

Related to #1400

📋 Checklist

🔬 How did you test this change?

  • 🤏 Lint tests
  • 🤞 PS -WhatIf / az validate
  • 👍 Manually deployed + verified
  • 💪 Unit tests
  • 🙌 Integration tests

🙋‍♀️ Do any of the following that apply?

  • 🚨 This is a breaking change.
  • 🤏 The change is less than 20 lines of code.

📑 Did you update docs/changelog.md?

  • ✅ Updated changelog (required for dev PRs)
  • ➡️ Will add log in a future PR (feature branch PRs only)
  • ❎ Log not needed (small/internal change)

📖 Did you update documentation?

  • ✅ Public docs in docs (required for dev)
  • ✅ Internal dev docs in src (required for dev)
  • ➡️ Will add docs in a future PR (feature branch PRs only)
  • ❎ Docs not needed (small/internal change)

dataFactoryName: dataFactory.name
pipelineName: '${safeConfigContainerName}_InitializeHub'
pipelineProperties: {
activities: [
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is mostly spacing changes. To hide spacing changes, use the gear menu above the files 👆 and select "Hide whitespace", then apply and reload.

params: {
dataFactoryName: dataFactory.name
pipelineName: '${safeConfigContainerName}_InitializeHub'
pipelineProperties: {
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

My main hesitation with this approach is that it removes typing for the pipeline properties. If any app owner wants to hand-craft pipelines, then this would be a painful loss.

The alternative approach is to require people create pipelines using normal bicep and then we have a bicep module that only subscribes pipelines to events. I'm curious what others think 🤔

@flanakin flanakin marked this pull request as draft April 9, 2025 10:28
@microsoft-github-policy-service microsoft-github-policy-service bot added the Needs: Review 👀 PR that is ready to be reviewed label Apr 9, 2025
@flanakin flanakin changed the title Create a hub-pipeline bicep module as a placeholder for ADF pipelines [Hub apps] Create a hub-pipeline bicep module as a placeholder for ADF pipelines Apr 9, 2025
@flanakin flanakin added the Tool: FinOps hubs Data pipeline solution label Apr 10, 2025
@flanakin flanakin changed the title [Hub apps] Create a hub-pipeline bicep module as a placeholder for ADF pipelines [Hub apps] Create the hub-pipeline module for ADF pipelines Apr 10, 2025
@flanakin flanakin changed the title [Hub apps] Create the hub-pipeline module for ADF pipelines [Hub apps] Create the hub-pipeline module for creating ADF pipelines Apr 10, 2025
@flanakin flanakin added the Skill: Deployment Resource deployment automation via bicep or terraform label Apr 10, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Needs: Review 👀 PR that is ready to be reviewed Skill: Deployment Resource deployment automation via bicep or terraform Tool: FinOps hubs Data pipeline solution
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants