azure.datafactory.tools

PowerShell module to help with CI&CD for Azure Data Factory, mainly to publish to ADF service in multiple environments. Check https://github.com/Azure-Player/azure.datafactory.tools/ & https://azureplayer.net/adf/

Minimum PowerShell version

5.1

Installation Options

Owners

• kamil_nowinski
• AzurePlayer

Copyright

(c) 2020-2026 Kamil Nowinski. All rights reserved.

Package Details

FileList

• azure.datafactory.tools.nuspec
• .github\ISSUE_TEMPLATE\bug_report.md
• .github\ISSUE_TEMPLATE\feature_request.md
• .github\workflows\ci-cd.yml
• .github\workflows\develop-ci.yml
• .github\workflows\publish.yml
• .vscode\launch.json
• CODE_OF_CONDUCT.md
• LICENSE
• README.md
• adhoc\!Prerequisites.ps1
• adhoc\DeleteNotInSource.ps1
• adhoc\GenerateDiagram.ps1
• adhoc\Get-AdfPaths.ps1
• adhoc\Get-DatasetsViaRestAPI.ps1
• adhoc\Get-RootPath.ps1
• adhoc\GetHelp.ps1
• adhoc\GetListOfObjects.ps1
• adhoc\New-PublishOption.ps1
• adhoc\PsAnalyzer.ps1
• adhoc\PublishToPsGallery.ps1
• adhoc\Test-AdfArmTemplate-debug.ps1
• adhoc\Update-PropertiesFromFile.ps1
• adhoc\Update-help.ps1
• adhoc\UpdateJsonFile.ps1
• adhoc\UpdateModules.ps1
• adhoc\access-to-json-prop.ps1
• adhoc\delete-debug.ps1
• adhoc\get-referencedObject.ps1
• adhoc\getExtension.ps1
• adhoc\infra-BigFactorySample3.json
• adhoc\infra-SQLPlayerDemo-UAT.json
• adhoc\issue-138\ARMTemplateForFactory.json
• adhoc\issue-138\publish-138.ps1
• adhoc\issue-144-165\list.json
• adhoc\issue-144-165\list2.json
• adhoc\issue-144-165\run-test.ps1
• adhoc\issue-156\Get-CredentialsViaRestAPI.ps1
• adhoc\issue-156\publish-credentials.ps1
• adhoc\issue-183\config.csv
• adhoc\issue-183\linkedservice\akv_ls_amnoneshd.json
• adhoc\issue-183\linkedservice\sql_ls_amie_amhdb.json
• adhoc\issue-183\test-183.ps1
• adhoc\issue-195\deployment-state.json
• adhoc\issue-195\test-195.ps1
• adhoc\issue-217\factory\BigFactorySample2.json
• adhoc\issue-217\publish-217.ps1
• adhoc\issue-223\adf1\pipeline\test_selectivemigration_pipeline1.json
• adhoc\issue-223\adf1\pipeline\test_selectivemigration_pipeline1.json.txt
• adhoc\issue-223\adf1\publish-includeexclude-objects.txt
• adhoc\issue-223\adf1\trigger\test_selectivemigration_trigger1.json
• adhoc\issue-223\adf2\pipeline\test_selectivemigration_pipeline1.json
• adhoc\issue-223\adf2\pipeline\test_selectivemigration_pipeline1.json.txt
• adhoc\issue-223\adf2\publish-includeexclude-objects.txt
• adhoc\issue-223\adf2\trigger\test_selectivemigration_trigger2.json
• adhoc\issue-223\deploy-full-test-2.ps1
• adhoc\issue-223\deploy-full-test.ps1
• adhoc\issue-223\deploy.powershell.script.ps1
• adhoc\issue-223\publish-includeexclude-objects.txt
• adhoc\issue-226\config.csv
• adhoc\issue-226\test-226.ps1
• adhoc\issue-226\trigger\trigger-example.json
• adhoc\issue-229\test-229.ps1
• adhoc\issue-240-v2\config.csv
• adhoc\issue-240-v2\config.json
• adhoc\issue-240-v2\factory\my-factory-001.json
• adhoc\issue-240-v2\factory\~my-factory-001.json
• adhoc\issue-240-v2\test-240-v2.ps1
• adhoc\issue-240\config.csv
• adhoc\issue-240\pipeline\pl_nav_extract.json
• adhoc\issue-240\pipeline\~pl_nav_extract.json
• adhoc\issue-240\test-240.ps1
• adhoc\issue-245\config.csv
• adhoc\issue-245\pipeline\PL_GEN_Sources_Orch.json
• adhoc\issue-245\test-245.ps1
• adhoc\issue-245\test-335.ps1
• adhoc\issue-260\AzureADF\factory\ADF-BIGroupFacts01-Dev.json
• adhoc\issue-260\repro_code.ps1
• adhoc\issue-279\test-279.ps1
• adhoc\issue-298\config.csv
• adhoc\issue-298\managedVirtualNetwork\default.json
• adhoc\issue-298\managedVirtualNetwork\default\managedPrivateEndpoint\adls_mpe_sap_adf.json
• adhoc\issue-298\test-298.ps1
• adhoc\issue-301\test-301.ps1
• adhoc\issue-340\issue-340.ps1
• adhoc\issue-354\config-QA.csv
• adhoc\issue-379\issue-379.ps1
• adhoc\issue-387\deploy-387.ps1
• adhoc\issue-387\factory\factory387.json
• adhoc\migrate-adf.ps1
• adhoc\npm-export.ps1
• adhoc\pester-throw.ps1
• adhoc\publish-ADF.procfwk.ps1
• adhoc\publish-BigFactorySample2-GP.ps1
• adhoc\publish-BigFactorySample2.ps1
• adhoc\publish-BigFactorySample2_vnet.ps1
• adhoc\publish-GlobalParams-run.ps1
• adhoc\publish-GlobalParams.ps1
• adhoc\publish-GlobalParamsBool.ps1
• adhoc\publish-SQLPlayerDemo.ps1
• adhoc\publish-with-warnings.ps1
• adhoc\readme.md
• adhoc\test-adfCode.ps1
• adhoc\unused-objects.ps1
• adhoc\write-file.ps1
• adhoc\~~Load-all-cmdlets-locally.ps1
• azure.datafactory.tools.psd1
• azure.datafactory.tools.psm1
• changelog.md
• diagram.md
• docs\ADVANCED\CMDLET_REFERENCE.md
• docs\ADVANCED\DEVOPS_INTEGRATION.md
• docs\FEATURES\ARM_TEMPLATE.md
• docs\FEATURES\BUILD_AND_TEST.md
• docs\FEATURES\DEPENDENCIES_DIAGRAM.md
• docs\FEATURES\LINKED_SERVICE_TESTING.md
• docs\GETTING_STARTED.md
• docs\GUIDE\CONFIGURATION.md
• docs\GUIDE\INCREMENTAL_DEPLOYMENT.md
• docs\GUIDE\PUBLISHING.md
• docs\GUIDE\PUBLISH_OPTIONS.md
• docs\GUIDE\SELECTIVE_DEPLOYMENT.md
• docs\README.md
• en-us\about_azure.datafactory.tools.help.txt
• en-us\messages_index.md
• images\AdfColor.png
• images\adftools-logo-128px.png
• images\logo512.png
• media\adf-folders.png
• media\linked-service-test-connection.gif
• media\matrix-of-behaviour-logic-1.png
• media\matrix-of-behaviour-logic-2.png
• private\!AdfPublishOption.class.ps1
• private\Adf.class.ps1
• private\AdfInstance.class.ps1
• private\AdfObject.class.ps1
• private\AdfObjectName.class.ps1
• private\AdfPSCredential.ps1
• private\AdfPSObjects.class.ps1
• private\ApplyExclusionOptions.ps1
• private\ConfigLine.ps1
• private\Convert-PSObjectToHashtable.ps1
• private\ConvertFrom-ArraysToOrderedHashTables.ps1
• private\ConvertFrom-OrderedHashTablesToArrays.ps1
• private\ConvertTo-AdfCollection.ps1
• private\ConvertTo-AdfType.ps1
• private\Deploy-AdfObject.ps1
• private\Deploy-AdfObjectOnly.ps1
• private\DeploymentState.class.ps1
• private\Get-AdfObjectByName.ps1
• private\Get-AdfObjectByPattern.ps1
• private\Get-AdfObjectsFromServiceRestAPI.ps1
• private\Get-AzDFV2Credential.ps1
• private\Get-AzureResourceType.ps1
• private\Get-ReferencedObjects.ps1
• private\Get-SimplifiedType.ps1
• private\Get-SortedTriggers.ps1
• private\GlobalParam.ps1
• private\Import-AdfObjects.ps1
• private\Microsoft-GlobalParametersUpdateScript.ps1
• private\Microsoft-PrePostDeploymentScript-ver2.ps1
• private\Microsoft-PrePostDeploymentScript.ps1
• private\ObjectProperty.ps1
• private\Read-CsvConfigFile.ps1
• private\Read-JsonConfigFile.ps1
• private\Remove-AdfObject.ps1
• private\Remove-AdfObjectIfNotInSource.ps1
• private\Remove-AdfObjectRestAPI.ps1
• private\Remove-UnusedDatasetsFromAdf.ps1
• private\Save-AdfObjectAsFile.ps1
• private\Start-Trigger.ps1
• private\Start-Triggers.ps1
• private\Stop-Trigger.ps1
• private\Stop-Triggers.ps1
• private\Test-LinkedServiceConnection.ps1
• private\ToArray.ps1
• private\Update-GlobalParameters.ps1
• private\Update-PropertiesFromFile.ps1
• private\triggerSortUtil.ps1
• public\Export-AdfToArmTemplate.ps1
• public\Get-AdfDocDiagram.ps1
• public\Get-AdfFromService.ps1
• public\Import-AdfFromFolder.ps1
• public\New-AdfPublishOption.ps1
• public\Publish-AdfV2FromJson.ps1
• public\Publish-AdfV2UsingArm.ps1
• public\Set-AdfToolsAuthToken.ps1
• public\Start-AdfTriggers.ps1
• public\Stop-AdfTriggers.ps1
• public\Test-AdfArmTemplate.ps1
• public\Test-AdfCode.ps1
• public\Test-AdfLinkedService.ps1
• test\!RunAllTests.ps1
• test\ApplyExclusionOptions.Tests.ps1
• test\BigFactorySample2\credential\credential1.json
• test\BigFactorySample2\dataflow\Currency Converter.json
• test\BigFactorySample2\dataflow\MovieDemo.json
• test\BigFactorySample2\dataflow\TaxiDemo.json
• test\BigFactorySample2\dataset\CADOutput1.json
• test\BigFactorySample2\dataset\CurrencyDatasetCAD.json
• test\BigFactorySample2\dataset\CurrencyDatasetUSD.json
• test\BigFactorySample2\dataset\TaxiDemoDayStatsSink.json
• test\BigFactorySample2\dataset\TaxiDemoTotalByPaymentType.json
• test\BigFactorySample2\dataset\TaxiDemoVendorStatsSink.json
• test\BigFactorySample2\dataset\USDOutput.json
• test\BigFactorySample2\dataset\movie_dataflow_sink.json
• test\BigFactorySample2\dataset\movie_dataflow_source.json
• test\BigFactorySample2\dataset\taxi_trip_data_input.json
• test\BigFactorySample2\dataset\taxi_trip_fare_input.json
• test\BigFactorySample2\deployment\config-array.csv
• test\BigFactorySample2\deployment\config-badformat.csv
• test\BigFactorySample2\deployment\config-badtype.csv
• test\BigFactorySample2\deployment\config-c001.csv
• test\BigFactorySample2\deployment\config-c002.csv
• test\BigFactorySample2\deployment\config-c002a.csv
• test\BigFactorySample2\deployment\config-c002b.csv
• test\BigFactorySample2\deployment\config-c003-variables.csv
• test\BigFactorySample2\deployment\config-c004-wrongpath.csv
• test\BigFactorySample2\deployment\config-c005-extra-action.csv
• test\BigFactorySample2\deployment\config-c100.csv
• test\BigFactorySample2\deployment\config-c100.json
• test\BigFactorySample2\deployment\config-commented.csv
• test\BigFactorySample2\deployment\config-globalparam1.csv
• test\BigFactorySample2\deployment\config-issue49.csv
• test\BigFactorySample2\deployment\config-missing.csv
• test\BigFactorySample2\deployment\config-missing.json
• test\BigFactorySample2\deployment\config-multiple.csv
• test\BigFactorySample2\deployment\config-multiple.json
• test\BigFactorySample2\deployment\config-trigger-Disabled.csv
• test\BigFactorySample2\deployment\config-trigger-Enabled.csv
• test\BigFactorySample2\deployment\config-uat.csv
• test\BigFactorySample2\deployment\filter.empty.txt
• test\BigFactorySample2\deployment\filter.option1.txt
• test\BigFactorySample2\factory\BigFactorySample2-without-gp.json#
• test\BigFactorySample2\factory\BigFactorySample2.json
• test\BigFactorySample2\integrationRuntime\AzureIR.json
• test\BigFactorySample2\integrationRuntime\SharedIR-DEV2019.json
• test\BigFactorySample2\linkedService\BlobSampleData.json
• test\BigFactorySample2\linkedService\LS_AzureDatabricks.json
• test\BigFactorySample2\linkedService\LS_AzureKeyVault.json
• test\BigFactorySample2\linkedService\LS_AzureSqlDb_AW2014_SqlAuth.json
• test\BigFactorySample2\linkedService\LS_DataLakeStore.json
• test\BigFactorySample2\linkedService\LS_SqlServer_DEV19_AW2017.json
• test\BigFactorySample2\pipeline\Currency Converter.json
• test\BigFactorySample2\pipeline\MovieDemoPipeline.json
• test\BigFactorySample2\pipeline\Multiple Waits.json
• test\BigFactorySample2\pipeline\PL_Issue33.json!
• test\BigFactorySample2\pipeline\PL_StoredProc.json
• test\BigFactorySample2\pipeline\PL_Wait5sec.json
• test\BigFactorySample2\pipeline\PL_Wait_Dynamic.json
• test\BigFactorySample2\pipeline\TaxiDemo.json
• test\BigFactorySample2\trigger\TR_AlwaysDisabled.json
• test\BigFactorySample2\trigger\TR_RunEveryDay.json
• test\BigFactorySample2\trigger\TR_TumblingWindow.json
• test\BigFactorySample2_vnet\deployment\config-endpoint.csv
• test\BigFactorySample2_vnet\deployment\config-endpoint2.json
• test\BigFactorySample2_vnet\factory\BigFactorySample2.json
• test\BigFactorySample2_vnet\integrationRuntime\AzureIR-VnetEnabled.json
• test\BigFactorySample2_vnet\linkedService\LS_AzureKeyVault.json
• test\BigFactorySample2_vnet\linkedService\LS_AzureSqlDb_AW2014_viaMVN_MI.json
• test\BigFactorySample2_vnet\linkedService\LS_SqlServer_DEV19_AW2017.json
• test\BigFactorySample2_vnet\managedVirtualNetwork\default.json
• test\BigFactorySample2_vnet\managedVirtualNetwork\default\managedPrivateEndpoint\MPE_SQLPlayer_srv2.json
• test\ConvertFrom.Tests.ps1
• test\Export-AdfToArmTemplate.Tests.ps1
• test\Get-AdfObjectByPattern.Tests.ps1
• test\Get-AzDFV2Credential.Tests.ps1
• test\Get-ReferencedObjects.Tests.ps1
• test\Get-SimplifiedType.Tests.ps1
• test\Import-AdfFromFolder.Tests.ps1
• test\Incremental-Deployment.Tests.ps1
• test\Integration.Tests.ps1
• test\Publish-AdfV2FromJson-1.Tests.ps1
• test\Publish-AdfV2FromJson-2.Tests.ps1
• test\Publish-AdfV2FromJson-3.Tests.ps1
• test\Publish-AdfV2FromJson-DryRun.Tests.ps1
• test\Publish-AdfV2FromJson-ErrorHandling.Tests.ps1
• test\Publish-AdfV2UsingArm.Tests.ps1
• test\PublishOption.Tests.ps1
• test\Read-CsvConfigFile.Tests.ps1
• test\Read-JsonConfigFile.Tests.ps1
• test\Remove-AdfObject.Tests.ps1
• test\Remove-AdfObjectRestAPI.Tests.ps1
• test\Start-Trigger.Tests.ps1
• test\Stop-Triggers.Tests.ps1
• test\Test-AdfArmTemplate.Tests.ps1
• test\Test-AdfCode.Tests.ps1
• test\Test-AdfLinkedService.Tests.ps1
• test\Test-Exceptions.Tests.ps1
• test\TestHelper\MockDataFactory.ps1
• test\TestHelper\TestHelper.psm1
• test\Triggers.Tests.ps1
• test\Triggers_template.ps1
• test\Update-GlobalParameters.Tests.ps1
• test\Update-PropertiesFromFile.Tests.ps1
• test\adf-class.Tests.ps1
• test\adf-simpledeployment-dev\armtemplate\ARMTemplateForFactory.json
• test\adf-simpledeployment-dev\armtemplate\ARMTemplateParametersForFactory.json
• test\adf1\dataflow\MovieDemo.json
• test\adf1\dataset\movie_dataflow_sink.json
• test\adf1\dataset\movie_dataflow_source.json
• test\adf1\linkedService\BlobSampleData.json
• test\adf2\credential\credential1.json
• test\adf2\dataflow\MovieDemo2.json
• test\adf2\dataset\DS_Json.json
• test\adf2\dataset\movie_dataflow_sink2.json
• test\adf2\dataset\movie_dataflow_source2.json
• test\adf2\factory\adf2.json
• test\adf2\linkedService\BlobSampleData.json
• test\adf2\linkedService\LS_AzureSynapseArtifacts1.json
• test\adf2\linkedService\LS_DataLakeG2.json
• test\adf2\pipeline\PL_ExecSparkJob.json
• test\adf2\pipeline\SynapseNotebook1.json
• test\adf2\trigger\TR_without_pipeline.json
• test\adf3\factory\adf3.json
• test\adfObject-class.Tests.ps1
• test\adfObjectName-class.Tests.ps1
• test\adftools_deployment_state.json
• test\emptyFactory\factory\emptyFactory.json
• test\generic.Tests.ps1
• test\misc\OB_CosmosDB_sink.json
• test\misc\SQLPlayerDemo-UAT.adftools_deployment_state.json
• test\misc\adftools_deployment_state.json
• test\zGet-AdfFromService.Tests.ps1
• tools\Publish-ToGallery.ps1

Version History