Skip to main content

Microsoft Azure Data Factory Management Client Library for Python

Project description

Microsoft Azure SDK for Python

This is the Microsoft Azure Data Factory Management Client Library.

Azure Resource Manager (ARM) is the next generation of management APIs that replace the old Azure Service Management (ASM).

This package has been tested with Python 2.7, 3.4, 3.5, 3.6 and 3.7.

For the older Azure Service Management (ASM) libraries, see azure-servicemanagement-legacy library.

For a more complete set of Azure libraries, see the azure bundle package.

Usage

For code examples, see Data Factory Management on docs.microsoft.com.

Provide Feedback

If you encounter any bugs or have suggestions, please file an issue in the Issues section of the project.

Release History

0.7.0 (2019-01-31)

Features

  • Model MarketoObjectDataset has a new parameter folder

  • Model MarketoObjectDataset has a new parameter schema

  • Model MarketoObjectDataset has a new parameter table_name

  • Model AzureTableDataset has a new parameter folder

  • Model AzureTableDataset has a new parameter schema

  • Model VerticaTableDataset has a new parameter folder

  • Model VerticaTableDataset has a new parameter schema

  • Model VerticaTableDataset has a new parameter table_name

  • Model VerticaLinkedService has a new parameter pwd

  • Model DocumentDbCollectionDataset has a new parameter folder

  • Model DocumentDbCollectionDataset has a new parameter schema

  • Model HubspotObjectDataset has a new parameter folder

  • Model HubspotObjectDataset has a new parameter schema

  • Model HubspotObjectDataset has a new parameter table_name

  • Model GetMetadataActivity has a new parameter user_properties

  • Model SalesforceObjectDataset has a new parameter folder

  • Model SalesforceObjectDataset has a new parameter schema

  • Model AzureStorageLinkedService has a new parameter account_key

  • Model AzureStorageLinkedService has a new parameter sas_token

  • Model OracleLinkedService has a new parameter password

  • Model ZohoObjectDataset has a new parameter folder

  • Model ZohoObjectDataset has a new parameter schema

  • Model ZohoObjectDataset has a new parameter table_name

  • Model HDInsightHiveActivity has a new parameter variables

  • Model HDInsightHiveActivity has a new parameter query_timeout

  • Model HDInsightHiveActivity has a new parameter user_properties

  • Model AmazonS3Dataset has a new parameter folder

  • Model AmazonS3Dataset has a new parameter schema

  • Model AzureSqlTableDataset has a new parameter folder

  • Model AzureSqlTableDataset has a new parameter schema

  • Model Activity has a new parameter user_properties

  • Model AzurePostgreSqlLinkedService has a new parameter password

  • Model HDInsightMapReduceActivity has a new parameter user_properties

  • Model HttpDataset has a new parameter folder

  • Model HttpDataset has a new parameter schema

  • Model MagentoObjectDataset has a new parameter folder

  • Model MagentoObjectDataset has a new parameter schema

  • Model MagentoObjectDataset has a new parameter table_name

  • Model NetezzaLinkedService has a new parameter pwd

  • Model ImpalaObjectDataset has a new parameter folder

  • Model ImpalaObjectDataset has a new parameter schema

  • Model ImpalaObjectDataset has a new parameter table_name

  • Model DrillLinkedService has a new parameter pwd

  • Model XeroObjectDataset has a new parameter folder

  • Model XeroObjectDataset has a new parameter schema

  • Model XeroObjectDataset has a new parameter table_name

  • Model ODataResourceDataset has a new parameter folder

  • Model ODataResourceDataset has a new parameter schema

  • Model MariaDBTableDataset has a new parameter folder

  • Model MariaDBTableDataset has a new parameter schema

  • Model MariaDBTableDataset has a new parameter table_name

  • Model PhoenixObjectDataset has a new parameter folder

  • Model PhoenixObjectDataset has a new parameter schema

  • Model PhoenixObjectDataset has a new parameter table_name

  • Model ShopifyObjectDataset has a new parameter folder

  • Model ShopifyObjectDataset has a new parameter schema

  • Model ShopifyObjectDataset has a new parameter table_name

  • Model DatabricksNotebookActivity has a new parameter libraries

  • Model DatabricksNotebookActivity has a new parameter user_properties

  • Model HDInsightStreamingActivity has a new parameter user_properties

  • Model MariaDBLinkedService has a new parameter pwd

  • Model OracleTableDataset has a new parameter folder

  • Model OracleTableDataset has a new parameter schema

  • Model AzureDatabricksLinkedService has a new parameter new_cluster_spark_env_vars

  • Model AzureDatabricksLinkedService has a new parameter new_cluster_custom_tags

  • Model ControlActivity has a new parameter user_properties

  • Model AzurePostgreSqlTableDataset has a new parameter folder

  • Model AzurePostgreSqlTableDataset has a new parameter schema

  • Model AzurePostgreSqlTableDataset has a new parameter table_name

  • Model EloquaObjectDataset has a new parameter folder

  • Model EloquaObjectDataset has a new parameter schema

  • Model EloquaObjectDataset has a new parameter table_name

  • Model ForEachActivity has a new parameter user_properties

  • Model HDInsightPigActivity has a new parameter user_properties

  • Model WaitActivity has a new parameter user_properties

  • Model DrillTableDataset has a new parameter folder

  • Model DrillTableDataset has a new parameter schema

  • Model DrillTableDataset has a new parameter table_name

  • Model ExecutePipelineActivity has a new parameter user_properties

  • Model UntilActivity has a new parameter user_properties

  • Model AzureDataLakeStoreDataset has a new parameter folder

  • Model AzureDataLakeStoreDataset has a new parameter schema

  • Model HDInsightLinkedService has a new parameter is_esp_enabled

  • Model SelfHostedIntegrationRuntimeStatus has a new parameter auto_update_eta

  • Model SelfHostedIntegrationRuntimeStatus has a new parameter pushed_version

  • Model SelfHostedIntegrationRuntimeStatus has a new parameter latest_version

  • Model ServiceNowObjectDataset has a new parameter folder

  • Model ServiceNowObjectDataset has a new parameter schema

  • Model ServiceNowObjectDataset has a new parameter table_name

  • Model WebActivity has a new parameter user_properties

  • Model QuickBooksObjectDataset has a new parameter folder

  • Model QuickBooksObjectDataset has a new parameter schema

  • Model QuickBooksObjectDataset has a new parameter table_name

  • Model CustomDataset has a new parameter folder

  • Model CustomDataset has a new parameter schema

  • Model GreenplumTableDataset has a new parameter folder

  • Model GreenplumTableDataset has a new parameter schema

  • Model GreenplumTableDataset has a new parameter table_name

  • Model JiraObjectDataset has a new parameter folder

  • Model JiraObjectDataset has a new parameter schema

  • Model JiraObjectDataset has a new parameter table_name

  • Model CouchbaseLinkedService has a new parameter cred_string

  • Model PrestoObjectDataset has a new parameter folder

  • Model PrestoObjectDataset has a new parameter schema

  • Model PrestoObjectDataset has a new parameter table_name

  • Model TabularTranslator has a new parameter schema_mapping

  • Model Factory has a new parameter e_tag

  • Model Factory has a new parameter repo_configuration

  • Model AzureSearchIndexDataset has a new parameter folder

  • Model AzureSearchIndexDataset has a new parameter schema

  • Model WebTableDataset has a new parameter folder

  • Model WebTableDataset has a new parameter schema

  • Model FilterActivity has a new parameter user_properties

  • Model PipelineRunInvokedBy has a new parameter invoked_by_type

  • Model Resource has a new parameter e_tag

  • Model RelationalTableDataset has a new parameter folder

  • Model RelationalTableDataset has a new parameter schema

  • Model AzureSqlDWTableDataset has a new parameter folder

  • Model AzureSqlDWTableDataset has a new parameter schema

  • Model Dataset has a new parameter folder

  • Model Dataset has a new parameter schema

  • Model AzureMLBatchExecutionActivity has a new parameter user_properties

  • Model CouchbaseTableDataset has a new parameter folder

  • Model CouchbaseTableDataset has a new parameter schema

  • Model CouchbaseTableDataset has a new parameter table_name

  • Model HDInsightSparkActivity has a new parameter user_properties

  • Model AzureSqlDWLinkedService has a new parameter password

  • Model AzureMLUpdateResourceActivity has a new parameter user_properties

  • Model SapEccResourceDataset has a new parameter folder

  • Model SapEccResourceDataset has a new parameter schema

  • Model LookupActivity has a new parameter user_properties

  • Model AzureMySqlLinkedService has a new parameter password

  • Model DataLakeAnalyticsUSQLActivity has a new parameter user_properties

  • Model CassandraTableDataset has a new parameter folder

  • Model CassandraTableDataset has a new parameter schema

  • Model SquareObjectDataset has a new parameter folder

  • Model SquareObjectDataset has a new parameter schema

  • Model SquareObjectDataset has a new parameter table_name

  • Model HDInsightOnDemandLinkedService has a new parameter script_actions

  • Model PaypalObjectDataset has a new parameter folder

  • Model PaypalObjectDataset has a new parameter schema

  • Model PaypalObjectDataset has a new parameter table_name

  • Model PipelineResource has a new parameter variables

  • Model PipelineResource has a new parameter folder

  • Model DynamicsEntityDataset has a new parameter folder

  • Model DynamicsEntityDataset has a new parameter schema

  • Model ActivityPolicy has a new parameter secure_input

  • Model FileShareDataset has a new parameter folder

  • Model FileShareDataset has a new parameter schema

  • Model AzureMySqlTableDataset has a new parameter folder

  • Model AzureMySqlTableDataset has a new parameter schema

  • Model ExecuteSSISPackageActivity has a new parameter project_connection_managers

  • Model ExecuteSSISPackageActivity has a new parameter user_properties

  • Model ExecuteSSISPackageActivity has a new parameter package_connection_managers

  • Model ExecuteSSISPackageActivity has a new parameter package_parameters

  • Model ExecuteSSISPackageActivity has a new parameter property_overrides

  • Model ExecuteSSISPackageActivity has a new parameter project_parameters

  • Model ExecuteSSISPackageActivity has a new parameter execution_credential

  • Model HiveObjectDataset has a new parameter folder

  • Model HiveObjectDataset has a new parameter schema

  • Model HiveObjectDataset has a new parameter table_name

  • Model IfConditionActivity has a new parameter user_properties

  • Model CosmosDbLinkedService has a new parameter account_key

  • Model GoogleBigQueryObjectDataset has a new parameter folder

  • Model GoogleBigQueryObjectDataset has a new parameter schema

  • Model GoogleBigQueryObjectDataset has a new parameter table_name

  • Model SqlServerTableDataset has a new parameter folder

  • Model SqlServerTableDataset has a new parameter schema

  • Model SparkObjectDataset has a new parameter folder

  • Model SparkObjectDataset has a new parameter schema

  • Model SparkObjectDataset has a new parameter table_name

  • Model CustomActivity has a new parameter user_properties

  • Model SapCloudForCustomerResourceDataset has a new parameter folder

  • Model SapCloudForCustomerResourceDataset has a new parameter schema

  • Model TumblingWindowTrigger has a new parameter depends_on

  • Model SqlServerStoredProcedureActivity has a new parameter user_properties

  • Model ConcurObjectDataset has a new parameter folder

  • Model ConcurObjectDataset has a new parameter schema

  • Model ConcurObjectDataset has a new parameter table_name

  • Model OperationMetricSpecification has a new parameter dimensions

  • Model HBaseObjectDataset has a new parameter folder

  • Model HBaseObjectDataset has a new parameter schema

  • Model HBaseObjectDataset has a new parameter table_name

  • Model AmazonMWSObjectDataset has a new parameter folder

  • Model AmazonMWSObjectDataset has a new parameter schema

  • Model AmazonMWSObjectDataset has a new parameter table_name

  • Model ExecutionActivity has a new parameter user_properties

  • Model AzureBlobDataset has a new parameter folder

  • Model AzureBlobDataset has a new parameter schema

  • Model AzureSqlDatabaseLinkedService has a new parameter password

  • Model MongoDbCollectionDataset has a new parameter folder

  • Model MongoDbCollectionDataset has a new parameter schema

  • Model CopyActivity has a new parameter data_integration_units

  • Model CopyActivity has a new parameter user_properties

  • Model SalesforceMarketingCloudObjectDataset has a new parameter folder

  • Model SalesforceMarketingCloudObjectDataset has a new parameter schema

  • Model SalesforceMarketingCloudObjectDataset has a new parameter table_name

  • Model GreenplumLinkedService has a new parameter pwd

  • Model NetezzaTableDataset has a new parameter folder

  • Model NetezzaTableDataset has a new parameter schema

  • Model NetezzaTableDataset has a new parameter table_name

  • Added operation PipelineRunsOperations.cancel

  • Added operation FactoriesOperations.configure_factory_repo

  • Added operation FactoriesOperations.get_data_plane_access

  • Added operation FactoriesOperations.get_git_hub_access_token

  • Added operation IntegrationRuntimeNodesOperations.get

  • Added operation IntegrationRuntimesOperations.create_linked_integration_runtime

  • Added operation IntegrationRuntimesOperations.remove_links

  • Added operation ActivityRunsOperations.query_by_pipeline_run

  • Added operation group RerunTriggersOperations

  • Added operation group TriggerRunsOperations

  • Added operation group IntegrationRuntimeObjectMetadataOperations

  • Added operation group ExposureControlOperations

Breaking changes

  • Parameter access_token_secret of model QuickBooksLinkedService is now required

  • Parameter access_token of model QuickBooksLinkedService is now required

  • Operation DatasetsOperations.get has a new signature

  • Operation FactoriesOperations.create_or_update has a new signature

  • Operation FactoriesOperations.get has a new signature

  • Operation IntegrationRuntimesOperations.get has a new signature

  • Operation LinkedServicesOperations.get has a new signature

  • Operation PipelinesOperations.get has a new signature

  • Operation TriggersOperations.get has a new signature

  • Operation PipelinesOperations.create_run has a new signature

  • Model Db2LinkedService no longer has parameter schema

  • Model QuickBooksLinkedService has a new required parameter consumer_key

  • Model QuickBooksLinkedService has a new required parameter consumer_secret

  • Model PostgreSqlLinkedService no longer has parameter database

  • Model PostgreSqlLinkedService no longer has parameter username

  • Model PostgreSqlLinkedService no longer has parameter schema

  • Model PostgreSqlLinkedService no longer has parameter server

  • Model PostgreSqlLinkedService has a new required parameter connection_string

  • Model TeradataLinkedService no longer has parameter schema

  • Model CopyActivity no longer has parameter cloud_data_movement_units

  • Model MySqlLinkedService no longer has parameter database

  • Model MySqlLinkedService no longer has parameter username

  • Model MySqlLinkedService no longer has parameter schema

  • Model MySqlLinkedService no longer has parameter server

  • Model MySqlLinkedService has a new required parameter connection_string

  • Removed operation FactoriesOperations.cancel_pipeline_run

  • Removed operation IntegrationRuntimesOperations.remove_node

  • Removed operation TriggersOperations.list_runs

  • Removed operation ActivityRunsOperations.list_by_pipeline_run

0.6.0 (2018-03-22)

  • Added new AzureDatabricks LinkedService and DatabricksNotebook Activity

  • Added headNodeSize and dataNodeSize properties in HDInsightOnDemand LinkedService

  • Added LinkedService, Dataset, CopySource for SalesforceMarketingCloud

  • Added support for SecureOutput on all activities

  • Added new BatchCount property on ForEach activity which controls how many concurrent activities to run

  • Added DELETE method for Web Activity

  • Added new Filter Activity

  • Added Linked Service Parameters support

0.5.0 (2018-02-16)

  • Enable AAD auth via service principal and management service identity for Azure SQL DB/DW linked service types

  • Support integration runtime sharing across subscription and data factory

  • Enable Azure Key Vault for all compute linked service

  • Add SAP ECC Source

  • GoogleBigQuery support clientId and clientSecret for UserAuthentication

  • Add LinkedService, Dataset, CopySource for Vertica and Netezza

0.4.0 (2018-02-02)

Features

  • Add readBehavior to Salesforce Source

  • Enable Azure Key Vault support for all data store linked services

  • Add license type property to Azure SSIS integration runtime

0.3.0 (2017-12-12)

Features

  • Add SAP Cloud For Customer Source

  • Add SAP Cloud For Customer Dataset

  • Add SAP Cloud For Customer Sink

  • Support providing a Dynamics password as a SecureString, a secret in Azure Key Vault, or as an encrypted credential.

  • App model for Tumbling Window Trigger

  • Add LinkedService, Dataset, Source for 26 RFI connectors, including: PostgreSQL,Google BigQuery,Impala,ServiceNow,Greenplum/Hawq,HBase,Hive ODBC,Spark ODBC,HBase Phoenix,MariaDB,Presto,Couchbase,Concur,Zoho CRM,Amazon Marketplace Services,PayPal,Square,Shopify,QuickBooks Online,Hubspot,Atlassian Jira,Magento,Xero,Drill,Marketo,Eloqua.

  • Support round tripping of new properties using additionalProperties for some types

  • Add new integration runtime API’s: patch integration runtime; patch integration runtime node; upgrade integration runtime, get node IP address

  • Add integration runtime naming validation

0.2.2 (2017-11-13)

Features

  • Added new connectors: AzureMySql, Salesforce and JSONFormat, Dynamics Sink

  • Added support providing Salesforce passwords and security tokens as SecureString and AzureKeyVaultSecret for Dynamics/Salesforce

  • Added cancel pipeline run api

0.2.1 (2017-10-03)

Features

  • Add factories.cancel_pipeline_run

0.2.0 (2017-09-22)

  • Initial Release

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

azure-mgmt-datafactory-0.7.0.zip (975.5 kB view hashes)

Uploaded Source

Built Distribution

azure_mgmt_datafactory-0.7.0-py2.py3-none-any.whl (951.2 kB view hashes)

Uploaded Python 2 Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page