{"id":3583,"date":"2023-04-12T15:39:33","date_gmt":"2023-04-12T15:39:33","guid":{"rendered":"https:\/\/quebit.com\/askquebit\/exploring-the-azure-data-factory\/"},"modified":"2026-01-15T18:02:22","modified_gmt":"2026-01-15T18:02:22","slug":"exploring-the-azure-data-factory","status":"publish","type":"post","link":"https:\/\/quebit.com\/askquebit\/exploring-the-azure-data-factory\/","title":{"rendered":"What Is Azure Data Factory and How Do I Use It to Build and Run Simple ETL Pipelines in Azure?"},"content":{"rendered":"<p>Since I\u2019ve worked with SQL Server Integration Services (SSIS) off and on for a while, I have been anxious to explore <a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/concepts-roles-permissions\">Azure Data Factory<\/a> (or ADF) to see what the differences are and how it stacks up.<\/p>\n<p>While SSIS may be a familiar ETL tool for on-premises work, \u00a0Azure Data Factory (defined as a \u201cplatform designed to solve data scenarios\u201d) is a managed service <em>in the cloud<\/em> providing the ability to extract data from different sources, transform it with data driven pipelines, and process the data.<\/p>\n<p>In another blog I outlined the step-by-step for building and executing a simple SSIS package, so here I want to tackle creating an Azure Data Factory instance and then using it to perform a simple ETL task.<\/p>\n<p><strong>Getting Started<\/strong><\/p>\n<p>To create a Azure Data Factory instance, the user account that you use to sign into Azure should be either the Azure subscription owner (or a subscription administrator) or an ID that is a <a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/concepts-roles-permissions\">Data Factory Contributor\u00a0<\/a>role at the resource group level or above.<\/p>\n<h3>Azure Storage Account<\/h3>\n<p>Azure Data Factory requires that you define at least one storage \u201ccontainer\u201d. A container organizes a set of data objects, similar to a directory in a file system within an Azure storage account. A storage account can include an unlimited number of containers, and a container can store an unlimited number of data objects.<\/p>\n<p>An Azure storage account will contain all of your Azure Storage data objects: such as blobs, file shares, queues, tables, and disks. The storage account provides a <u>unique namespace<\/u> for your Azure Storage data and is accessible from anywhere in the world over HTTP or HTTPS (based upon your configuration settings). Data you house in a storage account is <em>durable<\/em>, <em>highly available<\/em>, <em>secure<\/em>, and <em>extremely scalable<\/em>.<\/p>\n<h4>Storage<\/h4>\n<p>You can use a \u201cgeneral-purpose\u201d Azure Storage account for both source and destination data stores within an Azure data factory, so let\u2019s create a new \u201cgp\u201d storage account and then add a container to it. To do that, from within the Azure portal menu, select\u00a0<strong>All services<\/strong>, then select\u00a0<strong>Storage<\/strong>\u00a0&gt;\u00a0<strong>Storage accounts<\/strong>.<\/p>\n<p>Since we are working with a new Azure subscription in this example, there are no storage accounts set up yet:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-1869 alignnone\" src=\"https:\/\/quebit.com\/askquebit\/wp-content\/uploads\/2021\/10\/Z1-min.jpg\" alt=\"\" width=\"900\" height=\"361\" \/><\/p>\n<p>We need to click <strong>+ Create<\/strong> and configure an account by selecting a <strong>Subscription<\/strong> and <strong>Resource group<\/strong> (I created a new resource group for this exercise):<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-1870 alignnone\" src=\"https:\/\/quebit.com\/askquebit\/wp-content\/uploads\/2021\/10\/Z2-min.jpg\" alt=\"\" width=\"666\" height=\"369\" \/><\/p>\n<p>Next, I named my storage account (\u201cjmillerstorageaccount\u201d), picked a Region where it will exist and selected the standard<em> performance<\/em> and <em>redundancy<\/em> options:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-1871 alignnone\" src=\"https:\/\/quebit.com\/askquebit\/wp-content\/uploads\/2021\/10\/Z3-min.jpg\" alt=\"\" width=\"678\" height=\"310\" \/><\/p>\n<p>After reviewing the configurations and clicking <strong>Create<\/strong>, the deployment will be processed and completed within in minutes:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-1872 alignnone\" src=\"https:\/\/quebit.com\/askquebit\/wp-content\/uploads\/2021\/10\/Z4-min.jpg\" alt=\"\" width=\"814\" height=\"271\" \/><\/p>\n<p><strong>Creating a Storage Container<\/strong><\/p>\n<p>Now that we have established a storage account, we need to create a storage <em>container<\/em> which, as already mentioned, a storage container can store an unlimited number of data objects. From the above page you can click on <strong>Go to resource<\/strong> then on the <strong>New container<\/strong> page, you provide a name for the new storage container (I named this one \u201cjimscontainer\u201d) and set the access level to <strong>Private <\/strong>and then clicked <strong>Create<\/strong>.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-1873 alignnone\" src=\"https:\/\/quebit.com\/askquebit\/wp-content\/uploads\/2021\/10\/Z5-min.jpg\" alt=\"\" width=\"341\" height=\"308\" \/><\/p>\n<p>Now we have our new storage container!<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-1874 alignnone\" src=\"https:\/\/quebit.com\/askquebit\/wp-content\/uploads\/2021\/10\/Z6-min.jpg\" alt=\"\" width=\"900\" height=\"152\" \/><\/p>\n<p>If you now click on the container name, you will see that it is currently empty:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-1875 alignnone\" src=\"https:\/\/quebit.com\/askquebit\/wp-content\/uploads\/2021\/10\/Z7-min.jpg\" alt=\"\" width=\"900\" height=\"201\" \/><\/p>\n<p><strong>Adding Data<\/strong><\/p>\n<p>Azure Blob storage is Microsoft&#8217;s object storage solution for the cloud. Blob storage is optimized for storing massive amounts of unstructured data. Unstructured data is data that doesn&#8217;t adhere to a particular data model or definition, such as text or binary data. An Azure container organizes a set of blobs, similar to a directory in a file system and a container can store an unlimited number of blobs. The Azure Data Factory\u00a0supports copying data to and from Blob storage. For now, let\u2019s try adding some simple blob data to our container directly so we click on <strong>Upload<\/strong> and we get the <strong>Upload blob<\/strong> page:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-1876 alignnone\" src=\"https:\/\/quebit.com\/askquebit\/wp-content\/uploads\/2021\/10\/Z8-min.jpg\" alt=\"\" width=\"350\" height=\"712\" \/><\/p>\n<p>Here, you can conveniently browse to a file to fill in the <strong>Files<\/strong> text box and indicate if it should be overwritten if it already exists. I selected a simple text file named \u201ccycle_prices.txt\u201d, kept the <strong>Authentication type<\/strong> of Azure AD user account and for <strong>Blob type<\/strong>, and selected <u>Block blob<\/u> (there are three different types of blobs: Block, Append and Page and block blobs are the \u201csimplest form\u201d of blobs and made up of blocks of data that can be managed individually. You can read more about Azure blob storage <a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/storage\/blobs\/storage-blobs-introduction\">here<\/a>). Next, I set <strong>Access tier<\/strong> to HOT.<\/p>\n<p>If you leave <strong>Upload to Folder<\/strong> blank, the uploaded file will land in the container\u2019s root area, so I entered \u201c<em>input<\/em>\u201d to have a folder created with that name, finally I left <strong>Encryption scope<\/strong> as \u201cuse existing\u201d and clicked <strong>Upload<\/strong>.<\/p>\n<p>Once the upload completes, you should see the (newly created) input folder and if you click on it, you\u2019ll see the uploaded file:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-1877 alignnone\" src=\"https:\/\/quebit.com\/askquebit\/wp-content\/uploads\/2021\/10\/Z9-min.jpg\" alt=\"\" width=\"900\" height=\"194\" \/><\/p>\n<p><strong>The Data Factory<\/strong><\/p>\n<p>Now that we have an established <strong>storage account<\/strong> with a <strong>storage container<\/strong>, we can go on and set up a Data Factory Instance. On the Azure portal menu, select\u00a0<strong>Create a resource <\/strong>then under <strong>Categories<\/strong>, click on <strong>Integration<\/strong>. From there, you can locate the <strong>Data Factory<\/strong> icon and under it, click <strong>Create<\/strong>:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-1878 alignnone\" src=\"https:\/\/quebit.com\/askquebit\/wp-content\/uploads\/2021\/10\/Z10-min.jpg\" alt=\"\" width=\"789\" height=\"685\" \/><\/p>\n<p>On the <strong>Create Data Factory<\/strong> page, set the Basic information required: an Azure <em>subscription<\/em>, <em>Resource group<\/em>, a <em>Region<\/em> and <em>Version<\/em>. We also need to provide a name for the Data Factory (as a note, Azure Data Factory allows you to configure a <em>Git repository<\/em> to be used with either Azure DevOps or GitHub, for this exercise I selected the option \u201cConfigure Git later\u201d). When you are ready, click <strong>Review + Create<\/strong>.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-1879 alignnone\" src=\"https:\/\/quebit.com\/askquebit\/wp-content\/uploads\/2021\/10\/Z11-min.jpg\" alt=\"\" width=\"708\" height=\"410\" \/><\/p>\n<p>A validation is performed and if it succeeds, the deployment will begin.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-1880 alignnone\" src=\"https:\/\/quebit.com\/askquebit\/wp-content\/uploads\/2021\/10\/Z12-min.jpg\" alt=\"\" width=\"900\" height=\"322\" \/><\/p>\n<p>Once the deployment is completed, the data factory will appear as one of your resources. When you click on it to open it, you should see the details of the resource. To get started, we can click in the <strong>Open Azure Data factory Studio<\/strong> icon:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-1857 alignnone\" src=\"https:\/\/quebit.com\/askquebit\/wp-content\/uploads\/2021\/10\/Z13-min.jpg\" alt=\"\" width=\"900\" height=\"426\" \/><\/p>\n<p>We have succeeded with creating an <em>Azure Data Factory instance<\/em> and now want to try using it to perform a simple ETL task.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-1858 alignnone\" src=\"https:\/\/quebit.com\/askquebit\/wp-content\/uploads\/2021\/10\/Z14-min.jpg\" alt=\"\" width=\"914\" height=\"474\" \/><\/p>\n<p><strong>Loading a SQL Table<\/strong><\/p>\n<p>Earlier we loaded a text file (cycle_prices.txt) to our Azure storage container. Suppose we want to copy that data into a SQL Server table using Azure Data Factory. To do that we can perform the following steps:<\/p>\n<p>Click on <strong>Ingest<\/strong>:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-1859 alignnone\" src=\"https:\/\/quebit.com\/askquebit\/wp-content\/uploads\/2021\/10\/Z15-min.jpg\" alt=\"\" width=\"401\" height=\"142\" \/><\/p>\n<p>On the Properties page, leave <strong>Run once now<\/strong> selected and click <strong>Next<\/strong>.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-1860 alignnone\" src=\"https:\/\/quebit.com\/askquebit\/wp-content\/uploads\/2021\/10\/Z16-min.jpg\" alt=\"\" width=\"900\" height=\"419\" \/><\/p>\n<p>Next, we define the <strong>Source<\/strong> for the copy by selecting Azure Blob Storage as the <strong>source type<\/strong> (since we originally uploaded our text file to a blob container), define a blob <strong>connection<\/strong> (I named it AzureBlobStorage1) and then use the <strong>Browse<\/strong> feature to navigate to and select our cycle_prices.txt file. Lastly, select the <strong>Recursively<\/strong> option and click <strong>Next<\/strong>.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-1861 alignnone\" src=\"https:\/\/quebit.com\/askquebit\/wp-content\/uploads\/2021\/10\/Z17-min.jpg\" alt=\"\" width=\"900\" height=\"564\" \/><\/p>\n<p>Since we are sourcing the data from a text file, we need to set the <strong>File format,<\/strong> <strong>Column<\/strong> and <strong>Row delimiters<\/strong> and <strong>First row as header<\/strong> settings (and then click <strong>Next<\/strong>):<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-1862 alignnone\" src=\"https:\/\/quebit.com\/askquebit\/wp-content\/uploads\/2021\/10\/Z18-min.jpg\" alt=\"\" width=\"932\" height=\"426\" \/><\/p>\n<p>Next we define the <strong>Target<\/strong>. I selected <em>Azure SQL Database<\/em> as my <strong>Target type<\/strong> and setup a new <strong>Connection <\/strong>by clicking on <strong>+ New connection <\/strong>(and then filling in database connection details). After that I fill in a name for a new sql server \u00a0table \u201clatest_cycle_prices\u201d where I want the data to be copied to. After that, I click <strong>Next<\/strong>.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-1863 alignnone\" src=\"https:\/\/quebit.com\/askquebit\/wp-content\/uploads\/2021\/10\/Z19-min.jpg\" alt=\"\" width=\"906\" height=\"438\" \/><\/p>\n<p>On the <strong>Column mapping<\/strong> page I just leave the settings \u201cas they are\u201d so that the file field names become the table column names. In fact, I am going to just let the column <strong>Type<\/strong> default to <em>String<\/em> and again click <strong>Next<\/strong>:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-1864 alignnone\" src=\"https:\/\/quebit.com\/askquebit\/wp-content\/uploads\/2021\/10\/Z20-min.jpg\" alt=\"\" width=\"886\" height=\"409\" \/><\/p>\n<p>The last steps involve providing a <strong>Task name<\/strong> and <strong>Task description<\/strong> for our Data Factory copy process, click <strong>Next <\/strong>and<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-1865 alignnone\" src=\"https:\/\/quebit.com\/askquebit\/wp-content\/uploads\/2021\/10\/Z21-min.jpg\" alt=\"\" width=\"888\" height=\"354\" \/><\/p>\n<p>Then we can scroll through and review the <strong>Summary<\/strong> page and finally click <strong>Next<\/strong> again:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-1866 alignnone\" src=\"https:\/\/quebit.com\/askquebit\/wp-content\/uploads\/2021\/10\/Z22-min.jpg\" alt=\"\" width=\"922\" height=\"514\" \/><\/p>\n<p>The copy task runs and shows that each <strong>Deployment step<\/strong> succeeded:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-1867 alignnone\" src=\"https:\/\/quebit.com\/askquebit\/wp-content\/uploads\/2021\/10\/Z23-min.jpg\" alt=\"\" width=\"922\" height=\"479\" \/><\/p>\n<p><strong>Validation<\/strong><\/p>\n<p>In <a href=\"https:\/\/quebit.com\/askquebit\/quebit-products\/azure-query-performance-insight\/\">another post<\/a> I demonstrated how to open a sql server database in the Azure portal and use <strong>Query Editor<\/strong> to view objects and data. If we go back to the Azure portal now, we can again write a simple Query and see that our new table was created and loaded with the data from the text file:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-1807 alignnone\" src=\"https:\/\/quebit.com\/askquebit\/wp-content\/uploads\/2021\/10\/AZ24-min.jpg\" alt=\"\" width=\"900\" height=\"357\" \/><\/p>\n<p><strong>Conclusion<\/strong><\/p>\n<p>To put a wrap on all this, I\u2019ve configured an Azure Storage account, added a Storage Container, and then deployed a Data Factory instance that uses the storage container. After that I created a simple Data Factory pipeline to copy data from a text file I uploaded to a SQL Server table all without any programming. I cant wait to see what else I can accomplish with the <a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/media\/introduction\/data-factory-visual-guide.png\">ADF architecture<\/a>!<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Since I\u2019ve worked with SQL Server Integration Services (SSIS) off and on for a while, I have been anxious to explore Azure Data Factory (or ADF) to see what the differences are and how it stacks up. While SSIS may be a familiar ETL tool for on-premises work, \u00a0Azure Data Factory (defined as a \u201cplatform&hellip;<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[27],"tags":[34],"class_list":["post-3583","post","type-post","status-publish","format-standard","hentry","category-quebit-value","tag-data-management"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.6 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>What Is Azure Data Factory and How Do I Use It to Build and Run Simple ETL Pipelines in Azure? - QueBIT<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/quebit.com\/askquebit\/exploring-the-azure-data-factory\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"What Is Azure Data Factory and How Do I Use It to Build and Run Simple ETL Pipelines in Azure? - QueBIT\" \/>\n<meta property=\"og:description\" content=\"Since I\u2019ve worked with SQL Server Integration Services (SSIS) off and on for a while, I have been anxious to explore Azure Data Factory (or ADF) to see what the differences are and how it stacks up. While SSIS may be a familiar ETL tool for on-premises work, \u00a0Azure Data Factory (defined as a \u201cplatform&hellip;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/quebit.com\/askquebit\/exploring-the-azure-data-factory\/\" \/>\n<meta property=\"og:site_name\" content=\"QueBIT\" \/>\n<meta property=\"article:published_time\" content=\"2023-04-12T15:39:33+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-01-15T18:02:22+00:00\" \/>\n<meta name=\"author\" content=\"agoddard\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"agoddard\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"12 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/quebit.com\\\/askquebit\\\/exploring-the-azure-data-factory\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/quebit.com\\\/askquebit\\\/exploring-the-azure-data-factory\\\/\"},\"author\":{\"name\":\"agoddard\",\"@id\":\"https:\\\/\\\/quebit.com\\\/askquebit\\\/#\\\/schema\\\/person\\\/e52d72da0fd2f5f70d189343fe4f5084\"},\"headline\":\"What Is Azure Data Factory and How Do I Use It to Build and Run Simple ETL Pipelines in Azure?\",\"datePublished\":\"2023-04-12T15:39:33+00:00\",\"dateModified\":\"2026-01-15T18:02:22+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/quebit.com\\\/askquebit\\\/exploring-the-azure-data-factory\\\/\"},\"wordCount\":1462,\"commentCount\":0,\"image\":{\"@id\":\"https:\\\/\\\/quebit.com\\\/askquebit\\\/exploring-the-azure-data-factory\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/quebit.com\\\/askquebit\\\/wp-content\\\/uploads\\\/2021\\\/10\\\/Z1-min.jpg\",\"keywords\":[\"Data Management\"],\"articleSection\":[\"QueBIT Value\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/quebit.com\\\/askquebit\\\/exploring-the-azure-data-factory\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/quebit.com\\\/askquebit\\\/exploring-the-azure-data-factory\\\/\",\"url\":\"https:\\\/\\\/quebit.com\\\/askquebit\\\/exploring-the-azure-data-factory\\\/\",\"name\":\"What Is Azure Data Factory and How Do I Use It to Build and Run Simple ETL Pipelines in Azure? - QueBIT\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/quebit.com\\\/askquebit\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/quebit.com\\\/askquebit\\\/exploring-the-azure-data-factory\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/quebit.com\\\/askquebit\\\/exploring-the-azure-data-factory\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/quebit.com\\\/askquebit\\\/wp-content\\\/uploads\\\/2021\\\/10\\\/Z1-min.jpg\",\"datePublished\":\"2023-04-12T15:39:33+00:00\",\"dateModified\":\"2026-01-15T18:02:22+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/quebit.com\\\/askquebit\\\/#\\\/schema\\\/person\\\/e52d72da0fd2f5f70d189343fe4f5084\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/quebit.com\\\/askquebit\\\/exploring-the-azure-data-factory\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/quebit.com\\\/askquebit\\\/exploring-the-azure-data-factory\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/quebit.com\\\/askquebit\\\/exploring-the-azure-data-factory\\\/#primaryimage\",\"url\":\"https:\\\/\\\/quebit.com\\\/askquebit\\\/wp-content\\\/uploads\\\/2021\\\/10\\\/Z1-min.jpg\",\"contentUrl\":\"https:\\\/\\\/quebit.com\\\/askquebit\\\/wp-content\\\/uploads\\\/2021\\\/10\\\/Z1-min.jpg\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/quebit.com\\\/askquebit\\\/exploring-the-azure-data-factory\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/quebit.com\\\/askquebit\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"What Is Azure Data Factory and How Do I Use It to Build and Run Simple ETL Pipelines in Azure?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/quebit.com\\\/askquebit\\\/#website\",\"url\":\"https:\\\/\\\/quebit.com\\\/askquebit\\\/\",\"name\":\"QueBIT\",\"description\":\"QueBIT\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/quebit.com\\\/askquebit\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/quebit.com\\\/askquebit\\\/#\\\/schema\\\/person\\\/e52d72da0fd2f5f70d189343fe4f5084\",\"name\":\"agoddard\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/d817b364cff1d66116debde8d1c85e5e76eeece9c5ae731b19276a6040231455?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/d817b364cff1d66116debde8d1c85e5e76eeece9c5ae731b19276a6040231455?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/d817b364cff1d66116debde8d1c85e5e76eeece9c5ae731b19276a6040231455?s=96&d=mm&r=g\",\"caption\":\"agoddard\"},\"sameAs\":[\"https:\\\/\\\/quebit.com\\\/askquebit\"],\"url\":\"https:\\\/\\\/quebit.com\\\/askquebit\\\/author\\\/agoddard\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"What Is Azure Data Factory and How Do I Use It to Build and Run Simple ETL Pipelines in Azure? - QueBIT","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/quebit.com\/askquebit\/exploring-the-azure-data-factory\/","og_locale":"en_US","og_type":"article","og_title":"What Is Azure Data Factory and How Do I Use It to Build and Run Simple ETL Pipelines in Azure? - QueBIT","og_description":"Since I\u2019ve worked with SQL Server Integration Services (SSIS) off and on for a while, I have been anxious to explore Azure Data Factory (or ADF) to see what the differences are and how it stacks up. While SSIS may be a familiar ETL tool for on-premises work, \u00a0Azure Data Factory (defined as a \u201cplatform&hellip;","og_url":"https:\/\/quebit.com\/askquebit\/exploring-the-azure-data-factory\/","og_site_name":"QueBIT","article_published_time":"2023-04-12T15:39:33+00:00","article_modified_time":"2026-01-15T18:02:22+00:00","author":"agoddard","twitter_card":"summary_large_image","twitter_misc":{"Written by":"agoddard","Est. reading time":"12 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/quebit.com\/askquebit\/exploring-the-azure-data-factory\/#article","isPartOf":{"@id":"https:\/\/quebit.com\/askquebit\/exploring-the-azure-data-factory\/"},"author":{"name":"agoddard","@id":"https:\/\/quebit.com\/askquebit\/#\/schema\/person\/e52d72da0fd2f5f70d189343fe4f5084"},"headline":"What Is Azure Data Factory and How Do I Use It to Build and Run Simple ETL Pipelines in Azure?","datePublished":"2023-04-12T15:39:33+00:00","dateModified":"2026-01-15T18:02:22+00:00","mainEntityOfPage":{"@id":"https:\/\/quebit.com\/askquebit\/exploring-the-azure-data-factory\/"},"wordCount":1462,"commentCount":0,"image":{"@id":"https:\/\/quebit.com\/askquebit\/exploring-the-azure-data-factory\/#primaryimage"},"thumbnailUrl":"https:\/\/quebit.com\/askquebit\/wp-content\/uploads\/2021\/10\/Z1-min.jpg","keywords":["Data Management"],"articleSection":["QueBIT Value"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/quebit.com\/askquebit\/exploring-the-azure-data-factory\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/quebit.com\/askquebit\/exploring-the-azure-data-factory\/","url":"https:\/\/quebit.com\/askquebit\/exploring-the-azure-data-factory\/","name":"What Is Azure Data Factory and How Do I Use It to Build and Run Simple ETL Pipelines in Azure? - QueBIT","isPartOf":{"@id":"https:\/\/quebit.com\/askquebit\/#website"},"primaryImageOfPage":{"@id":"https:\/\/quebit.com\/askquebit\/exploring-the-azure-data-factory\/#primaryimage"},"image":{"@id":"https:\/\/quebit.com\/askquebit\/exploring-the-azure-data-factory\/#primaryimage"},"thumbnailUrl":"https:\/\/quebit.com\/askquebit\/wp-content\/uploads\/2021\/10\/Z1-min.jpg","datePublished":"2023-04-12T15:39:33+00:00","dateModified":"2026-01-15T18:02:22+00:00","author":{"@id":"https:\/\/quebit.com\/askquebit\/#\/schema\/person\/e52d72da0fd2f5f70d189343fe4f5084"},"breadcrumb":{"@id":"https:\/\/quebit.com\/askquebit\/exploring-the-azure-data-factory\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/quebit.com\/askquebit\/exploring-the-azure-data-factory\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/quebit.com\/askquebit\/exploring-the-azure-data-factory\/#primaryimage","url":"https:\/\/quebit.com\/askquebit\/wp-content\/uploads\/2021\/10\/Z1-min.jpg","contentUrl":"https:\/\/quebit.com\/askquebit\/wp-content\/uploads\/2021\/10\/Z1-min.jpg"},{"@type":"BreadcrumbList","@id":"https:\/\/quebit.com\/askquebit\/exploring-the-azure-data-factory\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/quebit.com\/askquebit\/"},{"@type":"ListItem","position":2,"name":"What Is Azure Data Factory and How Do I Use It to Build and Run Simple ETL Pipelines in Azure?"}]},{"@type":"WebSite","@id":"https:\/\/quebit.com\/askquebit\/#website","url":"https:\/\/quebit.com\/askquebit\/","name":"QueBIT","description":"QueBIT","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/quebit.com\/askquebit\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/quebit.com\/askquebit\/#\/schema\/person\/e52d72da0fd2f5f70d189343fe4f5084","name":"agoddard","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/d817b364cff1d66116debde8d1c85e5e76eeece9c5ae731b19276a6040231455?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/d817b364cff1d66116debde8d1c85e5e76eeece9c5ae731b19276a6040231455?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/d817b364cff1d66116debde8d1c85e5e76eeece9c5ae731b19276a6040231455?s=96&d=mm&r=g","caption":"agoddard"},"sameAs":["https:\/\/quebit.com\/askquebit"],"url":"https:\/\/quebit.com\/askquebit\/author\/agoddard\/"}]}},"_links":{"self":[{"href":"https:\/\/quebit.com\/askquebit\/wp-json\/wp\/v2\/posts\/3583","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/quebit.com\/askquebit\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/quebit.com\/askquebit\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/quebit.com\/askquebit\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/quebit.com\/askquebit\/wp-json\/wp\/v2\/comments?post=3583"}],"version-history":[{"count":1,"href":"https:\/\/quebit.com\/askquebit\/wp-json\/wp\/v2\/posts\/3583\/revisions"}],"predecessor-version":[{"id":4903,"href":"https:\/\/quebit.com\/askquebit\/wp-json\/wp\/v2\/posts\/3583\/revisions\/4903"}],"wp:attachment":[{"href":"https:\/\/quebit.com\/askquebit\/wp-json\/wp\/v2\/media?parent=3583"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/quebit.com\/askquebit\/wp-json\/wp\/v2\/categories?post=3583"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/quebit.com\/askquebit\/wp-json\/wp\/v2\/tags?post=3583"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}