---
title: Power your Data Pipeline with Matillion Variables
description: "Matillion is a great ETL tool for bringing over data from disparate sources into\none central location (Snowflake, for example). Matillion provides a number of\ntools and components that will help you ingest and transform your data, but one\nof the most valuable assets would have to be its concept"
image: https://blog.ippon.tech/hubfs/Imported_Blog_Media/matillion_variables_cover-1-3.png
---

[Skip to main content](https://blog.ippon.tech/power-your-data-pipeline-with-matillion-variables#main)

[![IpponLogoKleinBlue](https://blog.ippon.tech/hs-fs/hubfs/IpponLogoKleinBlue.png?width=219&height=64&name=IpponLogoKleinBlue.png) ![IpponLogoKleinBlue](https://blog.ippon.tech/hs-fs/hubfs/IpponLogoKleinBlue.png?width=219&height=64&name=IpponLogoKleinBlue.png) ![IpponLogoKleinBlue](https://blog.ippon.tech/hs-fs/hubfs/IpponLogoKleinBlue.png?width=168&height=49&name=IpponLogoKleinBlue.png) ![IpponLogoKleinBlue](https://blog.ippon.tech/hs-fs/hubfs/IpponLogoKleinBlue.png?width=168&height=49&name=IpponLogoKleinBlue.png)](https://ipponusa.com/)

- [Home](https://ipponusa.com)
- [Show submenu for About About](https://ipponusa.com/about-us) 
    - [Who We Are](https://ipponusa.com/who-we-are)
    - [Careers](https://ipponusa.com/careers)
    - [Show submenu for Our Partners Our Partners](https://ipponusa.com/our-partners/) 
          - [AWS](https://ipponusa.com/our-partners/aws/)
          - [Snowflake](https://ipponusa.com/our-partners/snowflake/)
          - [Databricks](https://ipponusa.com/our-partners/databricks/)
          - [Microsoft](https://ipponusa.com/our-partners/microsoft/)
- [Show submenu for Services Services](https://ipponusa.com/services) 
    - [Snowflake](https://ipponusa.com/service/snowflake-concierge/)
    - [Artificial Intelligence](https://ipponusa.com/service/artificial-intelligence/)
    - [Data & Analytics](https://ipponusa.com/service/data-analytics/)
    - [Cloud Strategy](https://ipponusa.com/service/cloud-strategy/)
    - [Platform Modernization](https://ipponusa.com/service/platform-moderization/)
    - [Product Innovation](https://ipponusa.com/service/product-innovation/)
    - [Operating Model](https://ipponusa.com/service/operating-model/)
- [Blogs](https://blog.ippon.tech/)
- [Success Stories](https://ipponusa.com/success-stories/)
- [Show submenu for Resources Resources](https://ipponusa.com/resources/) 
    - [eBooks](https://ipponusa.com/ebooks/)
    - [The Data Pour](https://info.ippon.tech/the-data-pour)
    - [Videos & Webinars](https://info.ippon.tech/videos-and-webinars)
    - [Media Center](https://ipponusa.com/media-center/)

Search

Open main navigation

Close main navigation

- [Home](https://ipponusa.com)
- Show submenu for About About 
  
    - About
    - [About](https://ipponusa.com/about-us)
    - [Who We Are](https://ipponusa.com/who-we-are)
    - [Careers](https://ipponusa.com/careers)
    - Show submenu for Our Partners Our Partners 
      
          - Our Partners
          - [Our Partners](https://ipponusa.com/our-partners/)
          - [AWS](https://ipponusa.com/our-partners/aws/)
          - [Snowflake](https://ipponusa.com/our-partners/snowflake/)
          - [Databricks](https://ipponusa.com/our-partners/databricks/)
          - [Microsoft](https://ipponusa.com/our-partners/microsoft/)
- Show submenu for Services Services 
  
    - Services
    - [Services](https://ipponusa.com/services)
    - [Snowflake](https://ipponusa.com/service/snowflake-concierge/)
    - [Artificial Intelligence](https://ipponusa.com/service/artificial-intelligence/)
    - [Data & Analytics](https://ipponusa.com/service/data-analytics/)
    - [Cloud Strategy](https://ipponusa.com/service/cloud-strategy/)
    - [Platform Modernization](https://ipponusa.com/service/platform-moderization/)
    - [Product Innovation](https://ipponusa.com/service/product-innovation/)
    - [Operating Model](https://ipponusa.com/service/operating-model/)
- [Blogs](https://blog.ippon.tech/)
- [Success Stories](https://ipponusa.com/success-stories/)
- Show submenu for Resources Resources 
  
    - Resources
    - [Resources](https://ipponusa.com/resources/)
    - [eBooks](https://ipponusa.com/ebooks/)
    - [The Data Pour](https://info.ippon.tech/the-data-pour)
    - [Videos & Webinars](https://info.ippon.tech/videos-and-webinars)
    - [Media Center](https://ipponusa.com/media-center/)
- Search
- [Contact Us](https://ipponusa.com/contact/)

[Contact Us](https://ipponusa.com/contact/)

# Power your Data Pipeline with Matillion Variables

![Hector Sanchez](https://app.hubspot.com/settings/avatar/d41d8cd98f00b204e9800998ecf8427e)

 by [Hector Sanchez](https://blog.ippon.tech/author/hector-sanchez)

August 11, 2022

![Power your Data Pipeline with Matillion Variables](https://blog.ippon.tech/hubfs/Imported_Blog_Media/matillion_variables_cover-1-3.png)

[Matillion](https://blog.ippon.tech/tag/matillion/) [ETL](https://blog.ippon.tech/tag/etl/) [ELT](https://blog.ippon.tech/tag/elt/) [Variables](https://blog.ippon.tech/tag/variables/) [Data Engineering](https://blog.ippon.tech/tag/data-engineering/) [Software Engineering](https://blog.ippon.tech/tag/software-engineering/)

 

*Published August 11, 2022*

Matillion is a great ETL tool for bringing over data from disparate sources into one central location (Snowflake, for example). Matillion provides a number of tools and components that will help you ingest and transform your data, but one of the most valuable assets would have to be its concept of Job and Grid Variables. With these, you will be able to add a level of dynamism that simply cannot be achieved any other way. Let’s take a look at an example.

### Bring In a Set List Of Tables

In this example we’ll have a set list of tables that we know we would like to bring into Snowflake. One option we could do is create a table on Snowflake that can hold these values for us to use within Matillion.

![model\_1](https://blog.ippon.tech/hubfs/Imported_Blog_Media/matillion_variables_1-2.png)

We can then take these values and assign them to variables within our Matillion job and have our ingestion process be driven dynamically with the values found in this table.

Now it’s time to set up our Matillion orchestration job and define a variable we can use there.

### Set up a Variable in Matillion

There are two types of variables in Matillion - Job and Grid variables. A Job variable can hold a single value, whereas a Grid variable can be thought of as an array holding multiple values. For our example, we’ll be using a Job variable.

Within our orchestration job, right-click and select 'Manage Job Variables'.

![model\_2](https://blog.ippon.tech/hubfs/Imported_Blog_Media/matillion_variables_2-2.png)

On the next screen, click the '+' sign at the bottom to add a new variable. In this case, we’ll name our new Job variable 'table\_name'.

![model\_3](https://blog.ippon.tech/hubfs/Imported_Blog_Media/matillion_variables_3-2.png)

We’re now ready to use this new variable to help us cycle through our list of tables.

### Build the Orchestration Job

Within our Matillion orchestration job we’re going to use a couple of components: Database Query and Table Iterator. The Table Iterator will allow us to iterate over our Snowflake table and assign each table name to our Job variable.

![model\_4](https://blog.ippon.tech/hubfs/Imported_Blog_Media/matillion_variables_4-2.png)

Point the Table Iterator to the Snowflake table holding your list of table names by filling in the Database, Schema, and Target Table values. The Column Mapping entry is where we link the values in our table to the Job Variable we created earlier. Now on each iteration our table\_name variable will be updated with a new table name from our list.

This is great so far, but we need our job to actually do something over each iteration, namely load our tables into Snowflake. We’ll pull in a Database Query component and instead of only loading one table, we’ll connect it to our Table Iterator to load all tables on our list.

![model\_5](https://blog.ippon.tech/hubfs/Imported_Blog_Media/matillion_variables_5-2.png)

![model\_6](https://blog.ippon.tech/hubfs/Imported_Blog_Media/matillion_variables_6-2.png)

Now here is where our Job variable will tie everything together. Within our Database Query component, we’ll enter the required info such as Connection URL, Username, and Password, but we’ll also be using our Job Variable when we fill out the SQL Query and Target Table values.

![model\_7](https://blog.ippon.tech/hubfs/Imported_Blog_Media/matillion_variables_7-2.png)

Here we’ll use ${table\_name} to signify that we want to use the value found in our Job variable. Since the Table Iterator will make sure we go through each entry in our list of tables, we’ll be able to bring in each table by simply using these two components and one Job variable.

### Conclusion

Matillion variables make it easy to create dynamically driven jobs that can rely on data found outside of Matillion itself. This can allow anyone to update jobs without having to go into Matillion at all, in this case adding new data to bring into Snowflake by simply updating a table that contains table names.

Need help using Matillion? Need help designing and implementing your future Data Warehouse? Ippon can help! Send us a line at [contact@ippon.tech](mailto:contact@ippon.tech).

## Related Articles

##### [![Beyond Engineers: From Syntax to Strategy](https://blog.ippon.tech/hs-fs/hubfs/undefined-May-05-2026-01-02-24-3848-PM.png?width=520&height=294&name=undefined-May-05-2026-01-02-24-3848-PM.png) Software Engineering • May 6, 2026 Beyond Engineers: From Syntax to Strategy 7 min read](https://blog.ippon.tech/the-high-performing-engineer)

##### [![AI Readiness at Ippon, Part 3: The Road Ahead](https://blog.ippon.tech/hs-fs/hubfs/Ippon%20(3).png?width=520&height=294&name=Ippon%20(3).png) Software Engineering • March 17, 2026 AI Readiness at Ippon, Part 3: The Road Ahead 3 min read](https://blog.ippon.tech/ai-readiness-at-ippon-part-3-the-road-ahead)

##### [![AI Readiness at Ippon, Part 2 : What We Learned](https://blog.ippon.tech/hs-fs/hubfs/Ippon%20(2)-1.png?width=520&height=294&name=Ippon%20(2)-1.png) Software Engineering • March 10, 2026 AI Readiness at Ippon, Part 2 : What We Learned 3 min read](https://blog.ippon.tech/ai-readiness-at-ippon-part-2-what-we-learned)

### Comments

### Subscribe to Our Blog!

Stay informed with the latest insights and updates by signing up for our weekly blog newsletter – delivered straight to your inbox!

[Back to blog homepage »](https://blog.ippon.tech/)

![IpponLogoKleinBlue](https://blog.ippon.tech/hs-fs/hubfs/IpponLogoKleinBlue.png?width=247&height=73&name=IpponLogoKleinBlue.png "IpponLogoKleinBlue")

Ippon is a consulting and expertise firm, who is convinced that technology is a source of progress for society. We help our clients leverage their digital assets to design an appropriate strategy and deploy their transformation roadmap at scale.

#### Navigation

- [Home](https://ipponusa.com/)
- [About](https://ipponusa.com/about-us/)
- [Services](https://ipponusa.com/services/)
- [Blogs](https://blog.ippon.tech/?__hstc=223043268.1036d82247623b329dfefe4e92697801.1714729179243.1714729179243.1714729179243.1&__hssc=223043268.2.1714729179244&__hsfp=803678701)
- [eBooks](https://ipponusa.com/ebooks/)
- [The Data Pour](https://info.ippon.tech/the-data-pour?__hstc=223043268.1036d82247623b329dfefe4e92697801.1714729179243.1714729179243.1714729179243.1&__hssc=223043268.2.1714729179244&__hsfp=803678701)

[Contact Us](https://ipponusa.com/contact/)

[Join Us](https://ipponusa.com/careers/)

#### Services

- [Data & Analytics](https://ipponusa.com/service/data-analytics/)
- [Cloud Strategy](https://ipponusa.com/service/cloud-strategy/)
- [Artificial Intelligence](https://ipponusa.com/service/artificial-intelligence/)
- [Operating Model](https://ipponusa.com/service/operating-model/)
- [Platform Modernization](https://ipponusa.com/service/platform-moderization/)
- [Product Innovation](https://ipponusa.com/service/product-innovation/)

#### Ippon International

- [France](https://fr.ippon.tech/?__hstc=223043268.1036d82247623b329dfefe4e92697801.1714729179243.1714729179243.1714729179243.1&__hssc=223043268.2.1714729179244&__hsfp=803678701)
- [Australia](https://au.ippon.tech/?__hstc=223043268.1036d82247623b329dfefe4e92697801.1714729179243.1714729179243.1714729179243.1&__hssc=223043268.2.1714729179244&__hsfp=803678701)

- #### Contact
- Ippon Technologies  
  [3431 West Leigh Street Richmond, VA 23230, USA](https://maps.app.goo.gl/RySm6SAwZnsxeiLz9)
- [(844) 477- 6687](tel:8444776687)
- [Sales@ipponusa.com](mailto:Sales@ipponusa.com)

<https://www.facebook.com/IpponUSA/> <https://www.youtube.com/c/ipponusa> <https://www.linkedin.com/company/ippon-technology>

©Copyright 2024 Ippon USA. All Rights Reserved.   |   [Terms and Conditions](https://ipponusa.com/privacy-policy/)   |   [Privacy Policy](https://ipponusa.com/privacy-policy/)   |   [Website by Skol Marketing](https://skolmarketing.com/)

```json
{
  "@context" : "https://schema.org",
  "@type" : "BlogPosting",
  "author" : {
    "@type" : "Person",
    "name" : "Hector Sanchez",
    "url" : "https://blog.ippon.tech/author/hector-sanchez"
  },
  "dateModified" : "2024-01-25T18:40:34.750Z",
  "datePublished" : "2022-08-11T17:40:00.000Z",
  "headline" : "Power your Data Pipeline with Matillion Variables",
  "image" : [ "https://blog.ippon.tech/hubfs/Imported_Blog_Media/matillion_variables_cover-1-3.png" ],
  "mainEntityOfPage" : {
    "@id" : "https://blog.ippon.tech/power-your-data-pipeline-with-matillion-variables",
    "@type" : "WebPage"
  },
  "publisher" : {
    "@type" : "Organization",
    "logo" : {
      "@type" : "ImageObject",
      "url" : "https://blog.ippon.tech/hubfs/logo_SVG.svg"
    },
    "name" : "Ippon Technologies"
  }
}
```