diff --git a/quickstarts/manage-data/run-bulkloads-efficiently-with-teradata-parallel-transporter.md b/quickstarts/manage-data/run-bulkloads-efficiently-with-teradata-parallel-transporter.md index 22e64772a2..e56d147799 100644 --- a/quickstarts/manage-data/run-bulkloads-efficiently-with-teradata-parallel-transporter.md +++ b/quickstarts/manage-data/run-bulkloads-efficiently-with-teradata-parallel-transporter.md @@ -1,11 +1,11 @@ --- sidebar_position: 11 -author: Adam Tworkiewicz -email: adam.tworkiewicz@teradata.com +author: Adam Tworkiewicz, Janeth Graziani +email: developer.relations@teradata.com page_last_update: April 6th, 2022 title: Load data with TPT -description: Load data into Vantage efficiently using Teradata Parallel Transporter (TPT). -keywords: [data warehouses, compute storage separation, teradata, vantage, cloud data platform, object storage, business intelligence, enterprise analytics, Fastload, Teradata Parallel Transporter, TPT] +description: Load data into Teradata efficiently using Teradata Parallel Transporter (TPT). +keywords: [data warehouses, compute storage separation, teradata, teradata database, cloud data platform, object storage, business intelligence, enterprise analytics, Fastload, Teradata Parallel Transporter, TPT] id: run-bulkloads-efficiently-with-teradata-parallel-transporter --- @@ -16,11 +16,11 @@ import Tabs from '../_partials/tabsTPT.mdx'; ## Overview -We often have a need to move large volumes of data into Vantage. Teradata offers `Teradata Parallel Transporter (TPT)` utility that can efficiently load large amounts of data into Teradata Vantage. This how-to demonstrates how to use `TPT`. In this scenario, we will load over 300k records, over 40MB of data, in a couple of seconds. +We often have a need to move large volumes of data into Teradata. Teradata offers `Teradata Parallel Transporter (TPT)` utility that can efficiently load large amounts of data into Teradata. This how-to demonstrates how to use `TPT`. In this scenario, we will load over 300k records, over 40MB of data, in a couple of seconds. ## Prerequisites -* Access to a Teradata Vantage instance. +* Access to a Teradata instance. * Download Teradata Tools and Utilities (TTU) - supported platforms: [Windows](https://downloads.teradata.com/download/tools/teradata-tools-and-utilities-windows-installation-package), [MacOS](https://downloads.teradata.com/download/tools/teradata-tools-and-utilities-mac-osx-installation-package), [Linux](https://downloads.teradata.com/download/tools/teradata-tools-and-utilities-linux-installation-package-0) (requires registration). @@ -36,7 +36,7 @@ We will be working with the US tax fillings for nonprofit organizations. Nonprof ## Create a database -Let's create a database in Vantage. Use your favorite SQL tool to run the following query: +Let's create a database in Teradata. Use your favorite SQL tool to run the following query: ``` sql CREATE DATABASE irs @@ -46,13 +46,13 @@ AS PERMANENT = 120e6, -- 120MB ## Run TPT -We will now run `TPT`. `TPT` is a command-line tool that can be used to load, extract and update data in Teradata Vantage. These various functions are implemented in so called `operators`. For example, loading data into Vantage is handled by the `Load` operator. The `Load` operator is very efficient in uploading large amounts of data into Vantage. The `Load` operator, in order to be fast, has several restrictions in place. It can only populate empty tables. Inserts to already populated tables are not supported. It doesn't support tables with secondary indices. Also, it won't insert duplicate records, even if a table is a `MULTISET` table. For the full list of restrictions check out [Teradata® TPT Reference - Load Operator - Restrictions and Limitations](https://docs.teradata.com/r/Teradata-Parallel-Transporter-Reference/February-2022/Load-Operator/Usage-Notes/Normalized-Tables/Restrictions-and-Limitations). +We will now run `TPT`. `TPT` is a command-line tool that can be used to load, extract and update data in Teradata. These various functions are implemented in so called `operators`. For example, loading data into Teradata is handled by the `Load` operator. The `Load` operator is very efficient in uploading large amounts of data into Teradata. The `Load` operator, in order to be fast, has several restrictions in place. It can only populate empty tables. Inserts to already populated tables are not supported. It doesn't support tables with secondary indices. Also, it won't insert duplicate records, even if a table is a `MULTISET` table. For the full list of restrictions check out [Teradata® TPT Reference - Load Operator - Restrictions and Limitations](https://docs.teradata.com/r/Teradata-Parallel-Transporter-Reference/February-2022/Load-Operator/Usage-Notes/Normalized-Tables/Restrictions-and-Limitations). -TPT has its own scripting language. The language allows you to prepare the database with arbitrary SQL commands, declare the input source and define how the data should be inserted into Vantage. +TPT has its own scripting language. The language allows you to prepare the database with arbitrary SQL commands, declare the input source and define how the data should be inserted into Teradata. -To load the csv data to Vantage, we will define and run a job. The job will prepare the database. It will remove old log and error tables and create the target table. It will then read the file and insert the data into the database. +To load the csv data to Teradata, we will define and run a job. The job will prepare the database. It will remove old log and error tables and create the target table. It will then read the file and insert the data into the database. -* Create a job variable file that will tell TPT how to connect to our Vantage database. Create file `jobvars.txt` and insert the following content. Replace `host` with the host name of your database. For example, if you are using a local Vantage Express instance, use `127.0.0.1`. `username` with the database user name, and `password` with the database password. Note that the preparation step (DDL) and the load step have their own configuration values and that the config values need to be entered twice to configure both the DDL and the load step. +* Create a job variable file that will tell TPT how to connect to our Teradata database. Create file `jobvars.txt` and insert the following content. Replace `host` with the host name of your database. For example, if you are using a local Teradata Express instance, use `127.0.0.1`. `username` with the database user name, and `password` with the database password. Note that the preparation step (DDL) and the load step have their own configuration values and that the config values need to be entered twice to configure both the DDL and the load step. ``` bash , id="tpt_first_config", role="emits-gtm-events" TargetTdpId = 'host' @@ -241,18 +241,13 @@ AS ( NO PRIMARY INDEX; ``` -The NOS solution is convenient as it doesn't depend on additional tools. It can be implemented using only SQL. It performs well, especially for Vantage deployments with a high number of AMPs as NOS tasks are delegated to AMPs and run in parallel. Also, splitting the data in object storage into multiple files may further improve performance. +The NOS solution is convenient as it doesn't depend on additional tools. It can be implemented using only SQL. It performs well, especially for Teradata database deployments with a high number of AMPs as NOS tasks are delegated to AMPs and run in parallel. Also, splitting the data in object storage into multiple files may further improve performance. ## Summary -This how-to demonstrated how to ingest large amounts of data into Vantage. We loaded hundreds of thousands or records into Vantage in a couple of seconds using `TPT`. +This how-to demonstrated how to ingest large amounts of data into Teradata. We loaded hundreds of thousands or records in a couple of seconds using `TPT`. ## Further reading * [Teradata® TPT User Guide](https://docs.teradata.com/r/Teradata-Parallel-Transporter-User-Guide/February-2022) * [Teradata® TPT Reference](https://docs.teradata.com/r/Teradata-Parallel-Transporter-Reference/February-2022) * [Query data stored in object storage](./nos.md) - - -import CommunityLinkPartial from '../_partials/community_link.mdx'; - -