Using Teradata TdBench to generate and load 300GB TPC-H data set on Azure


In this video, we walk through downloading, installing, configuring, and using Teradata TdBench 7.2 to generate and load 1GB and 300GB TPC-H data sets into Teradata Database (Developer Tier) deployed from Azure Marketplace.

Video Walkthrough

Tip: Play the video full screen.

Table of Contents

00:00 - Teradata TdBench 7.2 on Azure
02:36 - TdBench configuration
04:46 - Validate TdBench user
05:27 - Run tdb.sh
07:01 - Create tpch1g database
09:44 - Install Teradata Tools (tdload)
11:39 - Re-run data load
12:31 - Data load finished
13:21 - Create tpch300g database
14:17 - View iostat during data generation
15:16 - Data gen of 300G finished
16:50 - Load 300GB of files into tpch300g database
19:39 - Use Viewpoint to see tables being loaded
20:26 - 300GB data load finished
22:36 - Start serial TPC-H queries
23:34 - iostat during query execution
25:31 - View TdBench Result Tables
27:23 - Viewing results of 300GB serial run

Teradata TdBench 7.2

Create tpch1g database

CREATE DATABASE tpch1g AS PERM=10e9 SPOOL=10e9 TEMPORARY=10e9;
GRANT ALL ON tpch1g TO av_Benchmark WITH GRANT OPTION;

Check perm space used

SELECT 
	DatabaseName,
	SUM(CurrentPerm) As Used
FROM DBC.DiskSpace
WHERE DatabaseName = 'tpch1g'
GROUP BY DatabaseName;

Create tpch300g database

CREATE DATABASE tpch300g AS PERM=750e9 SPOOL=300e9 TEMPORARY=300e9;
GRANT ALL ON tpch300g TO av_Benchmark WITH GRANT OPTION;

Check perm space used

SELECT 
	DatabaseName,
	SUM(CurrentPerm) As Used
FROM DBC.DiskSpace
WHERE DatabaseName = 'tpch1g'
GROUP BY DatabaseName;

Add more perm space

MODIFY DATABASE tpch1g AS PERM = 10e9;

Run serial TPC-H commands to check empty tables

./tdbench.sh
exec scripts/tpch300g_serial.cmd

Run TPC-H data load command

./tdbench.sh
exec scripts/tpch300g_load.cmd

TdBench result tables

SELECT * FROM av_Benchmark.TestTracking;
SELECT * FROM av_Benchmark.RptTestDetail WHERE RUNID = 6;

Thank you!

Please leave feedback and questions below or on Twitter https://twitter.com/ArsenVlad

Comments (0)

Skip to main content