Teradata Backup to Azure Blob Storage using Data Stream Controller (DSC)

In this video, we look at backing up and restoring Teradata database tables to Azure Blob Storage using Teradata Data Stream Controller and Viewpoint VMs deployed from Azure Marketplace. Video Walkthrough Tip: Play the video full screen. Table of Contents 00:00 – Introduction01:19 – Deploy Teradata Database Solution Template03:13 – View Deployment Status04:10 – Deployment…

0

Deploying Teradata Database Developer Tier on Azure

In this video walkthrough, I show how to deploy Teradata Database Developer Tier from Azure Marketplace, access Teradata Viewpoint management UI, install and use Teradata Studio GUI on Windows, and connect to Teradata database using bteq command line via SSH. Video Walkthrough Tip: Play the video full screen. Teradata on Azure Review Teradata on Azure…

0

Azure Marketplace API to programmatically review and accept publisher agreement/EULA

In this quick video walkthrough, I show how to use REST API to programmatically review and accept publisher agreement/EULA for Azure Marketplace VM images. NOTE: I will update this post with links to official documentation and relevant Azure PowerShell cmdlets when they become available. Video Walkthrough Tip: Play the video full screen. You will also…

0

Azure AD How To Create OAuth2PermissionGrant using Graph API ("Grant Permissions" and consent for application)

In this video, I walk through the process of creating Azure Active Directory objects such as Applications, Service Principals, and OAuth2 Permission Grants using the “Grant Permissions” button in the Azure Portal and via the Azure AD Graph API (graph.windows.net) using Postman to see the low-level REST calls. NOTE: For new development it is recommended…

0

Presto with Azure Cosmos DB, Azure SQL Database, MySQL, PostgreSQL, and Azure Blob Storage

In this example, I’m showing how to configure Presto connectors to query and join data from Azure Cosmos DB (using MongoDB API), Azure SQL Database, Azure Database for MySQL, and Azure Database for PostgreSQL while storing the joined results in Azure Blob Storage. Take a look at the video walkthrough below and the source code…

0

Presto querying data in Azure Blob Storage and Azure Data Lake Store

Recently, I created a simple POC of a single-node Presto querying data in Azure Blob Storage (WASB) and Azure Data Lake Store (ADLS). In my example, Presto (version 0.167 or 0.178) is accessing these data stores via Presto’s hive-hadoop2 connector (with a few additional JARs) and needs Hive metastore service to store the metadata about…

0

Accessing Azure Data Lake Store using WebHDFS with OAuth2 from Spark 2.0 that is running locally

Update from March 2017: Since posting this article in August 2016, Azure Data Lake Product Team  published three new and highly recommended blog posts: Connecting your own Hadoop or Spark to Azure Data Lake Store Making Azure Data Lake Store the default file system in Hadoop Wiring your older Hadoop clusters to access Azure Data…

3

Compile and build specific Hadoop source code branch using Azure VM

Sometimes you may want to test a Hadoop feature that is available in a specific branch that is not available as a binary release. For example, in my case, I want to try accessing Azure Data Lake Store (ADLS) via its WebHDFS endpoint. Access to ADLS requires OAuth2, support for which was added in Hadoop…

0

Accessing Azure Storage Blobs from Spark 1.6 that is running locally

When you are using HDInsight Hadoop or Spark clusters in Azure, they are automatically pre-configured to access Azure Storage Blobs via the hadoop-azure module that implements the standard Hadoop FilesSystem interface. You can learn more about how HDInsight uses blob storage at https://azure.microsoft.com/en-us/documentation/articles/hdinsight-hadoop-use-blob-storage/ In this article, I will show how we can configure a local…

3

How to create and test Azure Service Principal using Azure CLI

Many automation tools (e.g. HashiCorp’s Packer.io and Terraform) and SDKs (e.g. Azure SDK for Java, Ruby, Python, Go, Node, etc.) that communicate with Azure using the Azure Resource Manager (ARM) APIs need a “Service Principal” credential for authentication via Azure Active Directory. This credential is usually defined by specifying the following properties somewhere within the…

0