Data Warehouse Migration with Snowflake VSC and Flyway

February 5, 2021 | by DB

Wow! It has been a year since my last blog post.
This post was originally going to cover getting #Flyway set up with Snowflake. Then a couple of days ago, my friend Kent Graziano tweeted a link on getting Visual Studio Code (VSC) connected to Snowflake. Considering I had just come off a lengthy project where VSC was the IDE of choice, I figured, what the heck let’s get this set up. I’m sure to use this in some capacity in the future.

I then decided to see how I can use both VSC…


I was recently responding to a question about DBeaver and the ability to automatically generate an ERD. The following post will walk you through the process.

;TLDR
Looking for an easy way to create one of these?


#OnTapToday, using @StreamSets to migrate data from your source database to Snowflake. In this post, I will walk through the process of configuring StreamSets to migrate data from my on prem DB to Snowflake.

WHY

You need to get some data from a source database to the Snowflake data warehouse. There were a few options at my disposal. I could have:

StreamSets operates on a Hybrid Open- Source Model (HOSS). StreamSets Data Collector is open source, released under the Apache 2.0 license. The remainder of the platform source code is proprietary and not available to customers

In this case, I chose…


April 19, 2019 | by DB

I was asked a while ago by a twitter follower this question. “One year ago to now, how has your use of technology changed in your job role?” Interestingly enough, I celebrated 1 year @snowflakeDB on April 16, 2019. I think now is a good time to answer that question.

In a nutshell, a year ago, I was 100% focused on building out private cloud infrastructure on a single platform. If you have followed anything I’ve tweeted or written over the last 4 or 5 years, you know that platform to be Oracle. In…


In this installment, I am going to walk through the process of connecting GO to the Snowflake Data Warehouse Service (DWaaS). This tutorial requires that you have a Snowflake account. You can sign up here for a 30 day/$400.00 trial.

Download and Install the ODBC Driver

Once you have your account set up in Snowflake, follow the directions to download the ODBC Driver. It will the same place you find the snowSQL download:

Warehouse driver download
Warehouse driver download

Installing GO

Installing GO can be accomplished via Homebrew or visiting the GoLang download page. …


In this installment, I am going to walk through the process of connecting GO to the Snowflake Data Warehouse Service (DWaaS). This tutorial requires that you have a Snowflake account. You can sign up here for a 30 day/$400.00 trial.

Download and Install the ODBC Driver

Once you have your account set up in Snowflake, follow the directions to download the ODBC Driver. It will the same place you find the snowSQL download:

Warehouse driver download
Warehouse driver download

Installing GO

Installing GO can be accomplished via Homebrew or visiting the GoLang download page. …


ODTUG
ODTUG

One month ago, ODTUG Kscope18 was getting started, and one month ago was the first time in two years that I was not the Conference Chair, and today, I can say that my friend Opal did a damn good job at taking the ODTUG Kscope conference to the next level. Thank you Opal for your leadership and making this Kscope, like all others before it, “The best one ever!!”

As with each ODTUG Kscope, we kickoff with Community Service Day. …


This will be the first entry into my Snowflake toolbox. Today I am going to set my MacBook Pro up to connect to a Snowflake data warehouse via the Snowflake Node.js driver. This could come in handy when needing to move data between systems where direct connections are not available and you need an intermediary. Let’s get started.

This tutorial does require you to have access to a Snowflake data warehouse. If you don’t, you can sign up for a free trial account.

Install Homebrew. I prefer using this method to manage software packages. …


By the time this posts hits, I’ll be in the air heading to one of my favorite cities, San Francisco. —

My Sifu, Coach Sule, has that slogan as part of his email signature, and those are words are quite fitting. If you have been following me on Twitter, then you know that a lot is going on in the life and times of @dbaOnTap. The blog title definitely says it all and change is a comin’!!

Have you ever thought to yourself, life is great! I wouldn’t change a thing! How quickly those things can change. I had a…


About a week ago, I was presenting at ECO on JSON parsing in the Oracle 12c Database and an attendee asked a great question. To summarize, Maria Colgan gave a keynote in which she noted a feature in 12c that allows you to define a column as Case Insensitive. The attendee in my session asked if this also applied to JSON in the Oracle database.

There are enough posts on how to configure your database for case insensitivity so I won’t go into details but check out my friend Tim Hall, @oraclebase for some guidance here. I’d also recommend using…

Danny Bryant

Dad | Husband | Snowflake | Oracle ACE (Alumni)| Speaker | SCUBA Diver.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store