From the course: Learning SnowflakeDB

Load SnowflakeDB from S3 - Snowflake Tutorial

From the course: Learning SnowflakeDB

Load SnowflakeDB from S3

- [Instructor] At this point I want to introduce the excellent Snowflake documentation because it is such a rich set of features. I could make a course that was, I don't know, eight hours long, 40 hours long from all the features. And I just don't want to do that but I do want to point you to resources so that you can learn more when it's appropriate. In particular for file loading the sections here which I've read all of them and done most of them are very well written, very useful. So I would recommend that to get to the next step of loading you do this tutorial, Bulk Loading from a Local File System Using the COPY command. So this is going to, as it says, describe how to load data from files into an internal Snowflake stage into a table. So this will be using the CLI. We're not going to take the time to do this manually but you notice there are nine steps to it and very well written. I'd really recommend this as an next step. So pause this video, go ahead and do this. And then in addition to that, the most common use case I think is going to be either loading locally or loading from S3. So the next tutorial covers that. So once you've mastered the using the CLI basically, then the next thing that you would want to do is use the CLI with files that aren't on your local machine but they're in an S3 bucket. And so again, this is another 20 to 30 minutes but I think it's time well spent. It takes you through the steps that I showed you in the previous movie, but with scripts. So creating a file format object, creating a named stage object, best practice again, copying data into the target table, resolving data load errors, and verifying the loaded data. Very crisply written, and really useful as a next step. In addition to that, if you have JSON data, because again great support for all things JSON in Snowflake DB, you can see that we've got a tutorial on that. And there is Parquet data as well. So in general, the Snowflake DB documentation is really outstanding. I haven't found one error and I am notorious for testing documentation and finding errors. So props to the documentation team. I would always recommend to for any feature that you're trying explore to go ahead and do the tutorials and then understand. And again, in this section, which is huge and really useful loading data, they talk about the considerations, preparation and all the different aspects of working with data for Snowflake DB. In addition to this they have a great tutorial on using Snowpipe which we'll talk a little bit about in the next movie.

Contents