From the course: Introduction to Modern Data Engineering with Snowflake

Unlock this course with a free trial

Join today to access over 24,400 courses taught by industry experts.

Data transformations with snowpark

Data transformations with snowpark

If you're like me, then SQL might not be your preferred language of choice. I personally prefer Python, and I love that with Snowpark, I can use Python to perform my data transformations. With Snowpark, you can perform data transformations in Python, Java, or Scala. Snowpark allows you to configure the runtimes for these languages, meaning you can perform data transformations with, say, Python 3.9 or 3.10 or whichever version fits your language and use case best. Snowpark provides a DataFrame API for processing your data and performing your data transformations. The general pattern is that you'll create DataFrames using your data, perform whatever sorts of transformations you need to perform, and usually write those results back to new views or tables. If you've used PySpark prior to this or any other data framework with a DataFrame API, your Snowpark experience will feel very similar. Finally, if you've ever attempted to perform large-scale data operations using your own computer's…

Contents