Data Science in VS Code tutorial
AI agents: See llms.txt for documentation discovery and navigation. Documentation articles are also available as Markdown by appending .md to the article URL. Join VS Code at Microsoft Ignite or catch the sessions online. A year of VS Code, wrapped. Explore the highlights. Data Science in VS Code tutorial View as Markdown Ask in VS Code Ask in VS Code Insiders This tutorial demonstrates using Visual Studio Code and the Microsoft Python extension with common data science libraries to explore a basic data science scenario.
Specifically, using passenger data from the Titanic, you will learn how to set up a data science environment, import and clean data, create a machine learning model for predicting survival on the Titanic, and evaluate the accuracy of the generated model. Prerequisites The following installations are required for the completion of this tutorial. Make sure to install them if you haven't already. Visual Studio Code The Python extension for VS Code and Jupyter extension for VS Code from the Visual Studio Marketplace.
For more details on installing extensions, see Extension Marketplace . Both extensions are published by Microsoft. Miniconda with latest Python Note : If you already have the full Anaconda distribution installed, you don't need to install Miniconda. Alternatively, if you'd prefer not to use Anaconda or Miniconda, you can create a Python virtual environment and install the packages needed for the tutorial using pip. If you go this route, you will need to install the following packages: pandas, jupyter, seaborn, scikit-learn, keras, and tensorflow. python -m pip install pandas jupyter seaborn scikit-learn keras tensorflow Set up a data science environment Visual Studio Code and the Python extension provide a great editor for data science scenarios.
With native support for Jupyter notebooks combined with Anaconda, it's easy to get started. In this section, you will create a workspace for the tutorial, create an Anaconda environment with the data science modules needed for the tutorial, and create a Jupyter notebook that you'll use for creating a machine learning model. Begin by creating an Anaconda environment for the data science tutorial. Open an Anaconda command prompt and run conda create -n myenv python=3.10 pandas jupyter seaborn scikit-learn keras tensorflow to create an environment named myenv .
For additional information about creating and managing Anaconda environments, see the Anaconda documentation . Next, create a folder in a convenient location to serve as your VS Code workspace for the tutorial, name it hello_ds . Open the project folder in VS Code by running VS Code and using the File > Open Folder command. You can safely trust opening the folder, since you created it. Once VS Code launches, create the Jupyter notebook that will be used for the tutorial.
Open the Command Palette ( ⇧⌘P (Windows, Linux Ctrl+Shift+P ) ) and select Create: New Jupyter Notebook . Note : Alternatively, from the VS Code File Explorer, you can use the New File icon to create a Notebook file named hello.ipynb . Save the file as hello.ipynb using File > Save As... . After your file is created, you should see the open Jupyter notebook in the notebook editor. For additional information about native Jupyter notebook support, you can read the Jupyter Notebooks topic.
Now select Select Kernel at the top right of the notebook. Choose the Python environment you created above in which to run your kernel. To manage your environment from VS Code's integrated terminal, open it up with ( ⌃` (Windows, Linux Ctrl+` ) ). If your environment is not activated, you can do so as you would in your terminal ( conda activate myenv ). Prepare the data This tutorial uses the Titanic dataset available on OpenML.org , which is obtained from Vanderbilt University's Department of Biostatistics at https://hbiostat.org/data .
The Titanic data provides information about the survival of passengers on the Titanic and characteristics about the passengers such as age and ticket class. Using this data, the tutorial will establish a model for predicting whether a given passenger would have survived the sinking of the Titanic. This section shows how to load and manipulate data in your Jupyter notebook. To begin, download the Titanic data from hbiostat.org as a CSV file (download links in the upper right) named titanic3.csv and save it to the hello_ds folder that you created in the previous section.
If you haven't already opened the file in VS Code, open the hello_ds folder and the Jupyter notebook ( hello.ipynb ), by going to File > Open Folder . Within your Jupyter notebook, begin by importing the pandas and numpy libraries, two common libraries used for manipulating data, and loading the Titanic data into a pandas DataFrame . To do so, copy the code below into the first cell of the notebook. For more guidance about working with Jupyter notebooks in VS Code, see the Working with Jupyter Notebooks documentation. import pandas as pd import numpy as np data = pd.read_csv( 'titanic3.csv' ) Now, run the cell using the Run cell icon or the Shift+Enter shortcut.
After the cell finishes running, you can view the data that was loaded using the Variables Explorer and Data Viewer. First select the Variables icon in the notebook's upper toolbar. A JUPYTER: VARIABLES pane will open at the bottom of VS Code. It contains a list of the variables defined so far in your running kernel. To view the data in the Pandas DataFrame previously loaded, select the Data Viewer icon to the left of the data variable.
Use the Data Viewer to view, sort, and filter the rows of data. After reviewing the data, it can then be helpful to graph some aspects of it to help visualize the relationships between the different variables. Alternatively, you can use the data viewing experience offered by other extensions like Data Wrangler . The Data Wrangler extension offers a rich user interface to show insights about your data and helps you perform data profiling, quality checks, transformations, and more.
Learn more about the Data Wrangler extension in our docs . Before the data can be graphed, you need to make sure that there aren't any issues with it. If you look at the Titanic csv file, one thing you'll notice is that a question mark ("?") was used to identify cells where data wasn't available. While Pandas can read this value into a DataFrame, the result for a column like age is that its data type will be set to object instead of a numeric data type, which is problematic for graphing.
This problem can be corrected by replacing the question mark with a missing value that pandas is able to understand. Add the following code to the next cell in your notebook to replace the question marks in the age and fare columns with the numpy NaN value. Notice that we also need to update the column's data type after replacing the values. Tip : To add a new cell you can use the insert cell icon that's in the bottom left corner of an existing cell.
Alternatively, you can also use the Esc to enter command mode, followed by the B key. data.replace( '?' , np.nan, inplace = True ) data = data.astype({ "age" : np.float64, "fare" : np.float64}) Note : If you ever need to see the data type that has been used for a column, you can use the DataFrame dtypes attribute. Now that the data is in good shape, you can use seaborn and matplotlib to view how certain columns of the dataset relate to survivability.
Add the following code to the next cell in your notebook and run it to see the generated plots. import seaborn as sns import matplotlib.pyplot as plt fig, axs = plt.subplots( ncols = 5 , figsize =( 30 , 5 )) sns.violinplot( x = "survived" , y = "age" , hue = "sex" , data =data, ax =axs[ 0 ]) sns.pointplot( x = "sibsp" , y = "survived" , hue = "sex" , data =data, ax =axs[ 1 ]) sns.pointplot( x = "parch" , y = "survived" , hue = "sex" , data =data, ax =axs[ 2 ]) sns.pointplot( x = "pclass" , y = "survived" , hue = "sex" , data =data,
The rest of this page is on the live site.