Skip to content

Installation

GitHub

Create or connect a GitHub account

GitHub is a platform for software development and version control using Git, allowing developers to store and manage their code. Create or connect to a GitHub account, you can either use your BSB mail address or your personal mail address.

| GitHub Sign Up

Create a GitHub repository

We will create a repository to centralize your project files, it will enable version control of your work. First we will access GitHub and we will create a new repossitory.

image no In the configuration page, you can reproduce the same configuration as pictured below:

image

Note

Please create a repository with the following format: intro_cloud_{YourName}. Avoid spaces and specific caracters.

Before leaving your repository, we will save the repository URL as pictured below:

image

Databricks

Databricks free account Creation

We will create a Databricks account to be able to work with Python directly online.

image

| Databricks Sign Up

Click on the sign-up button, select Google or another way to signup. Select France as your location country and click on Workspace create.

Now that we created a GitHub repository, we will link GitHub to Databricks to store our in code in a version control environment.

Go back to Databricks and select your Account, then Settings

image

Select Linked account > Add Git credentials > Link Git accounts

image

Select Link and authorize Databricks to access GitHub.

You have now linked your GitHub account with Databricks!

Clone Github repository to Databricks

Go to Workspace > Create > Git Folder and copy paste your GitHub repository URL

image

Create your first Notebook

image

Create a notebook within your GitHub folder named Python_basics.ipynb and open it to start to code.

Install Visual Studio Code

Visual Studio Code is an IDE developed by Microsoft that aims to program in different languages like Python.

You can install VS Code directly from their website with the following link:

| Download VS Code

Hence VS Code installed, you can install the following extensions:

image image image

Note

You will need to install Python if you don't already have it. You can also install other extensions if you want. Beware of your installation path. You should avoid any spaces in your folder or have one drive sync to your VS Code folder.

Install/import Packages

When you have complex environment, you may need to install several package at the same time. The file requirements.txt enables you to declare package to install in the same place to install them all. Create a file 'requirements.txt' and add the following packages:

  • pandas
  • numpy

Now we can call the file with the following command to install packages declared 

pip install -r requirements.txt

You can also install packages by packages calling pip install.

```python
pip install pandas
```

Once it is installed, you can import your new package and start to use the pandas' function. Here we have decided to add an alias to the import to avoid writing pandas before each pandas function. We can just use pd.{the pandas function to be used}.

```python
import pandas as pd # as keywords aim to create an alias. It allows you to use the function shortcut instead of the whole name
pd.DataFrame() # Function to transform an array/dict/iterable to a DataFrame type
```

Whenever you need to import only one function from your package you can use from (package} import (function).

```python
from pandas import DataFrame
```

Note

You have several ways to install a Python package: Directly from your notebook:

!pip install {package}
#OR
%pip install {package}

Directly from your terminal (Terminal>New Terminal>Command Prompt or Terminal>New Terminal>Powershell ):

pip install {package}

Create a Python environment

Before you can install any package within your VS Code repository, you will need to create an environment. There are several ways to create a Python environment (Conda environment, Venv through command line). In our case, we will create a Venv environment through the VS Code GUI.

??? warning "Troubleshooting"
    - If you try to execute some code through Powershell, you may have the error :  *Impossible to load the file Activate. because script execution is deactivated on this system.
    Consult about_Execution_Policies through the following [Microsoft documentation](https://go.microsoft.com/fwlink/?  inkID=135170)*.
    You can execute the following Powershell command directly in the terminal:

    ```Powershell
    Set-ExecutionPolicy Unrestricted -Scope Process
    ```
    - If you are not able to execute command line, you may add quote around your path if it contains special caracters

    ```Powershell
    yourCommand 'yourPath!'
    ```

Install GIT

Git is a tool that's used to manage multiple versions of source code edits that are then transferred to files in a Git repository.

Download GIT

Install Github Desktop

GitHub Desktop aims to facilitate the use of GitHub and manage easily your repositories, Commits, and Branches. You can connect to GitHub Desktop with your GitHub account.

| Download Github Desktop

Alpha Vantage account creation

Alpha Vantage provides real-time and historical financial market data through a set of powerful and developer-friendly data APIs and spreadsheets

Warning

If you are connected to the School Wifi you may have an error stating that you already have a key. To fix the error, please use your phone or share your phone's Wifi hotspot ("Partage de connexion" in French).

| Alpha Vantage Sign Up

Create a secret scope in Databricks

Go to https://{databricks-instance}#secrets/createScope. Replace {databricks-instance} with the workspace URL of your Databricks deployment. It should looks like the following URL:

[https://dbc-1234a5bc-6789.cloud.databricks.com#secrets/createScope]

Note

The URL is case sensitive, scope in createScope must use an uppercase "S".

Create scope: secret_keys In Manage Principal select all workspace users to specify which users have the MANAGE permission on the secret scope.

image

Click Create.

Use the Databricks CLI databricks secrets list-scopes command to verify that the scope was created successfully.

Create a secret in Databricks

Copy your API Key from Alpha Vantage to store it in Databricks. It will avoid having your secret available on GitHub. To create an alphavantage secret, use the following Python code:

Create a secret with Databricks
from databricks.sdk import WorkspaceClient

w = WorkspaceClient()

w.secrets.put_secret("secret_keys","AV_API_Key", string_value ="YourSecret")

--