{
"cells": [
{
"cell_type": "markdown",
"metadata": {
"colab_type": "text",
"id": "view-in-github"
},
"source": [
"![\"Open](\"https://colab.research.google.com/assets/colab-badge.svg\")
"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "MCVQrt2M6Kbg"
},
"source": [
"# Chapter 7 - Go Beyond Plotly Express\n",
"\n",
"Plotly Express is convenient and fast, but it can only take you to select designations. To go where Plotly Express cannot reach, you can resort to Plotly, the foundational library that Plotly Express was built on.\n",
"\n",
"Since Plotly Express does not provide a Pareto chart, let's build one from scratch using Plotly.\n",
"\n",
"Using 2020 population of countries as an example.\n",
"\n",
"Demonstrate the use of subplots with secondary Y axis.\n",
"\n",
"Demonstrate the use of color scales and how to hide the scale."
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "cN8ayVueywnO",
"outputId": "ac1789ce-16d6-4ca1-c2cc-ad21e847e66d"
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"Requirement already satisfied: plotly in /usr/local/lib/python3.7/dist-packages (5.3.1)\n",
"Requirement already satisfied: tenacity>=6.2.0 in /usr/local/lib/python3.7/dist-packages (from plotly) (8.0.1)\n",
"Requirement already satisfied: six in /usr/local/lib/python3.7/dist-packages (from plotly) (1.15.0)\n"
]
}
],
"source": [
"# As of this writing, the Google Colab has Plotly version 4.4.1 pre-installed\n",
"# We need to upgrade it to the latest version\n",
"\n",
"!pip install --upgrade plotly"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "qKNd5wkciFWE"
},
"source": [
"To note, for this chapter, we will not import Plotly Express module. WE will import Plotly's graph_objects module instead. "
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/",
"height": 35
},
"id": "9xMXPdyEZQvS",
"outputId": "51d33d30-4f40-4c88-fd3e-c91b68560178"
},
"outputs": [
{
"data": {
"application/vnd.google.colaboratory.intrinsic+json": {
"type": "string"
},
"text/plain": [
"'5.3.1'"
]
},
"execution_count": 2,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"import numpy as np # We use numpy to generate some sample data for ploting\n",
"import plotly.graph_objects as go # graph_opjects package is the core of plotly\n",
"import plotly.io as pio\n",
"\n",
"import plotly\n",
"plotly.__version__"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "WR1HbwfL50ha"
},
"source": [
"## 7.1 Plotly Basics\n",
"\n",
"Plotly uses Java Script Object Notation (JSON) format to describe how data are visualized. JSON is a standard format for web applications and data integrations. It is similar to Python's dictionary object and uses key-value pairs to describe data and computing instructions.\n",
"\n",
"A Plotly data visualization is represented by a **Figure** object. A figure has two components: **Data** and **Layout**. \n",
"\n",
"The data component is is a list of **Traces**. A trace describes any predefined type of charts such as boxplot, bar chart, and scatter plot and any custom-coded type of charts.\n",
"\n",
"The layout component describes the overall characteristics of a figure such as its title, legend, and titles of the axes among many others. \n",
"\n",
"A sophisticated visualization can be implemented by incorporating multiple traces each representing a unique visual component with customized layout.\n",
"\n",
"\n"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "X1e_erkW6Y69"
},
"source": [
"## 7.2 A \"Hello World\" Chart\n",
"This example uses the method `update_layout()` of Figure class to add a title for the figure as well as the X axis and Y axis.\n",
"\n",
"This simple chart has no data to display. \n",
"\n"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/",
"height": 542
},
"id": "r5cSLIn95yA0",
"outputId": "3eab0538-d90a-4bb3-fe84-ecc01445ff82"
},
"outputs": [
{
"data": {
"text/html": [
"\n",
"\n",
"\n",
" \n",
"\n",
""
]
},
"metadata": {},
"output_type": "display_data"
}
],
"source": [
"fig = go.Figure()\n",
"fig.update_layout(title=\"Hello World!\")\n",
"\n",
"# Alternatively,\n",
"# my_layout = go.Layout(title=\"Hello World!\")\n",
"# fig = go.Figure(layout = my_layout)\n",
"\n",
"fig.show()"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "86eKv7GoQ0Vj"
},
"source": [
"Here, the outpt shows thie figure has no data but its layout has a value for the title. "
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "9F7_u7yQQ1r6",
"outputId": "36abdb60-d310-4b7c-a22f-b60c29054f6a"
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"Figure({\n",
" 'data': [], 'layout': {'template': '...', 'title': {'text': 'Hello World!'}}\n",
"})\n"
]
}
],
"source": [
"print(fig)"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "Serpor70659a"
},
"source": [
"## 7.3. A Boxplot of Ages of Some Men\n",
"\n",
"Here, we create a trace of type \"boxplot\" for a list of numbers and add it to the Figure object using `add_trace()` method of the Figure class. A trace is represented by a Python dictionary data type which contains key-value pairs. We use the Graph object's box() method to create the trace. Alternatively, we can just create a Python dictionary. See the sectoin on Best Practices of which option to choose.\n",
"\n",
"#### Statistics Background\n",
"\n",
"\"A boxplot is a standardized way of displaying the distribution of data based on a five number summary (“minimum”, first quartile (Q1), median, third quartile (Q3), and “maximum”). It can tell you about your outliers and what their values are. It can also tell you if your data is symmetrical, how tightly your data is grouped, and if and how your data is skewed.\"\n",
"\n",
"https://towardsdatascience.com/understanding-boxplots-5e2df7bcbd51\n",
"\n",
"Fences can be used to illustrate extreme values (outliers) in box plots. Sometimes you might see reference to “inner fences” and “outer fences”. These are defined as:\n",
"- Lower inner fence: Q1 – (1.5 * IQR)\n",
"- Upper inner fence: Q3 + (1.5 * IQR)\n",
"- Lower outer fence: Q1 – (3 * IQR)\n",
"- upper outer fence: Q3 + (3 * IQR)\n",
"\n",
"Points beyond the inner fences in either direction are mild outliers; \n",
"\n",
"points beyond the outer fences in either direction are extreme outliers.\n",
"\n",
"\n",
"In addition, we also add a title for the X Axis."
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "e1-NFq5N7Z5e",
"outputId": "684a9de9-6e1b-4e52-e325-434c6b41fb22"
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"[97 5 23 33 78 26 79 59 23 69 66 68 36 34 22 99 52 22 19 80]\n"
]
}
],
"source": [
"# Here, we use Numpy to generate a list of random numbers to represent the ages for a group of men.\n",
"\n",
"male_ages = np.random.randint(low=1, high=101, size=20) # 20 random integers between 1 and 101 excluding 101.\n",
"\n",
"print(male_ages)"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/",
"height": 542
},
"id": "98tdTOwn8FeR",
"outputId": "b1f8e83c-d752-4a1f-da46-75711d8532e0"
},
"outputs": [
{
"data": {
"text/html": [
"\n",
"\n",
"\n",
" \n",
"\n",
""
]
},
"metadata": {},
"output_type": "display_data"
}
],
"source": [
"# A trace is represented by a Python Dict object which contains key-value pairs.\n",
"# The key \"x\" represents the X Axis and its values are represented by a Python List object\n",
"# The key \"type\" represents the type of the chart, \"box\" for boxplot, \"scatter\" scatter plot, etc.\n",
"\n",
"trace_0 = go.Box( # type of chart: Boxplot\n",
" x=male_ages, \n",
" name=\"Male\" # The name of the trace, used as a legend to distinguish multiple traces.\n",
"\n",
")\n",
"\n",
"# Alternatively, just use the Python dictionary \n",
"# trace_0 = {\n",
"# \"x\":male_ages,\n",
"# \"type\":\"box\", # type of chart: Boxplot\n",
"# \"name\":\"Male\" # The name of the trace, used as a legend to distinguish multiple traces.\n",
"# }\n",
"\n",
"fig = go.Figure()\n",
"fig.add_trace(trace_0)\n",
"\n",
"# Alternatively,\n",
"# fig = go.Figure(data=[trace_0])\n",
"\n",
"fig.update_layout(\n",
" title=\"Boxplot of Ages of Some Men\",\n",
" xaxis={\"title\":\"Age\"} # This is equivalent to xaxis_title=\"Age\"\n",
")\n",
"\n",
"fig.show()"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "3bi4wKVURN4w"
},
"source": [
"Since Plotly figures are interactive, you can move your mouse around to see the five summary statistics.\n",
"\n",
"Here the print() function show that the figure has one trace of type boxplot and the data points. The figure also has some custom layout properties specified including its title, title for the X axis, and title for Y axis."
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "eWLqnvujROQN",
"outputId": "8d876057-ddf9-4842-99a5-0c21ab84f2cb"
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"Figure({\n",
" 'data': [{'name': 'Male',\n",
" 'type': 'box',\n",
" 'x': array([47, 48, 38, 1, 44, 80, 23, 66, 50, 80, 79, 44, 61, 66, 43, 82, 51, 68,\n",
" 42, 70])}],\n",
" 'layout': {'template': '...', 'title': {'text': 'Boxplot of Ages of Some Men'}, 'xaxis': {'title': {'text': 'Age'}}}\n",
"})\n"
]
}
],
"source": [
"print(fig)"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "INDBLbZNS8TP"
},
"source": [
"## 7.4. A Boxplot of Ages of Some Men and Women\n",
"We add another trace representing the boxplot of ages of some women."
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/",
"height": 542
},
"id": "Vc7pT8Xj9ACJ",
"outputId": "34959047-df2e-4152-840b-44dcf9dfcd3d"
},
"outputs": [
{
"data": {
"text/html": [
"\n",
"\n",
"\n",
" \n",
"\n",
""
]
},
"metadata": {},
"output_type": "display_data"
}
],
"source": [
"male_ages = np.random.randint(low=1, high=100, size=20)\n",
"\n",
"trace_0 = go.Box( \n",
" x=male_ages, \n",
" name=\"Male\" \n",
")\n",
"\n",
"female_ages = np.random.randint(low=1, high=100, size=20)\n",
"\n",
"trace_1 = go.Box( \n",
" x=female_ages, \n",
" name=\"Female\" \n",
")\n",
"\n",
"fig = go.Figure()\n",
"fig.add_trace(trace_0)\n",
"fig.add_trace(trace_1)\n",
"\n",
"# Alternatively,\n",
"# fig = go.Figure(data=[trace_0, trace_1])\n",
"\n",
"fig.update_layout(\n",
" title=\"Boxplot of Ages of Some Men and Women\",\n",
" xaxis={\"title\":\"Age\"},\n",
" showlegend=True # The legend can be shown or hidden\n",
")\n",
"\n",
"fig.show()"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "g5W2FQZos4D0"
},
"source": [
"Since we already have the label \"Male\" and \"Female\" for the Y axis, the color legend on the upper right is not necessary. We can hide it by changing the `showlegend` property of the Layout to `False`. "
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/",
"height": 542
},
"id": "LLdnBRWxfTFD",
"outputId": "2f9a5c58-4be3-4aa2-c6dc-4cd88b0f087c"
},
"outputs": [
{
"data": {
"text/html": [
"\n",
"\n",
"\n",
" \n",
"\n",
""
]
},
"metadata": {},
"output_type": "display_data"
}
],
"source": [
"fig.update_layout(showlegend=False)\n",
"\n",
"# Alternatively,\n",
"# fig.layout.showlegend = False\n",
"\n",
"fig.show()"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "Q9eiWP_MLUvl"
},
"source": [
"## 7.5 Plotly Flexibility"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "fMFCpJSmKROf"
},
"source": [
"### 7.5.1 Different Ways to Create a Figure \n",
"\n",
"We can create an empty Figure object and then add traces and update layout properties like this:\n",
"```\n",
"trace_0 = go.Box( \n",
" x=male_ages, \n",
" name=\"Male\" \n",
")\n",
"\n",
"fig = go.Figure()\n",
"fig.add_trace(trace_0)\n",
"fig.update_layout(title=\"A Boxplot\")\n",
"```\n",
"Alternatively, we can create traces and add them to the Data object and create a Layout object with some specified properties and then create the figure using the Data object and Layout object as inputs:\n",
"\n",
"```\n",
"trace_0 = go.Box( \n",
" x=male_ages, \n",
" name=\"Male\" \n",
")\n",
"\n",
"my_layout = go.Layout(title=\"A Boxplot\")\n",
"fig = go.Figure(data=[trace_0], layout=my_layout)\n",
"```\n",
"\n",
"\n",
" "
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "mqw_XHQc4Ns8"
},
"source": [
"### 7.5.2 Different Ways to Create a Trace\n",
"\n",
"We can use a specifc method of the Graph object. Here we use Box() method to create a Boxplot. This method creates a Python dictionary object to represent a Boxplot.\n",
"\n",
"```\n",
"trace_0 = go.Box(\n",
" x=[10, 3, -5, -35, 23, 8, 78, -65, 13,31, 82], \n",
" name=\"Trace Name\" \n",
")\n",
"```\n",
"\n",
"Alternatively, we can use a Python dictionary object to represent a trace:\n",
"\n",
"```\n",
"trace_0 = { \n",
" \"x\":[10, 3, -5, -35, 23, 8, 78, -65, 13,31, 82], \n",
" \"type\":\"box\",\n",
" \"name\":\"Trace Name\" \n",
"}\n",
"```"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "-FuWf3QJ4Ujh"
},
"source": [
"### 7.5.3 Different Ways to Specify a Layout Property\n",
"\n",
"For example, to specify the title of the X axis, the following three methods work the same:\n",
"\n",
"- `fig.update_layout(xaxis={\"title\":\"Age\"})`\n",
"- `fig.update_layout(xaxis_title=\"Age\")`\n",
"- `fig.layout.xaxis.title = \"Age\"`"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "617kWkhT4Zoz"
},
"source": [
"Python is a flexible language and offers alternative ways to achieve the same outcome. In some cases, there are industry best practices. For example, the commonly used indentation is four spaces. In other cases, it is up to your personal preference. In the latter, you should try to pick one and use it consistently. "
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "cGoqBAsYUaZQ"
},
"source": [
"\n",
"## 7.6. Steps to Create a Plotly Visualization\n",
"\n",
"Here are the steps to create a plotly chart:\n",
"\n",
"1. Create an instance of the Figure class. \n",
"2. Create traces (one or more) each representing a plot.\n",
"3. Add the traces to the Figure instance.\n",
"4. Update the layout of the figure (title, legend, etc.).\n",
"5. Display or export the figure."
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "tYAza6czLtNU"
},
"source": [
"## 7.7 Create a Pareto Chart\n",
"\n"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "om3YpkFTMLmY"
},
"outputs": [],
"source": [
"df = pd.read_csv(\"wdi_data.csv\")\n",
"df.head()"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "ebwvX4VpMIob"
},
"outputs": [],
"source": [
"trace_0 = go.Bar(\n",
" x=df[\"Country Name\"],\n",
" y=df[\"value\"]\n",
")\n",
"\n",
"fig = go.Figure()\n",
"\n",
"fig.add_trace(trace_0)\n",
"\n",
"fig.show()"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "AxWoeCejMO7k"
},
"outputs": [],
"source": [
"df.sort_values(by=\"value\", ascending=False, inplace=True)\n",
"df.head()"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "k8yQBpYEMSGO"
},
"outputs": [],
"source": [
"trace_0 = go.Bar(\n",
" x=df[\"Country Name\"],\n",
" y=df[\"value\"],\n",
" marker=dict(color=df[\"value\"], coloraxis=\"coloraxis\") \n",
")\n",
"\n",
"fig = go.Figure()\n",
"\n",
"fig.add_trace(trace_0)\n",
"\n",
"fig.update_layout(\n",
" title=\"2020 Population by Country\",\n",
" yaxis={\"title\":\"2020 Population\"}\n",
")\n",
"\n",
"fig.show()"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "u6C0ixxqMksx"
},
"outputs": [],
"source": [
"df[\"cumulative_%\"] = 100 * df[\"value\"].cumsum() / df[\"value\"].sum()\n",
"df.head()"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "GO7ONcLoMonk"
},
"outputs": [],
"source": [
"trace_1 = go.Scatter(\n",
" x=df[\"Country Name\"],\n",
" y=df[\"cumulative_%\"],\n",
" mode=\"markers+lines\"\n",
")\n",
"\n",
"fig = make_subplots(specs=[[{\"secondary_y\": True}]])\n",
"\n",
"fig.add_trace(trace_0)\n",
"\n",
"fig.add_trace(trace_1,secondary_y=True)\n",
"\n",
"fig.update_layout(\n",
" title=\"2020 Population by Countries\",\n",
" yaxis={\"title\":\"2020 Population\"},\n",
" showlegend=False,\n",
" coloraxis_showscale=False\n",
")\n",
"\n",
"#fig.update(layout_coloraxis_showscale=False)\n",
"\n",
"fig.show()"
]
}
],
"metadata": {
"colab": {
"authorship_tag": "ABX9TyOgy15txddZP7nE43ssZhPr",
"include_colab_link": true,
"name": "chapter_01.ipynb",
"provenance": [],
"toc_visible": true
},
"kernelspec": {
"display_name": "Python 3",
"name": "python3"
},
"language_info": {
"name": "python"
}
},
"nbformat": 4,
"nbformat_minor": 0
}