pmd_demonstrator-SPARQL.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "id": "badfcf26",
   "metadata": {},
   "source": [
    "# PMD Demonstrator: processing remotely hosted data \n",
    "\n",
    "In this Notebook, we show exemplary how *ontologically described experimental data* (tensile tests on various S355 steel specimen) may be explored and processed. The database is hosted on a remote server running ontodocker. First, a manual exploration via SPARQL-queries is shown. We follow a set of questions, \"translate\" them into SPARQL-queries and discuss the obtained ouput. Then, data is processed using a pyiron-workflow. After analising a single dataset, we batch-process all available datasets while avoiding the formulation of explicit SPARQL-queries by the user. Mechanical quantities are calculated ($E$-modulus, $R_{p0.2}$) and stress-strain curves are plotted.\n",
    "\n",
    "### Provided by the user:\n",
    "- A material-digital account\n",
    "- A SPARQL endpoint\n",
    "- An user specific API-token (generated by keycloak and retievable via the ontodocker GUI).\n",
    "  For running this notebook, this token has to be copied to a file `token.txt` located in the working directory.\n",
    "\n",
    "## The infrasturcture view\n",
    "\"Under the hood\" this procedure can be performed for a set of scenarios:\n",
    "1. **All involved computers/servers are exposed to the internet**  \n",
    "    The user works on an arbitrary computer which is connected to the internet.      \n",
    "    The ontological database + infrastructure (triplestore = ontodocker) is hosted on the PMD-C ([ontodocker-dev.material-digital.de](ontodocker-dev.material-digital.de)) or any PMD-S which is exposed to the internet.\n",
    "    Of course, the files containing the actual data also have to be either publicly available or available within the users subnet in this situation.\n",
    "\n",
    "2. **All involved computers are exposed within the wireguard mesh**\n",
    "   In this situation, the user is working on some PMD-S instance (e.g. [pyiron.material-digital.de](pyiron.material-digital.de)). There you can either select an appropriate image (e.g. \"PMD Demonstrator\") or some other pre-configured conda-environment within a jupyter session. Perhaps one has to install some more packages (e.g. for running this notebook, see `environment.yml`). The datafiles may be hosted either on some server available within the mesh or on the public internet.\n",
    "\n",
    "3. **The user works on some machine within a strongly restricted environment** (e.g. @ BAM)\n",
    "   Ontodocker and the datafiles are hosted on a server within the same network, the wireguard mesh or the internet.\n",
    "\n",
    "From the user side, all these scenarios \"feel the same\", i.e. the interface and steps to perform do not differ (or may only differ to a trivial extend)."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "35f23431",
   "metadata": {},
   "source": [
    "# Exploring the data via SPARQL-queries"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "839531d9-d049-41a8-be66-575641c62ddf",
   "metadata": {},
   "source": [
    "First, we import some modules to perform SPARQL-queries and to nicely format the retrieved output:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "id": "fad70622",
   "metadata": {},
   "outputs": [],
   "source": [
    "from SPARQLWrapper import SPARQLWrapper, JSON # SPARQL-queries from python\n",
    "from tabulate import tabulate # formatting output in tables\n",
    "import pandas as pd # dataframes"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "582e3468-a4fd-4f67-8a2c-6fcb236d5c69",
   "metadata": {},
   "source": [
    "The next step is to **define the SPARQL endpoint** and to **read the users API-token**. Both may be copied from the ontodocker GUI."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "id": "a2ca594e-06b9-4d5c-8619-d705128ce9eb",
   "metadata": {},
   "outputs": [],
   "source": [
    "SPARQL_ENDPOINT = 'https://ontodocker-dev.material-digital.de/api/blazegraph/pmdco2_tto_example/sparql'\n",
    "\n",
    "def read_token(filename):\n",
    "    with open(filename, 'r') as f:\n",
    "        lines = f.readlines()\n",
    "    return \"Bearer \" + lines[0].replace('\\n','')\n",
    "\n",
    "TOKEN = read_token('./token.txt')\n",
    "\n",
    "# setup to perform the queries\n",
    "sparql = SPARQLWrapper(SPARQL_ENDPOINT)\n",
    "sparql.setReturnFormat('json')\n",
    "sparql.addCustomHttpHeader(httpHeaderName=\"Authorization\", httpHeaderValue=TOKEN)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "0d05c908-cd25-4a70-ac2f-f354ac9737db",
   "metadata": {},
   "source": [
    "Now, we can make queries."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "b7162785-d728-405b-83b1-832a6c7bd6e1",
   "metadata": {},
   "source": [
    "1. **For which materials is data available?**"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "id": "0e249b97-8fde-4636-af1c-42855aff2043",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "+----------------------------------------------------------+------------+\n",
      "| URI                                                      | Material   |\n",
      "|----------------------------------------------------------+------------|\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_process | S355       |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-1_process  | S355       |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-2_process  | S355       |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-3_process  | S355       |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-4_process  | S355       |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-5_process  | S355       |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-6_process  | S355       |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-7_process  | S355       |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-8_process  | S355       |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-9_process  | S355       |\n",
      "+----------------------------------------------------------+------------+\n"
     ]
    }
   ],
   "source": [
    "sparql.setQuery(\"\"\"\n",
    "PREFIX pmd: <https://w3id.org/pmd/co/>\n",
    "SELECT distinct ?p ?matDesVal\n",
    "WHERE {\n",
    "?s a pmd:TestPiece .\n",
    "?p pmd:input ?s .\n",
    "?p pmd:characteristic ?matDes .\n",
    "?matDes a pmd:materialDesignation .\n",
    "?matDes pmd:value ?matDesVal .\n",
    "} ORDER BY ?p\n",
    "\"\"\"\n",
    ")\n",
    "\n",
    "list = []\n",
    "try:\n",
    "    ret = sparql.queryAndConvert()\n",
    "    for r in ret['results']['bindings']:\n",
    "        row = []\n",
    "        for k in r.keys():\n",
    "            row.append(r[k]['value'])\n",
    "        list.append(row)\n",
    "\n",
    "except Exception as e:\n",
    "    print(e)\n",
    "\n",
    "df = pd.DataFrame(list, columns =[\"Material\", \"URI\"])\n",
    "print(tabulate(df[[\"URI\", \"Material\"]], headers=[\"URI\", \"Material\"], tablefmt='psql', showindex=False))"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "929dec3c-35f5-4680-a24d-bfcdf5123579",
   "metadata": {},
   "source": [
    "The query above prompts for the the process' **U**nified **R**esource **I**dentifier (= URI) and the respective \"materialDesignation\" = the name of the material as described in the ontology (here only S355 steel). In the example, a process corresponds to a specimen."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "170ce028-2ce3-4e81-8ab4-d65b6041dc9e",
   "metadata": {},
   "source": [
    "2. **What processes were performed on S355 steel?**"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "id": "56c3ec84-6374-43c0-867c-8933218b4f74",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "+----------------------------------------------------------+-------------------------------------+\n",
      "| URI                                                      | Process type                        |\n",
      "|----------------------------------------------------------+-------------------------------------|\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_process | https://w3id.org/pmd/co/TensileTest |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-1_process  | https://w3id.org/pmd/co/TensileTest |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-2_process  | https://w3id.org/pmd/co/TensileTest |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-3_process  | https://w3id.org/pmd/co/TensileTest |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-4_process  | https://w3id.org/pmd/co/TensileTest |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-5_process  | https://w3id.org/pmd/co/TensileTest |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-6_process  | https://w3id.org/pmd/co/TensileTest |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-7_process  | https://w3id.org/pmd/co/TensileTest |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-8_process  | https://w3id.org/pmd/co/TensileTest |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-9_process  | https://w3id.org/pmd/co/TensileTest |\n",
      "+----------------------------------------------------------+-------------------------------------+\n"
     ]
    }
   ],
   "source": [
    "sparql.setQuery(\"\"\"\n",
    "PREFIX pmd: <https://w3id.org/pmd/co/>\n",
    "SELECT distinct ?p ?type\n",
    "WHERE {\n",
    "?p a ?type .\n",
    "?matDes a pmd:materialDesignation .\n",
    "?matDes pmd:value \"S355\"^^xsd:string .\n",
    "?p pmd:characteristic ?matDes .\n",
    "} ORDER BY ?p\n",
    "\"\"\"\n",
    ")\n",
    "\n",
    "list = []\n",
    "try:\n",
    "    ret = sparql.queryAndConvert()\n",
    "    for r in ret['results']['bindings']:\n",
    "        row = []\n",
    "        for k in r.keys():\n",
    "            row.append(r[k]['value'])\n",
    "        list.append(row)\n",
    "\n",
    "except Exception as e:\n",
    "    print(e)\n",
    "\n",
    "df = pd.DataFrame(list, columns =[\"URI\", \"Process type\"])\n",
    "print(tabulate(df[[\"URI\",\"Process type\"]], headers=[\"URI\", \"Process type\"], tablefmt='psql', showindex=False))"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "a3a4227a-b097-46cd-a137-373fefbfaffe",
   "metadata": {},
   "source": [
    "We see that for each specimen a tensile test was perfomed."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "35779fe8-b756-4e5a-ab3f-b09f36f4590c",
   "metadata": {},
   "source": [
    "3. **In what orientation relative to the rolling direction was each specimen cut?**"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "id": "0d5ada44-730e-4673-86ad-10ece10cdec4",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "+----------------------------------------------------------+------------------------------------+\n",
      "| URI                                                      | cut orientation                    |\n",
      "|----------------------------------------------------------+------------------------------------|\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_process | diagonal to rolling direction      |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-1_process  | in rolling direction               |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-2_process  | in rolling direction               |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-3_process  | in rolling direction               |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-4_process  | in rolling direction               |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-5_process  | perpendicular to rolling direction |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-6_process  | perpendicular to rolling direction |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-7_process  | perpendicular to rolling direction |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-8_process  | perpendicular to rolling direction |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-9_process  | diagonal to rolling direction      |\n",
      "+----------------------------------------------------------+------------------------------------+\n"
     ]
    }
   ],
   "source": [
    "sparql.setQuery(\"\"\"\n",
    "PREFIX pmd: <https://w3id.org/pmd/co/>\n",
    "SELECT distinct ?p ?rollingDirection\n",
    "WHERE {\n",
    "?s a pmd:TestPiece .\n",
    "?p a pmd:TensileTest .\n",
    "?p pmd:input ?s .\n",
    "?p pmd:characteristic ?characteristic .\n",
    "?characteristic a pmd:MaterialRelated .\n",
    "?characteristic pmd:value ?rollingDirection .\n",
    "} ORDER BY ?p\n",
    "\"\"\"\n",
    ")\n",
    "\n",
    "list = []\n",
    "try:\n",
    "    ret = sparql.queryAndConvert()\n",
    "    for r in ret['results']['bindings']:\n",
    "        row = []\n",
    "        for k in r.keys():\n",
    "            row.append(r[k]['value'])\n",
    "        list.append(row)\n",
    "\n",
    "except Exception as e:\n",
    "    print(e)\n",
    "\n",
    "df = pd.DataFrame(list, columns =[\"URI\", \"cut orientation\"])\n",
    "print(tabulate(df[[\"URI\", \"cut orientation\"]], headers=[\"URI\", \"cut orientation\"], tablefmt='psql', showindex=False))"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "93d57939-a281-4ef9-a4b6-2a2d806f8e74",
   "metadata": {},
   "source": [
    "4. **Which device and standard was used for the measurements?**"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "id": "4dce5beb-4c58-4259-a9f9-17bf7e6eb38f",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "+----------------------------------------------------------+----------------------+------------------+\n",
      "| URI                                                      | Extensiometer name   | Standard         |\n",
      "|----------------------------------------------------------+----------------------+------------------|\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_process | HBM                  | DIN EN ISO 17025 |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-1_process  | HBM                  | DIN EN ISO 17025 |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-2_process  | HBM                  | DIN EN ISO 17025 |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-3_process  | HBM                  | DIN EN ISO 17025 |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-4_process  | HBM                  | DIN EN ISO 17025 |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-5_process  | HBM                  | DIN EN ISO 17025 |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-6_process  | HBM                  | DIN EN ISO 17025 |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-7_process  | HBM                  | DIN EN ISO 17025 |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-8_process  | HBM                  | DIN EN ISO 17025 |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-9_process  | HBM                  | DIN EN ISO 17025 |\n",
      "+----------------------------------------------------------+----------------------+------------------+\n"
     ]
    }
   ],
   "source": [
    "sparql.setQuery(\"\"\"\n",
    "PREFIX pmd: <https://w3id.org/pmd/co/>\n",
    "SELECT distinct ?p ?extensometerNameVal ?extensometerStandardVal\n",
    "WHERE {\n",
    "?s a pmd:TestPiece .\n",
    "?p a pmd:TensileTest .\n",
    "?p pmd:input ?s .\n",
    "?p pmd:characteristic ?metadata .\n",
    "?extensometerName a pmd:NodeName .\n",
    "?extensometerName pmd:value ?extensometerNameVal .\n",
    "?extensometerStandard a pmd:Norm .\n",
    "?extensometerStandard pmd:value ?extensometerStandardVal .\n",
    "FILTER (?extensometerName!=<https://w3id.org/pmd/ao/tte/_machineName>)\n",
    "FILTER (?extensometerStandard=<https://w3id.org/pmd/ao/tte/_extensometerStandard>)\n",
    "} ORDER BY ?p\n",
    "\"\"\"\n",
    ")\n",
    "\n",
    "list = []\n",
    "try:\n",
    "    ret = sparql.queryAndConvert()\n",
    "    for r in ret['results']['bindings']:\n",
    "        row = []\n",
    "        for k in r.keys():\n",
    "            row.append(r[k]['value'])\n",
    "        list.append(row)\n",
    "\n",
    "except Exception as e:\n",
    "    print(e)\n",
    "\n",
    "df = pd.DataFrame(list, columns =[\"Extensiometer name\", \"Standard\", \"URI\"])\n",
    "print(tabulate(df[[\"URI\", \"Extensiometer name\", \"Standard\"]], headers=[\"URI\", \"Extensiometer name\", \"Standard\"], tablefmt='psql', showindex=False))"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "cb487250-28a4-474e-8008-71a6ac4022ce",
   "metadata": {},
   "source": [
    "5. **Show all tensile tests that were performed.**"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "id": "fe0a328d-bab6-4c97-bc34-2ca586b3101f",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "+----------------------------------------------------------+-------------------------------------------------------------+\n",
      "| URI                                                      | Specimen name                                               |\n",
      "|----------------------------------------------------------+-------------------------------------------------------------|\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_process | https://w3id.org/pmd/ao/tte/testpiece_name/Zd3testpiece/Zd3 |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-1_process  | https://w3id.org/pmd/ao/tte/testpiece_name/Zx1testpiece/Zx1 |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-2_process  | https://w3id.org/pmd/ao/tte/testpiece_name/Zx2testpiece/Zx2 |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-3_process  | https://w3id.org/pmd/ao/tte/testpiece_name/Zx3testpiece/Zx3 |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-4_process  | https://w3id.org/pmd/ao/tte/testpiece_name/Zx4testpiece/Zx4 |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-5_process  | https://w3id.org/pmd/ao/tte/testpiece_name/Zy1testpiece/Zy1 |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-6_process  | https://w3id.org/pmd/ao/tte/testpiece_name/Zy2testpiece/Zy2 |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-7_process  | https://w3id.org/pmd/ao/tte/testpiece_name/Zy3testpiece/Zy3 |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-8_process  | https://w3id.org/pmd/ao/tte/testpiece_name/Zy4testpiece/Zy4 |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-9_process  | https://w3id.org/pmd/ao/tte/testpiece_name/Zd2testpiece/Zd2 |\n",
      "+----------------------------------------------------------+-------------------------------------------------------------+\n"
     ]
    }
   ],
   "source": [
    "sparql.setQuery(\"\"\"\n",
    "PREFIX pmd: <https://w3id.org/pmd/co/>\n",
    "SELECT distinct ?p ?s\n",
    "WHERE {\n",
    "?s a pmd:TestPiece .\n",
    "?p a pmd:TensileTest .\n",
    "?p pmd:input ?s .\n",
    "} ORDER BY ?p\n",
    "\"\"\"\n",
    ")\n",
    "\n",
    "list = []\n",
    "try:\n",
    "    ret = sparql.queryAndConvert()\n",
    "    for r in ret['results']['bindings']:\n",
    "        row = []\n",
    "        for k in r.keys():\n",
    "            row.append(r[k]['value'])\n",
    "        list.append(row)\n",
    "\n",
    "except Exception as e:\n",
    "    print(e)\n",
    "\n",
    "df = pd.DataFrame(list, columns =[\"URI\", \"Specimen name\"])\n",
    "print(tabulate(df[[\"URI\", \"Specimen name\"]], headers=[\"URI\", \"Specimen name\"], tablefmt='psql', showindex=False))"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "daed8257-2e78-45c6-b0f9-699b89381230",
   "metadata": {},
   "source": [
    "6. **For each process, show the URL to the data file.**"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "id": "f8606134-e28b-4ecb-96fe-979f0b5066f5",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "+----------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------+\n",
      "| URI                                                      | URL                                                                                                                     |\n",
      "|----------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------|\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_process | https://github.com/materialdigital/application-ontologies/tree/main/tensile_test_ontology_TTO/data/primary_data/Zd3.csv |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-1_process  | https://github.com/materialdigital/application-ontologies/tree/main/tensile_test_ontology_TTO/data/primary_data/Zx1.csv |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-2_process  | https://github.com/materialdigital/application-ontologies/tree/main/tensile_test_ontology_TTO/data/primary_data/Zx2.csv |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-3_process  | https://github.com/materialdigital/application-ontologies/tree/main/tensile_test_ontology_TTO/data/primary_data/Zx3.csv |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-4_process  | https://github.com/materialdigital/application-ontologies/tree/main/tensile_test_ontology_TTO/data/primary_data/Zx4.csv |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-5_process  | https://github.com/materialdigital/application-ontologies/tree/main/tensile_test_ontology_TTO/data/primary_data/Zy1.csv |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-6_process  | https://github.com/materialdigital/application-ontologies/tree/main/tensile_test_ontology_TTO/data/primary_data/Zy2.csv |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-7_process  | https://github.com/materialdigital/application-ontologies/tree/main/tensile_test_ontology_TTO/data/primary_data/Zy3.csv |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-8_process  | https://github.com/materialdigital/application-ontologies/tree/main/tensile_test_ontology_TTO/data/primary_data/Zy4.csv |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-9_process  | https://github.com/materialdigital/application-ontologies/tree/main/tensile_test_ontology_TTO/data/primary_data/Zd2.csv |\n",
      "+----------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------+\n"
     ]
    }
   ],
   "source": [
    "sparql.setQuery(\"\"\"\n",
    "PREFIX base: <https://w3id.org/pmd/co/>\n",
    "PREFIX csvw: <http://www.w3.org/ns/csvw#>\n",
    "SELECT ?url ?p\n",
    "WHERE {\n",
    "    ?p a base:TensileTest .\n",
    "    ?p base:characteristic ?dataset .\n",
    "    ?dataset a base:Dataset .\n",
    "    ?dataset base:resource ?table .\n",
    "    ?table a csvw:Table .\n",
    "    ?table csvw:url ?url .\n",
    "}\n",
    "ORDER BY ?p\n",
    "\"\"\"\n",
    ")\n",
    "\n",
    "list = []\n",
    "try:\n",
    "    ret = sparql.queryAndConvert()\n",
    "    for r in ret['results']['bindings']:\n",
    "        row = []\n",
    "        for k in r.keys():\n",
    "            row.append(r[k]['value'])\n",
    "        list.append(row)\n",
    "\n",
    "except Exception as e:\n",
    "    print(e)\n",
    "\n",
    "df = pd.DataFrame(list, columns =[\"URI\", \"URL\"])\n",
    "print(tabulate(df[[\"URI\", \"URL\"]], headers=[\"URI\", \"URL\"], tablefmt='psql', showindex=False))"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "5ff10921-9b72-47f9-bda7-02026e19e1df",
   "metadata": {},
   "source": [
    "For the following questions/ queries, we select one dataset as example:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "id": "696017b5-5781-4942-b02c-1ac5c1d6d4d4",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_process\n"
     ]
    }
   ],
   "source": [
    "example_uri = ret['results']['bindings'][0]['p']['value']\n",
    "print(example_uri)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "6351e0c1-cef8-4066-82fe-9aa895e78a8f",
   "metadata": {},
   "source": [
    "7. **Show all Metadata for the example uri, print the respective value and unit.**"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "8bfbc4f8-c7e3-4e05-a8f9-ef9ae293237a",
   "metadata": {},
   "source": [
    "*There are different types of metadata*.  \n",
    "`PrimaryData`: Data acquired before / after a process either refering to the geometry (e.g. width) of the specimen or as a register of the setup (e.g. original gauge length)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "id": "87b6d035-b93a-4367-ae16-d3f426e377d6",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "+----------------------------------------------------------+-----------------------------------------------------------------------------------+---------+------------------------------------+\n",
      "| URI                                                      | Quantity                                                                          |   value | unit                               |\n",
      "|----------------------------------------------------------+-----------------------------------------------------------------------------------+---------+------------------------------------|\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_process | https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_crossSectionArea_S0              | 120.707 | http://qudt.org/vocab/unit/MilliM2 |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_process | https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_crossSectionArea_s1              | 120.867 | http://qudt.org/vocab/unit/MilliM2 |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_process | https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_crossSectionArea_s2              | 120.544 | http://qudt.org/vocab/unit/MilliM2 |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_process | https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_crossSectionArea_s3              | 120.71  | http://qudt.org/vocab/unit/MilliM2 |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_process | https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_crossSectionArea_Su              |  43.924 | http://qudt.org/vocab/unit/MilliM2 |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_process | https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_finalGaugeLengthAfterFracture_Lu |  79.97  | http://qudt.org/vocab/unit/MilliM  |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_process | https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_originalGaugeLength_L0           |  60     | http://qudt.org/vocab/unit/MilliM  |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_process | https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_thickness_a1                     |   5.993 | http://qudt.org/vocab/unit/MilliM  |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_process | https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_thickness_a2                     |   5.985 | http://qudt.org/vocab/unit/MilliM  |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_process | https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_thickness_a3                     |   5.99  | http://qudt.org/vocab/unit/MilliM  |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_process | https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_thicknessAfterFracture_au        |   3.16  | http://qudt.org/vocab/unit/MilliM  |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_process | https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_width_b1                         |  20.168 | http://qudt.org/vocab/unit/MilliM  |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_process | https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_width_b2                         |  20.141 | http://qudt.org/vocab/unit/MilliM  |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_process | https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_width_b3                         |  20.152 | http://qudt.org/vocab/unit/MilliM  |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_process | https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_widthAfterFracture_bu            |  13.9   | http://qudt.org/vocab/unit/MilliM  |\n",
      "+----------------------------------------------------------+-----------------------------------------------------------------------------------+---------+------------------------------------+\n"
     ]
    }
   ],
   "source": [
    "sparql.setQuery(\"\"\"\n",
    "PREFIX pmd: <https://w3id.org/pmd/co/>\n",
    "SELECT distinct ?p ?o ?v ?u\n",
    "WHERE {{\n",
    "?s a pmd:TestPiece .\n",
    "?p a pmd:TensileTest .\n",
    "?p pmd:input ?s .\n",
    "?p pmd:characteristic ?o .\n",
    "?o a pmd:PrimaryData .\n",
    "?o pmd:value ?v .\n",
    "?o pmd:unit ?u .\n",
    "FILTER regex(str(?p), \"{0:s}\")\n",
    "}} ORDER BY ?p\n",
    "\"\"\".format(example_uri)\n",
    ")\n",
    "\n",
    "list = []\n",
    "try:\n",
    "    ret = sparql.queryAndConvert()\n",
    "    for r in ret['results']['bindings']:\n",
    "        row = []\n",
    "        for k in r.keys():\n",
    "            row.append(r[k]['value'])\n",
    "        list.append(row)\n",
    "\n",
    "except Exception as e:\n",
    "    print(e)\n",
    "\n",
    "df = pd.DataFrame(list, columns =['Quantity', 'URI', 'unit', 'value'])\n",
    "print(tabulate(df[['URI', 'Quantity', 'value', 'unit']], headers=[\"URI\", \"Quantity\", \"value\", \"unit\"], tablefmt='psql', showindex=False))"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "81a4dd91-ba41-4722-97eb-b00b513d731b",
   "metadata": {},
   "source": [
    "`Metadata`: Attributes and additional data (provenance) concerning the factory, laboratory, the process system and the objects which allow the evaluation of the quality / reliability of the measurements and a systematic search task of a database"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "id": "108ccc19-7141-43ba-90b1-af0ecb825e0d",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "+----------------------------------------------------------+---------------------------------------------------------------------------+---------+------------------------------------+\n",
      "| URI                                                      | Quantity                                                                  |   value | unit                               |\n",
      "|----------------------------------------------------------+---------------------------------------------------------------------------+---------+------------------------------------|\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_process | https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_environmentalTemperature |      20 | http://qudt.org/vocab/unit/DEG_C   |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_process | https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_extensometerGaugeLength  |      50 | http://qudt.org/vocab/unit/MilliM  |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_process | https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_transitionPoint          |       4 | http://qudt.org/vocab/unit/PERCENT |\n",
      "+----------------------------------------------------------+---------------------------------------------------------------------------+---------+------------------------------------+\n"
     ]
    }
   ],
   "source": [
    "sparql.setQuery(\"\"\"\n",
    "PREFIX pmd: <https://w3id.org/pmd/co/>\n",
    "SELECT distinct ?p ?o ?v ?u\n",
    "WHERE {{\n",
    "?s a pmd:TestPiece .\n",
    "?p a pmd:TensileTest .\n",
    "?p pmd:input ?s .\n",
    "?p pmd:characteristic ?o .\n",
    "?o a pmd:Metadata .\n",
    "?o pmd:value ?v .\n",
    "?o pmd:unit ?u .\n",
    "FILTER regex(str(?p), \"{0:s}\")\n",
    "}} ORDER BY ?p\n",
    "\"\"\".format(example_uri)\n",
    ")\n",
    "\n",
    "list = []\n",
    "try:\n",
    "    ret = sparql.queryAndConvert()\n",
    "    for r in ret[\"results\"][\"bindings\"]:\n",
    "        row = []\n",
    "        for k in r.keys():\n",
    "            row.append(r[k]['value'])\n",
    "        list.append(row)\n",
    "\n",
    "except Exception as e:\n",
    "    print(e)\n",
    "\n",
    "df = pd.DataFrame(list, columns =['Quantity', 'URI', 'unit', 'value'])\n",
    "print(tabulate(df[['URI', 'Quantity', 'value', 'unit']], headers=[\"URI\", \"Quantity\", \"value\", \"unit\"], tablefmt='psql', showindex=False))"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "1fce82bd-b738-4264-93a2-bb6a4dbc9b25",
   "metadata": {},
   "source": [
    "`SecondaryData`: Characteristic values (e.g. test results) determined by equations or algorithms using primary data and metadata for a process."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "id": "461fc620-8286-472b-a1da-8874abbbd9d2",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "+----------------------------------------------------------+------------------------------------------------------------------------------------+---------+------------------------------------+\n",
      "| URI                                                      | Quantity                                                                           |   value | unit                               |\n",
      "|----------------------------------------------------------+------------------------------------------------------------------------------------+---------+------------------------------------|\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_process | https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_maximumForce                      |  61.681 | http://qudt.org/vocab/unit/kiloN   |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_process | https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_modulusOfElasticity               | 195     | http://qudt.org/vocab/unit/GigaPa  |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_process | https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_percentageElongationAfterFracture |  33     | http://qudt.org/vocab/unit/PERCENT |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_process | https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_percentageReductionOfArea         |  64     | http://qudt.org/vocab/unit/PERCENT |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_process | https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_proofStrength_Rp02                | nan     | http://qudt.org/vocab/unit/MegaPa  |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_process | https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_tensileStrength                   | 511     | http://qudt.org/vocab/unit/MegaPa  |\n",
      "| https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_process | https://w3id.org/pmd/ao/tte/pmdao-tto-tt-S355-10_upperYieldStrength                | 396     | http://qudt.org/vocab/unit/MegaPa  |\n",
      "+----------------------------------------------------------+------------------------------------------------------------------------------------+---------+------------------------------------+\n"
     ]
    }
   ],
   "source": [
    "sparql.setQuery(\"\"\"\n",
    "PREFIX pmd: <https://w3id.org/pmd/co/>\n",
    "SELECT distinct ?p ?o ?v ?u\n",
    "WHERE {{\n",
    "?s a pmd:TestPiece .\n",
    "?p a pmd:TensileTest .\n",
    "?p pmd:input ?s .\n",
    "?p pmd:characteristic ?o .\n",
    "?o a pmd:SecondaryData .\n",
    "?o pmd:value ?v .\n",
    "?o pmd:unit ?u .\n",
    "FILTER regex(str(?p), \"{0:s}\")\n",
    "}} ORDER BY ?p\n",
    "\"\"\".format(example_uri)\n",
    ")\n",
    "\n",
    "list = []\n",
    "try:\n",
    "    ret = sparql.queryAndConvert()\n",
    "    for r in ret[\"results\"][\"bindings\"]:\n",
    "        row = []\n",
    "        for k in r.keys():\n",
    "            row.append(r[k]['value'])\n",
    "        list.append(row)\n",
    "\n",
    "except Exception as e:\n",
    "    print(e)\n",
    "\n",
    "df = pd.DataFrame(list, columns =['Quantity', 'URI', 'unit', 'value'])\n",
    "print(tabulate(df[['URI', 'Quantity', 'value', 'unit']], headers=[\"URI\", \"Quantity\", \"value\", \"unit\"], tablefmt='psql', showindex=False))"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "8d0b7283-59b2-41c6-b4c3-d85c0ec0bda1",
   "metadata": {},
   "source": [
    "8. **Show the URL of the data file for the example.**"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "id": "c1e3b60d-149c-4407-8916-aa2654a9eba2",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "https://github.com/materialdigital/application-ontologies/tree/main/tensile_test_ontology_TTO/data/primary_data/Zd3.csv\n"
     ]
    }
   ],
   "source": [
    "sparql.setQuery(\"\"\"\n",
    "PREFIX base: <https://w3id.org/pmd/co/>\n",
    "PREFIX csvw: <http://www.w3.org/ns/csvw#>\n",
    "SELECT ?url ?p\n",
    "WHERE {{\n",
    "    ?p a base:TensileTest .\n",
    "    ?p base:characteristic ?dataset .\n",
    "    ?dataset a base:Dataset .\n",
    "    ?dataset base:resource ?table .\n",
    "    ?table a csvw:Table .\n",
    "    ?table csvw:url ?url .\n",
    "    FILTER regex(str(?p), \"{0:s}\")\n",
    "}}\n",
    "ORDER BY ?p\n",
    "\"\"\".format(example_uri)\n",
    ")\n",
    "\n",
    "res = sparql.queryAndConvert()\n",
    "example_url = res[\"results\"][\"bindings\"][0][\"url\"][\"value\"]\n",
    "print(example_url)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "09296de3-7b26-46ca-995b-f9b9b809a1c5",
   "metadata": {},
   "source": [
    "This is not actually the raw csv but a html website. Accessing raw data hosted on github is easily done be doing some string replacements:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "id": "09db26f4-c241-4993-aa6d-44858fb4433f",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "https://raw.githubusercontent.com/materialdigital/application-ontologies/main/tensile_test_ontology_TTO/data/primary_data/Zd3.csv\n"
     ]
    }
   ],
   "source": [
    "def do_replacements(urls, orign_strings=[\"github.com\", \"tree/\"], replacements=[\"raw.githubusercontent.com\", \"\"]):\n",
    "    for orign_str, repl in zip(orign_strings, replacements):\n",
    "        urls = [new.replace(orign_str, repl) for new in urls]\n",
    "    return(urls)\n",
    "\n",
    "example_url_raw = do_replacements([example_url])[0]\n",
    "print(example_url_raw)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "45ff157b-344c-420e-80a8-e1bbf7fb8a4c",
   "metadata": {},
   "source": [
    "9. **What quantities are saved in the csv-file's columns? What is their unit?**"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "id": "dcd38e8c-b204-42e8-ad42-a9bf54439d26",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "+-------------------------------------------------------------------------------------------------------------------------+----------------+--------+---------------------------------------------+------------------------------------+\n",
      "| URL                                                                                                                     |   Column Index | Node   | Quantity                                    | Unit                               |\n",
      "|-------------------------------------------------------------------------------------------------------------------------+----------------+--------+---------------------------------------------+------------------------------------|\n",
      "| https://github.com/materialdigital/application-ontologies/tree/main/tensile_test_ontology_TTO/data/primary_data/Zd3.csv |              1 | t709   | https://w3id.org/pmd/co/Duration            | http://qudt.org/vocab/unit/SEC     |\n",
      "| https://github.com/materialdigital/application-ontologies/tree/main/tensile_test_ontology_TTO/data/primary_data/Zd3.csv |              2 | t753   | https://w3id.org/pmd/co/CrossheadSeparation | http://qudt.org/vocab/unit/MilliM  |\n",
      "| https://github.com/materialdigital/application-ontologies/tree/main/tensile_test_ontology_TTO/data/primary_data/Zd3.csv |              3 | t736   | https://w3id.org/pmd/co/Force               | http://qudt.org/vocab/unit/KiloN   |\n",
      "| https://github.com/materialdigital/application-ontologies/tree/main/tensile_test_ontology_TTO/data/primary_data/Zd3.csv |              4 | t718   | https://w3id.org/pmd/co/PercentageExtension | http://qudt.org/vocab/unit/PERCENT |\n",
      "+-------------------------------------------------------------------------------------------------------------------------+----------------+--------+---------------------------------------------+------------------------------------+\n"
     ]
    }
   ],
   "source": [
    "sparql.setQuery(\"\"\"\n",
    "SELECT DISTINCT ?part (count(?mid) AS ?column_num) ?url ?type ?unit\n",
    "WHERE {{\n",
    "    ?table <http://www.w3.org/ns/csvw#url> ?url .\n",
    "    ?table <http://www.w3.org/ns/csvw#tableSchema> ?schema .\n",
    "    ?schema <http://www.w3.org/ns/csvw#column>/rdf:rest* ?mid .\n",
    "    ?mid rdf:rest* ?node .\n",
    "    ?node rdf:first ?part .\n",
    "    ?part a ?type .\n",
    "    ?part <https://w3id.org/pmd/co/unit> ?unit .\n",
    "    FILTER (?type!=<http://www.w3.org/ns/csvw#Column>)\n",
    "    FILTER (str(?url)='{0:s}')\n",
    "}}\n",
    "GROUP BY ?node ?part ?type ?url ?unit ORDER BY ?url ?column_num\n",
    "\"\"\".format(example_url)\n",
    ")\n",
    "\n",
    "liste=[]\n",
    "try:\n",
    "    ret = sparql.queryAndConvert()\n",
    "    for r in ret[\"results\"][\"bindings\"]:\n",
    "        row = []\n",
    "        for k in r.keys():\n",
    "            # print(k, r[k]['value'])\n",
    "            row.append(r[k]['value'])\n",
    "        liste.append(row)\n",
    "        # print ()\n",
    "\n",
    "except Exception as e:\n",
    "    print(e)\n",
    "\n",
    "df = pd.DataFrame(liste, columns =[\"Column Index\", \"Node\", \"Quantity\", \"Unit\", \"URL\"])\n",
    "print(tabulate(df[[\"URL\", \"Column Index\", \"Node\", \"Quantity\", \"Unit\"]], headers=[\"URL\", \"Column Index\", \"Node\", \"Quantity\", \"Unit\"], tablefmt='psql', showindex=False))"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "0720d1a1-8f65-4768-b986-111f4e711dc0",
   "metadata": {},
   "source": [
    "10. **Show the value & unit of the metadata \"crossectionArea_S0\" for the example uri.**"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "id": "63177e57-22b8-4709-ac1b-28a7761fdbeb",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "120.707\n",
      "http://qudt.org/vocab/unit/MilliM2\n"
     ]
    }
   ],
   "source": [
    "sparql.setQuery(\"\"\"\n",
    "PREFIX pmd: <https://w3id.org/pmd/co/>\n",
    "SELECT distinct ?p ?S0val ?unit\n",
    "WHERE {{\n",
    "    ?s a pmd:TestPiece .\n",
    "    ?p a pmd:TensileTest .\n",
    "    ?p pmd:input ?s .\n",
    "    ?p pmd:characteristic ?output .\n",
    "    ?output a pmd:CrossSectionArea .\n",
    "    ?output pmd:value ?S0val .\n",
    "    ?output pmd:unit ?unit .\n",
    "    FILTER regex(str(?output), \"S0\")\n",
    "    FILTER regex(str(?p), \"{0:s}\")\n",
    "}}\n",
    "ORDER BY ?p\n",
    "\"\"\".format(example_uri)\n",
    ")\n",
    "\n",
    "res = sparql.queryAndConvert()\n",
    "example_csa = float(res[\"results\"][\"bindings\"][0][\"S0val\"][\"value\"])\n",
    "example_csa_unit = res[\"results\"][\"bindings\"][0][\"unit\"][\"value\"]\n",
    "print(str(example_csa))\n",
    "print(example_csa_unit)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "75d60324-e8b8-437f-a284-088e7cfcb97f",
   "metadata": {},
   "source": [
    "With all of these information, one could now download the raw datafiles and analise the stress-strain data however he/she likes. To do this in a faster and more reproduceble way, we will use a pyiron workflow and a custom pyiron-job class \"pyiron_tensile_job\"."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "aaec6909-5d5e-4e84-8cfc-e34a265c8882",
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3 (ipykernel)",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.8.17"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 5
}