ulan.ipynb

{
 "cells": [
  {
   "cell_type": "code",
   "execution_count": 29,
   "metadata": {},
   "outputs": [],
   "source": [
    "# imports SPARQL prefixes and functions defs\n",
    "\n",
    "from pprint import pprint\n",
    "from SPARQLWrapper import SPARQLWrapper, JSON, TURTLE, CSV \n",
    "\n",
    "prefixes = '''    \n",
    "PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#>\n",
    "PREFIX aat: <http://vocab.getty.edu/aat/>\n",
    "PREFIX gvp: <http://vocab.getty.edu/ontology#> \n",
    "PREFIX skos: <http://www.w3.org/2004/02/skos/core#>\n",
    "PREFIX skosxl: <http://www.w3.org/2008/05/skos-xl#>\n",
    "PREFIX dcterms: <http://purl.org/dc/terms/>\n",
    "PREFIX ulan: <http://vocab.getty.edu/ulan/>\n",
    "'''    \n",
    "\n",
    "\n",
    "def sparql_query(query, format):\n",
    "    formats = {\"json\": JSON, \"turtle\": TURTLE, \"csv\": CSV}\n",
    "    f_ = formats[format]\n",
    "    endpoint = \"http://vocab.getty.edu/sparql\"\n",
    "    sparql = SPARQLWrapper(endpoint)\n",
    "\n",
    "    query = prefixes + query     \n",
    "    sparql.setQuery(query)\n",
    "\n",
    "    sparql.setReturnFormat(f_)\n",
    "    results = sparql.query().convert()    \n",
    "    # sparql.setReturnFormat(XML)\n",
    "    # results = sparql.query()\n",
    "    return results\n",
    "    # # Print the results\n",
    "    # print(\"Subject ID: \", subjectID)\n",
    "    # \n",
    "\n",
    "\n",
    "def print_sparql_results(results):\n",
    "    for row in results[\"results\"][\"bindings\"]:\n",
    "        return (row)\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "ULAN is organized according to the following Facets\n",
    "* http://vocab.getty.edu/ulan/500000002,\"Persons, Artists\" (total of 963.716 concepts)\n",
    "* http://vocab.getty.edu/ulan/500000003,Corporate Bodies\n",
    "* http://vocab.getty.edu/ulan/500125081,Unknown Person by Culture\n",
    "* http://vocab.getty.edu/ulan/500299802,Non-Artists\n",
    "* http://vocab.getty.edu/ulan/500355043,Unidentified Named People and Firms\n",
    "\n",
    "In the following queries, I will explore how to get concepts from one of those Facets"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 78,
   "metadata": {},
   "outputs": [],
   "source": [
    "# query ULAN ConceptScheme, form member of the ulan:500000002 \"Persons, Artists\" facet\n",
    "\n",
    "ulan_concepts_q= '''\n",
    "SELECT *\n",
    "WHERE {\n",
    "    ?concept skos:inScheme ulan: ;\n",
    "             gvp:broader ulan:500000002 ;\n",
    "#             rdfs:label ?label .\n",
    "            xl:prefLabel ?label .\n",
    "       ?label  xl:literalForm ?label_literal\n",
    "       FILTER(!(CONTAINS(?label_literal, ',')))\n",
    "}\n",
    "ORDER BY ?label_literal\n",
    "'''\n",
    "\n",
    "ulan_concepts = sparql_query(query=ulan_concepts_q, format='csv')\n",
    "# pprint(ulan_concepts)\n",
    "\n",
    "\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 79,
   "metadata": {},
   "outputs": [],
   "source": [
    "# if previous cell format is CSV\n",
    "with open('ulan-artists.csv', 'wb') as csv_f:\n",
    "    csv_f.write(ulan_concepts)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Labels in ULAN\n",
    "\n",
    "in ULAN we can find concept labels under both `rdfs:label` and `xl:prefLabel`. However there are some issues with these\n",
    "\n",
    "**rdfs:label issues**\n",
    "* often, there is more than 1 rdfs:label for each concept - which one should be chosen?\n",
    "* often, labels are wrapped by literal quotation marks - can be address by processing the labels in SPARQL\n",
    "* no consistent pattern: although quotation marks seems to encapsulate the `\"Surname, Name\" pattern, **not all concepts have labels like this** ie.  ulan:500000009\n",
    "\n",
    "\n",
    "example:\n",
    "```\n",
    "concept,rdfs:label\n",
    "http://vocab.getty.edu/ulan/500000004,Samuel John Carter\n",
    "http://vocab.getty.edu/ulan/500000004,\"Carter, Samuel (sr.)\"\n",
    "http://vocab.getty.edu/ulan/500000004,\"Carter, Samuel John\"\n",
    "http://vocab.getty.edu/ulan/500000005,Giovanni Battista Merano\n",
    "http://vocab.getty.edu/ulan/500000005,\"Merano, Giovanni Battista\"\n",
    "http://vocab.getty.edu/ulan/500000006,\"Meyer, Hannes\"\n",
    "http://vocab.getty.edu/ulan/500000006,Hannes Meyer\n",
    "http://vocab.getty.edu/ulan/500000007,Augustinus Corvus\n",
    "http://vocab.getty.edu/ulan/500000007,\"Cordus, Augustus\"\n",
    "http://vocab.getty.edu/ulan/500000007,\"Corvus, Augustinus\"\n",
    "http://vocab.getty.edu/ulan/500000009,Francesco Morelli\n",
    "http://vocab.getty.edu/ulan/500000009,Francisco Morelli\n",
    "```\n",
    "\n",
    "*xl:prefLabel issues*\n",
    "* although many labels in Dutch spelling, not all have it\n",
    "* often there is more than 1 spelling, some times just one \n",
    "\n",
    "\n",
    "examples:\n",
    "\n",
    "```\n",
    "concept,label, label_literal\n",
    "http://vocab.getty.edu/ulan/500000004,http://vocab.getty.edu/ulan/term/1500000004-nl,\"Carter, Samuel John\"\n",
    "http://vocab.getty.edu/ulan/500000005,http://vocab.getty.edu/ulan/term/1500000005-nl,\"Merano, Giovanni Battista\"\n",
    "http://vocab.getty.edu/ulan/500000006,http://vocab.getty.edu/ulan/term/1500000006,\"Meyer, Hannes\"\n",
    "http://vocab.getty.edu/ulan/500000007,http://vocab.getty.edu/ulan/term/1500000007-nl,\"Corvus, Augustinus\"\n",
    "http://vocab.getty.edu/ulan/500000009,http://vocab.getty.edu/ulan/term/1500000012,\"Morelli, Francesco\"\n",
    "http://vocab.getty.edu/ulan/500000010,http://vocab.getty.edu/ulan/term/1500000013,\"Réattu, Jacques\"\n",
    "http://vocab.getty.edu/ulan/500000010,http://vocab.getty.edu/ulan/term/1500000014-nl,\"Reattu, Jacques\"\n",
    "http://vocab.getty.edu/ulan/500000011,http://vocab.getty.edu/ulan/term/1500000015-nl,\"Pegram, Frederick\"\n",
    "http://vocab.getty.edu/ulan/500000012,http://vocab.getty.edu/ulan/term/1500280905,Paul Richards\n",
    "http://vocab.getty.edu/ulan/500000013,http://vocab.getty.edu/ulan/term/1500000017-nl,\"Royle, Stanley\"\n",
    "http://vocab.getty.edu/ulan/500000014,http://vocab.getty.edu/ulan/term/1500000018-nl,\"Russell, Henrietta\"```\n",
    "\n",
    "Concepts from the following Facets, are returned, when we query for concepts that have `gvp:broader FACET-URI`\n",
    "\n",
    "  \n",
    "\n",
    "- `PERSONS, ARTIST` Facet:  ulan:500000002  \n",
    "- `CORPORATE BODIES` Facet: ulan:500000003\n",
    "- `NON-ARTISTS` Facet: mostly represents patrons, who often had input in the creative process, and occasionally donors, sitters, and others whose names are required for indexing visual works but who are themselves not artists.  \n",
    "- `UNKNOWN PEOPLE BY CULTURE` Facet: refers to the generic culture in which a work was created (e.g. *unknown Aztec*, or simply *Aztec*)\n",
    " - `UNIDENTIFIED NAMED PEOPLE ` Facet: people or corporate bodies where the identity is knowable, but has not yet been thoroughly researched\n"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "venv",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.12.3"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}