Author: [email protected], April 2016
Blog entry: http://externaltable.blogspot.com/2016/04/ipython-notebooks-for-querying-apache.html
This folder contains example notebooks on how to use Jupyter/IPython for querying Apache Impala and integrating with Python data analysis and visualization tools.
Example notebooks:
| Notebook | Short description |
|---|---|
| Impala_Basic.ipynb | Examples of how to run SQL on Impala using Cloudera's client, impyla. |
| Impala_SQL_Magic.ipynb | Examples of how to query Impala using %sql line magic (or %%sql cell magic) and of how to integrate with pandas and visualization with matplotlib. |
| Impala_Basic_Kerberos.ipynb | SQL on Impala, with Kerberos authentication. |
| Impala_SQL_Magic_Kerberos.ipynb | SQL on Impala with %sql line magic and with Kerberos authentication |
Dependencies and pointers on how to build a test environemnt:
- Install IPython and Jupyter. The following assumes Anaconda from Continuum Analytics)
- Install Cloudera impyla https://github.com/cloudera/impyla
pip install impyla
- Install ipython-sql
- download from https://github.com/LucaCanali/ipython-sql
cd ipython-sqland(sudo) python setup.py install
- Additional steps for Kerberos:
yum install cyrus-sasl-develyum install gcc-c++pip install thrift_sasl