Dataframes: Apache Spark

[amotl]

About

When looking at Apache Spark from the perspective of a dataframe library, I guess Use CrateDB with DataFrame libraries is the right slot to add corresponding information, unless someone will share any objections about it.

The section should quickly outline/summarize the features, characteristics, and ingredients of Apache Spark, and its PySpark Python language binding.

• The section should also absorb the link to this tutorial:
  Getting started with Apache Spark and CrateDB: A step by step tutorial

• A good blueprint / intro is also:
  Tutorial: Load and transform data using Apache Spark DataFrames

References

• Dataframes: Apache Arrow / PyArrow #66

/cc @karynzv, @marijaselakovic, @surister

[amotl]

• https://community.cratedb.com/t/cratedb-connection-issue-while-using-jdbc-driver/1767
• https://github.com/Taliik/crate-spark-pipeline
• https://github.com/crate/crate-ml