Save Apache Spark DataFrames and Datasets to TFRecord files

You can use spark-tensorflow-connector to save Apache Spark DataFrames to TFRecord files. See Spark-TensorFlow data conversion for details.

The example notebook below demonstrates how to load MNIST data images to Spark DataFrames and save to TFRecords with spark-tensorflow-connector.

Preparing MNIST data for distributed DL notebook