Working with External Data Sources

SnappyData relies on the Spark SQL Data Sources API to parallelly load data from a wide variety of sources. Any data source or database that supports Spark to load or save state can be accessed from within SnappyData.

There is built-in support for many data sources as well as data formats. You can access data from sources such as S3, file system, HDFS, Hive, and RDB. The loaders have built-in support to handle data formats such as CSV, Parquet, ORC, Avro, JSON, and Java/Scala Objects.

SnappyData provides a utility to deploy third-party connectors using the SQL Deploy command. Refer Deployment of Third Party Connectors

For more information see:

• START HERE - How to load data into SnappyData Tables
• Data Loading examples using Spark SQL/Data Sources API
• Using the SnappyData Change Data Capture (CDC) Connector
• Using the SnappyData GemFire Connector