SnappyData™ 1.1.1
Overview
Provisioning SnappyData
Provisioning SnappyData
System Requirements
Installing SnappyData On-Premise
Setup SnappyData Cluster on AWS
Setup SnappyData Cluster on Kubernetes
Building a Docker Image with SnappyData Binaries
Building SnappyData from Source files
Upgrading SnappyData
Getting Started
Getting Started
On-Premise
Kubernetes
Docker Image
Spark Distribution
SnappyData Quickstart Guide
Using Spark Scala APIs
Benchmark 16-20x Faster Performance than Apache Spark
Using SQL
Structured Streaming
Configure/Launch SnappyData Cluster
Concepts
SnappyData Concepts
Concepts
Core Components
SnappyData Cluster Architecture
Hybrid Cluster Manager
Distributed Transactions
Distributed Transactions
How Transactions Work for Row Tables
Lock-free Queries using MVCC and Snapshot Isolation for Column Tables
Affinity Modes
Affinity Modes
Local Mode
Embedded SnappyData Store Mode
SnappyData Smart Connector Mode
How Tos
How Tos
How to Start a SnappyData Cluster
How to Check the Status of a SnappyData Cluster
How to Stop a SnappyData Cluster
How to Run Spark Job inside the Cluster
How to Access SnappyData Store from existing Spark Installation using Smart Connector
How to Use Snappy SQL shell (snappy-sql)
How to Create Row Tables and Run Queries
How to Create Column Tables and Run Queries
How to Load Data into SnappyData Tables
How to Load Data from External Data Stores (e.g. HDFS, Cassandra, Hive, etc)
How to Perform a Colocated Join
How to Connect using JDBC Driver
How to use SnappyData for any Spark Distribution
How to Store and Retrieve Complex Data Types in JDBC Programs
How to Store and Query JSON Objects
How to Store and Query Objects
How to use Stream Processing with SnappyData
How to use Transactions Isolation Levels
How to use Synopsis Data Engine to Run Approximate Queries
How to use Python to Create Tables and Run Queries
How to Connect using ODBC Driver
How to Connect to the Cluster from External Network
How to Import Data from Hive Table into SnappyData Table
How to Export and Restore Table Data using HDFS
How to Access SnappyData from Various SQL Client Tools
How to connect TIBCO Spotfire® Desktop to SnappyData
How to Connect Tableau to SnappyData
How to Use Apache Zeppelin with SnappyData
How to Configure Apache Zeppelin to Securely and Concurrently access the SnappyData Cluster
Programming Guide
Programming Guide
SparkSession, SnappySession and SnappyStreamingContext
Snappy Jobs
Managing JAR Files
Using Snappy Shell
Using the Spark Shell and spark-submit
Working with Hadoop YARN cluster Manager
Using JDBC with SnappyData
Accessing SnappyData Tables from any Spark (2.1+) Cluster
Multiple Language Binding using Thrift Protocol
Building SnappyData Applications using Spark API
Tables in SnappyData
Stream Processing using SQL
User Defined Functions (UDF) and User Defined Aggregate Functions (UDAF)
Best Practices
Best Practices
Tuning for Concurrency and Computation
Designing your Database and Schema
Designing your Database and Schema
Design Principles of Scalable, Partition-Aware Databases
Optimizing Query Latency: Partitioning and Replication Strategies
Memory Management
HA Considerations
Important Settings
SnappyData Distributed Transactions
Approximate Query Processing
Approximate Query Processing
Key Concepts
Working with Stratified Samples
Running Queries
More Examples
Sample Selection
High-level Accuracy Contracts (HAC)
Sketching
Working with External Data Sources
Working with External Data Sources
Deploying Third Party Connectors
Using the SnappyData GemFire Connector
Using the SnappyData CDC (Change Data Capture) Connector
Managing and Monitoring
Managing and Monitoring
SnappyData Monitoring UI
Configuring High Availability for a Partitioned Table
Configuring Logging
Getting Information from SnappyData System Tables
Managing Security
Managing Security
Launching the Cluster in Secure Mode
Specifying Encrypted Passwords in Conf Files or in Client Connections
Authentication - Connecting to a Secure Cluster
Authorization
Implementing Row Level Security
Configuring Network Encryption and Authentication using SSL
Enabling SSL Encryption in Different Socket Endpoints of SnappyData
Securing SnappyData UI Connection
User Names for Authentication, Authorization, and Membership
Evaluating Statistics for the System and Applications
Evaluating Statistics for the System and Applications
Collecting System Statistics
Using VSD to Analyze Statistics
Using VSD to Analyze Statistics
Installing and Running VSD
Transaction Performance
Table Performance
SQL Statement Performance
Memory Usage
Client Connections
CPU Usage
Reference Guides
Reference Guides
Configuration Reference
List of Properties
SQL Reference Guide
SQL Reference Guide
ALTER TABLE
CREATE Statements
CREATE Statements
CREATE DISKSTORE
CREATE EXTERNAL TABLE
CREATE FUNCTION
CREATE INDEX
CREATE SCHEMA
CREATE STREAM TABLE
CREATE SAMPLE TABLE
CREATE TABLE
CREATE TEMPORARY TABLE
CREATE VIEW
DELETE
DROP Statements
DROP Statements
DROP DISKSTORE
DROP FUNCTION
DROP INDEX
DROP TABLE/EXTERNAL TABLE/SAMPLE TABLE
DROP SCHEMA
DEPLOY Statements
DEPLOY Statements
DEPLOY PACKAGE
DEPLOY JAR
UNDEPLOY
GRANT
INSERT
LATERAL VIEW
PUT INTO
REVOKE
SELECT
SET ISOLATION
SET SCHEMA
TRUNCATE TABLE
UPDATE
SQL General Limitations
Built-in System Procedures and Built-in Functions
Built-in System Procedures and Built-in Functions
DUMP_STACKS
REBALANCE_ALL_BUCKETS
SET_CRITICAL_HEAP_PERCENTAGE
SET_TRACE_FLAG
SYS.REMOVE_METASTORE_ENTRY
DSID
System Tables
System Tables
MEMBERS
SYSDISKSTORES
SYSDISKSTOREIDS
SYSTABLES
Command Line Utilities
Command Line Utilities
backup and restore
compact-all-disk-stores
compact-disk-store
validate-disk-store
list-missing-disk-stores
revoke-missing-disk-store
unblock-disk-store
run
version
Snappy-SQL Shell Interactive Commands
Snappy-SQL Shell Interactive Commands
autocommit
commit
connect client
connect
describe
disconnect
elapsedtime
exit
MaximumDisplayWidth
rollback
run
set connection
show
Configuration Parameters
Configuration Parameters
ack-severe-alert-threshold
ack-wait-threshold
allow-explicit-commit
archive-disk-space-limit
archive-file-size-limit
bind-address
enable-network-partition-detection
enable-stats
enable-time-statistics
enable-timestats
enforce-unique-host
init-scripts
load-balance
locators
log-file
log-level
member-timeout
membership-port-range
password
read-timeout
redundancy-zone
secondary-locators
skip-constraint-checks
skip-locks
socket-buffer-size
socket-lease-time
gemfirexd.datadictionary.allow-startup-errors
gemfirexd.default-startup-recovery-delay
snappy.history
gemfirexd.max-lock-wait
gemfirexd.query-cancellation-interval
gemfirexd.query-timeout
ssl-enabled
ssl-protocols
ssl-ciphers
ssl-require-authentication
start-locator
statistic-archive-file
statistic-sample-rate
statistic-sampling-enabled
sync-commits
sys-disk-dir
user
API Reference
ODBC Supported API
SQL Functions Reference
SnappyData Spark extension API Reference Guide
Supported Data Types
Configuring SSH Login without Password
Setting Up SnappyData ODBC Driver
Setting Up SnappyData JDBC Client and QlikView
Troubleshooting Common Problems
Troubleshooting Common Problems
Member Startup Problems
Recovering from a ConflictingPersistentDataException
Preventing Disk Full Errors
Recovering from Disk Full Errors
Resolving Catalog Inconsistency Issues
Troubleshooting Out-of-Memory (OOM) Error
Collecting Logs, Stats and Dumps Using the collect-debug-artifacts Script
Troubleshooting Error Messages
Community Edition/ Enterprise Edition Features
License Model
Release Notes
Doc Archives
Contact and Support
License
Important Information
SnappyData™ 1.1.1
Docs
»
Concepts
This document is a work in progress and will be progressively updated.
SnappyData Concepts
The topic explains the following fundamental concepts of SnappyData:
Core Components
SnappyData Cluster Architecture
Hybrid Cluster Manager
Distributed Transactions
Affinity Modes
GitHub
« Previous
Next »