Enterprise Data Platform

Smart Data eXchange & Reporting

Ingest. Transform. Report. Deliver. — On Windows & Linux.
An enterprise data management and reporting product capable of federated cross-source querying, data ingestion from on-prem & cloud sources, data transformation (ELT/ETL/ELTL), Excel-template reporting, multi-format extraction, data lake creation, and data warehouse enablement — powered by a flexible workflow-based scheduling engine. Deploy on Windows or Linux.
56
Task Types
18
Database Types
13+
Output Formats
0
Lines of Code Required
Platform Overview

Enterprise Data Management at Your Fingertips

From data ingestion to delivery — everything you need in a single platform, without writing code.

📊

Data Ingestion

Load data from on-prem databases, cloud storage (AWS S3, Azure Blob), REST APIs, Kafka streams, FTP/SFTP, and files (CSV, Excel, JSON, XML, Fixed-Width, Parquet).

⚙

Data Transformation

In-memory dataset operations, ETL/ELT/ELTL pipelines, data profiling, slow-changing dimensions, master data management with fuzzy matching, and C# scripting transforms.

📄

Report Generation

Excel template-based reporting with embedded graphs and charts. Output to Excel, PDF, CSV, JSON, XML, and Fixed-Width. SSRS integration for enterprise reporting.

🚀

Visual Workflows

Drag-and-drop workflow designer. Build complex data pipelines visually. Conditional execution, looping, task-to-task communication, and JavaScript scripting support.

🔒

Security & Compliance

Role-based access control. Active Directory, OAuth/OpenID Connect, and form-based authentication. PGP/AES encryption. Complete audit logging.

☁

Cloud & On-Prem

Deploy as SaaS or on-premises. AWS S3, Azure Blob, Kafka integration. Multi-node distributed execution with automatic failover and load distribution.

New Feature

Universal Data Query — Federated Cross-Source Joins

Write a single SQL query that joins data from multiple heterogeneous databases, files, APIs, and streams — regardless of where the data lives or what protocol it speaks.

One Query. Any Source. Any Protocol. NEW

SDXR's Universal Data Query engine lets you JOIN data across Oracle, SQL Server, PostgreSQL, DB2, Snowflake, CSV files, JSON APIs, Parquet files, and SFTP sources — all in a single query. The engine auto-detects each source type, translates SQL dialect differences, routes through the optimal protocol (ODBC, JDBC, HTTP, File, SFTP, FTP, REST), and returns a unified result set. No data movement. No ETL prerequisite. No vendor lock-in.

Single Federated SQL Query SELECT o.name, p.balance, c.data FROM oracle_db.orders o JOIN pg.accounts p ON ... JOIN s3_csv.claims c ON ... SDXR Universal Data Query Engine Auto-detect source | Translate SQL dialect | Route via optimal protocol | JOIN results in-memory GetDBServerType() • ReplaceDbSpecificKeywords() • AddTopN() • FederatedJoin() • ProtocolRouter() Windows & Linux • On-Prem & Cloud • No Data Movement Required 7 Connection Protocols ODBC JDBC File SFTP FTPs HTTP REST API ODBC Databases SQL Server • PostgreSQL • MySQL • Oracle • SQLite JDBC Databases Oracle • DB2 • Snowflake • Spark • Hive • Redshift Files & Cloud Storage CSV • JSON • Parquet • XML • Excel • S3 • Azure Blob APIs & Streams REST • HTTP • Kafka • MQ • WebSocket SQL Server Postgres MySQL MariaDB Oracle DB2 Snowflake Redshift CSV JSON Parquet XML Excel S3 Azure REST Kafka MQ In-Memory Federated JOIN → Unified Result Set DataTable • DataSet • CSV • JSON • Excel • Parquet • Stream Windows Server Linux

7 Connection Protocols

ODBCJDBC HTTPREST API File I/OSFTP FTPs

The engine automatically routes each data source through the optimal protocol. ODBC for native database drivers, JDBC via the Java bridge for DB2/Snowflake/Spark, HTTP/REST for API endpoints, File I/O for local and network paths, SFTP/FTPs for secure remote file access.

File Format Support

CSVJSON ParquetXML ExcelFixed-Width Avro

Query flat files as if they were database tables. CSV, JSON, Parquet, XML, Excel, and Fixed-Width files can be joined with live database queries in a single federated operation.

18+ Databases

SQL ServerPostgreSQL OracleDB2 MySQLSnowflake SparkHive RedshiftMongoDB MariaDBSQLite

All major relational and NoSQL databases. Any database with an ODBC or JDBC driver is automatically supported — no custom connectors needed.

Automatic SQL Dialect Translation

Write your SQL once — the engine adapts it per database automatically:

FeatureSQL ServerPostgreSQLOracleMySQL
Top N rowsSELECT TOP 100 ...SELECT ... LIMIT 100WHERE ROWNUM < 100SELECT ... LIMIT 100
Quoting[column]"column""column"`column`
Lock hint(UPDLOCK)removedremovedremoved
SequenceNEXT VALUE FOR seqnextval('seq')seq.NEXTVALAUTO_INCREMENT
Recursive CTEWITH cte ASWITH RECURSIVE cteWITH cte ASWITH RECURSIVE cte
String concat+||||CONCAT()

Business Value

Write Once, Query Anywhere — Eliminate the need for separate queries per database. Zero Data Movement — Query data where it lives; no ETL prerequisite for cross-source analytics. No Vendor Lock-In — Open protocol support (ODBC/JDBC/REST) means you can swap databases without rewriting queries. Instant Cross-Source Insights — JOIN a PostgreSQL table with a Snowflake warehouse and an S3 CSV file in one SQL statement. Windows & Linux — Deploy on either operating system.

Competitive Edge

SDXR vs. Starburst vs. Dremio vs. Denodo

How SDXR's Universal Data Query compares to leading federated query and data virtualization platforms.

Capability SDXR Starburst (Trino) Dremio Denodo
Federated Cross-Source JOINs ✓ Full — JOIN across DBs, files, APIs, streams in one query ✓ Via Trino connectors (50+) ✓ Via Apache Arrow connectors ✓ Via data virtualization layer
Supported Databases 18+ — All major RDBMS + NoSQL via ODBC/JDBC 50+ connectors (requires Trino catalog config) 30+ connectors (requires Dremio source config) 150+ connectors (enterprise)
Connection Protocols 7 — ODBC, JDBC, HTTP, REST, File, SFTP, FTPs JDBC (Trino connectors) JDBC, ODBC, REST (Arrow Flight) JDBC, ODBC, REST, OData
File Format Querying ✓ CSV, JSON, Parquet, XML, Excel, Fixed-Width, Avro ✓ Parquet, ORC, Avro, CSV, JSON (via object store) ✓ Parquet, ORC, Avro, CSV, JSON, Iceberg ✓ Parquet, CSV, JSON, XML, Excel
Built-in ETL/ELT/ELTL ✓ Full pipeline engine — 56 task types, visual workflow, SCD, MDM ✗ Query-only; requires external ETL (dbt, Airflow) Partial — reflections + basic transforms Partial — caching + materialization
Visual Workflow Designer ✓ Drag-and-drop with conditional branching, looping, pipeline mode ✗ No built-in workflow UI ✗ No built-in workflow UI ✗ No built-in workflow UI
Report Generation ✓ Excel templates, PDF, SSRS, Word mail merge, charts ✗ None (BI tool required) ✗ None (BI tool required) ✗ None (BI tool required)
Multi-Threaded Scheduler ✓ Built-in — multi-node, auto-failover, pipeline mode, retry logic ✗ External scheduler needed ✗ External scheduler needed ✓ Built-in scheduler
Data Quality / MDM ✓ Profiling, compare, MDM with 6 fuzzy match engines ✗ Requires external tools ✗ Requires external tools Partial — basic profiling
Deployment Windows & Linux — on-prem, cloud, hybrid. Self-hosted. Kubernetes, cloud, on-prem (Trino cluster) Kubernetes, cloud (Dremio Cloud), on-prem On-prem, cloud, hybrid (JVM-based)
Pricing Model Self-hosted license — no per-query or per-user consumption fees Per-node or consumption-based ($$$$) Per-core or cloud consumption ($$$$) Per-core enterprise license ($$$$)
Encryption & Security ✓ PGP/AES, AD/OAuth/OIDC, RBAC, audit logs, TLS ✓ RBAC, LDAP, encryption at rest ✓ RBAC, SSO, encryption ✓ RBAC, SSO, column-level masking
Custom Extensibility ✓ Custom .NET DLLs, PowerShell, Python, Java at runtime Custom Trino connectors (Java SPI) UDFs (limited) Custom wrappers (Java)

Why SDXR Over Starburst / Trino?

Starburst (built on Trino) is a query-only platform — it requires external ETL tools (dbt, Airflow, Spark) for data movement and transformation, external schedulers for orchestration, and external BI tools for reporting. SDXR is an all-in-one platform: federated querying + ETL/ELTL pipeline engine + visual workflow designer + report generation + scheduler + data quality/MDM — all integrated. No ecosystem assembly required. Additionally, Starburst requires a Trino cluster with Kubernetes, while SDXR runs as a simple Windows Service or Linux daemon with zero cluster overhead.

Why SDXR Over Dremio?

Dremio excels at interactive SQL analytics on data lakes (Apache Iceberg), but it's not a data operations platform. It lacks built-in ETL, workflow automation, scheduling, file operations, email delivery, encryption, and report generation. SDXR provides all 56 task types in one platform. Dremio's pricing is consumption-based (per-core), making costs unpredictable at scale. SDXR offers a straightforward self-hosted license. Dremio also requires Kubernetes for production deployment, while SDXR runs on any Windows or Linux server.

The SDXR Advantage — Complete Platform vs. Query Engine

Starburst, Dremio, and Denodo are federated query engines — they answer SQL queries across sources. But they stop there. To build a complete data pipeline, you still need: an ETL tool, a scheduler, a workflow engine, a report generator, a file mover, an encryption tool, and a monitoring system. SDXR replaces all of these with a single, integrated platform. Federated querying is just one of 56 capabilities. This means fewer moving parts, lower TCO, simpler operations, and faster time-to-value.

No-Code Automation

Visual Workflow Designer

Build complex data pipelines by drag-and-drop assembly of tasks — no coding required.

Workflow Features

  • Visually build workflows by drag-drop assembly of tasks
  • API / On-Demand / Batch execution modes
  • Multi-threaded / Multi-node execution
  • Conditional execution of tasks (branching)
  • Repeat a task or group of tasks multiple times
  • Task-to-task communication and variable passing
  • JavaScript scripting support within workflows
  • Handle multiple data formats: JSON, CSV, XML, Object
  • Sub-workflows: trigger other schedules from within a workflow

Schedule Management

  • Schedule run parameters (key-value pairs) with dynamic date macros: $EOM$ (End of Month), $EOPM$ (End of Previous Month), $EOPY$ (End of Previous Year)
  • Schedule dependencies — runs only after dependent schedules complete
  • Configurable run frequency (Daily, Business Day, Monthly, Quarterly, Yearly)
  • Automatic email distribution of outputs to configured recipients
  • Distribution folder output — auto-copy to shared network paths
  • Max Retries with smart restart from the failed step
  • On-demand execution with parameter overrides
  • Real-time monitoring via SignalR dashboard
Data In

Data Ingestion

Bring data in from anywhere — on-prem databases, cloud storage, APIs, streams, and files.

🗃

Database Sources

  • Oracle, PostgreSQL, SQL Server, DB2, MySQL
  • Snowflake, Spark, Hive, Redshift
  • ODBC and JDBC connectivity
  • Stored procedures and dynamic SQL
  • Multi-threaded extraction
☁

Cloud Sources

  • AWS S3 buckets (upload/download/list)
  • Azure Blob Storage
  • Kafka streams (produce/consume)
  • REST API data ingestion
  • SFTP/FTP with SSH encryption
📄

File Formats

  • CSV, Excel (XLSX), Fixed-Width
  • JSON, XML, Parquet
  • Load files as a group with post-processing
  • Post-process SQL after each file or all files
  • Bulk load with SqlServerBulkCopy or INSERT
Transform

Data Transformation & Quality

Powerful ETL/ELT/ELTL pipelines with profiling, MDM, and C# scripting.

Transformation Capabilities

  • In-memory datasets from data files
  • Query and merge multiple datasets
  • Data converter between formats
  • ELTL (Extract-Load-Transform-Load) pipeline with delta detection
  • Slow-changing dimensions (SCD Type 1 & 2)
  • C# scripting engine for custom transforms
  • Column mapping with UDF (User-Defined Functions)
  • Hash-based change detection for incremental loads
  • Staging, history archival, and revert capabilities

Data Quality & MDM

  • Data Profiling — comprehensive quality metrics on any dataset
  • Data Compare/Reconciliation between sources
  • Master Data Management (MDM) with entity resolution
  • Fuzzy matching engines: Jaro-Winkler, FuzzySharp, Metaphone3, Dice Coefficient, Cosine Similarity
  • Golden record merge with survivorship rules
  • Field-level survivorship rule configuration
  • Match rules with SQL-based and key-based comparison
  • OCR (Optical Character Recognition) for document processing
Reports

Report Generation & Delivery

Excel template-based reporting with automatic distribution via email, FTP, and shared folders.

📈

Excel Template Reports

Create rich Excel reports with embedded graphs, charts, pivot tables, and conditional formatting. Use existing Excel templates as the base, and SDXR populates data automatically.

📃

Multiple Output Formats

Generate reports in Excel, PDF, CSV, JSON, XML, Fixed-Width, and Parquet. Multiple sheets per workbook with dynamic sheet naming from stored procedures.

📧

Automatic Delivery

Email distribution with attachments. FTP/SFTP delivery. Shared folder distribution. Word mail merge with database data. PDF merging for consolidated reports.

Data Out

Data Extraction

Extract data from any source to any format with full control over structure and delivery.

Flexible Data Sources & Targets

Sources: Database objects (Table/View/Stored Procedures), files (CSV, XML, JSON), and custom sources.
Output Formats: Excel, CSV, Fixed-Width, JSON, XML, Parquet, PDF, DataSet objects, and message queues.
Delivery: Local filesystem, network shares, FTP/SFTP, AWS S3, Azure Blob, email attachments, and REST APIs.

Infrastructure

Execution Service & Scalability

Distributed, multi-node, multi-threaded execution with automatic failover.

Multi-Node Architecture

  • Run on multiple servers/nodes with multi-threading
  • Built-in redundancy and automatic failover
  • Scale up easily by adding more nodes
  • Each server/node configurable for specific job types
  • Fully configurable polling intervals and thread counts
  • Dynamic poll adjustment (longer sleep during idle, instant wake on work)
  • Windows Service or Console application deployment

Monitoring & Control

  • Real-time task monitoring via web dashboard
  • SignalR live status updates and notifications
  • View running tasks, terminate hung processes
  • Service custom commands: reload config, view threads, cancel tasks
  • Comprehensive audit logging and service run logs
  • Heartbeat monitoring with automatic timer recovery
  • REST API for external task triggering and management
Triggers

Event-Based Triggers

Multiple ways to initiate workflow execution.

📅

Date/Time

Daily, Business Day, Monthly, Quarterly, Yearly. Include/exclude specific days.

📂

File Pattern

Watch for file arrival. Group triggers (All or Any). Archive and process folders.

🔗

REST API

Trigger any workflow via REST API call. External system integration.

🔁

Recurring

Repeat at configurable intervals until completion or failure.

Security

Enterprise Security

Multi-layer security with encryption, audit trails, and granular access control.

Authentication

  • Active Directory integration
  • OAuth / OpenID Connect
  • Form-based authentication
  • API Key/Secret for service access

Authorization

  • Role-based access control (Admin, Public, Custom)
  • Granular entitlements (Read/Write/Delete/Run/Full)
  • Element-level access (Menus, Reports, Schedules, DBs)
  • User group email distribution management

Encryption & Audit

  • PGP and AES file encryption/decryption
  • SHA-256 / MD5 hash computation
  • TLS 1.2 for all communications
  • Complete audit logging of all operations
Deployment

Deployment — Windows & Linux

Flexible deployment supporting on-premises, cloud, and hybrid environments on both Windows and Linux operating systems.

Components

  • SDXRApp — ASP.NET Core MVC web application (IIS / Kestrel / Nginx)
  • SDXRWebApi — REST API with SignalR real-time hub
  • SDXRService — Windows Service or Linux systemd daemon
  • SDXR Database — SQL Server or PostgreSQL for metadata
  • SDXRLocalTaskHelper — On-prem remote agent
  • SDXRJavaUtils — Java JDBC bridge for cross-DB connectivity

Windows Deployment

  • .NET 9.0 Runtime on Windows Server
  • IIS with ASP.NET Core Module
  • Windows Service for SDXRService
  • SQL Server or PostgreSQL
  • ODBC/JDBC drivers for target databases
  • Java Runtime for JDBC bridge
  • HTTPS/SSL certificate

Linux Deployment

  • .NET 9.0 Runtime on Linux (Ubuntu, RHEL, etc.)
  • Kestrel or Nginx reverse proxy
  • systemd service for SDXRService
  • PostgreSQL (recommended) or SQL Server on Linux
  • unixODBC + JDBC drivers
  • OpenJDK for JDBC bridge
  • Let's Encrypt or custom SSL certificate
Extensible

Extendable Architecture

Custom tasks, PowerShell scripts, and user-defined functions for unlimited flexibility.

Custom Tasks

Supply your own C# code as a DLL and SDXR will execute it at runtime with full access to task and schedule parameters. Using the GenericMethod task type, you can do anything that isn't built-in.

PowerShell & Script Execution

Execute any external command, PowerShell script, Python script, or Java program via the RunCmd task type. Full integration with workflow parameters and output capture.

Complete Reference

All 56 Task Types

Every automation capability available in the SDXR platform.

📊 Data & Reporting

  • SDXRReport — Excel template reports
  • SQL_DataExport — SQL query to file
  • StoredProc_DataExport — SP to file
  • StoredProc_Execute — Run SP
  • SQL_Execute — Run SQL DDL/DML
  • SSRS — SSRS report rendering
  • DataSetObject_DataExport
  • DataSetObjectsMerge_DataExport
  • DBCopy — Copy tables cross-DB
  • DatabaseMetadata — Schema extract

⚙ Transform & Quality

  • TransformDataset — C# scripting
  • DataConverter — Format conversion
  • ELTL — Extract-Load-Transform-Load
  • JdbcELTL — Cross-DB ELTL
  • SparkETL — Apache Spark pipelines
  • DataProfiler — Quality metrics
  • DataCompare — Reconciliation
  • MDM — Master Data Management
  • Ocr — Document OCR
  • DataStream — Pipeline streaming

📂 File Operations

  • FileCopy — Copy/move files
  • FileDelete — Delete with patterns
  • FileWatcher — Monitor for arrival
  • ListFiles — Directory listing
  • LoadFile — Load to database
  • MergeLoadFile — Upsert from file
  • SplitFile — Split by size/rows
  • SortFile — Sort by columns
  • Zip_Files / Unzip_Files
  • MergePDFs — Combine PDFs
  • FileUploader — HTTP upload
  • ExtractAttachment
  • JsonMerge / JsonReformat

☁ Cloud & Integration

  • AWS_S3 — Upload/download/list
  • AzureBlobStorage — Azure Blob ops
  • Kafka — Produce/consume
  • HttpRequest — REST API calls
  • Sftp — SFTP transfers
  • FTPJobsProcessor — FTP with tracking
  • MQ — Message queue pub/sub

🔒 Security & Email

  • EncryptDecrypt — PGP/AES
  • ComputeHash — SHA256/MD5
  • SendMail — Email with attachments
  • EmailProcessor — Process incoming
  • MailMergeWord — Word merge

🛠 Control & Utility

  • GenericMethod — Custom .NET code
  • RunCmd — OS command execution
  • RunSchedule — Sub-workflow
  • Set_Variables — Pipeline variables
  • DelayTask — Wait/pause
  • RepeatTasksGroup — Loop control
  • DB_Snapshot — Database snapshot

The Complete Data Operations Platform

From data ingestion to transformation to reporting to delivery — all in one platform, with zero code required.

56
Task Types
18
Database Types
13+
Output Formats
6
Fuzzy Match Engines
230+
SQL Query Files