ExpeDat™ is designed for a very wide variety of use scenarios and network environments. Below are some of the key features which set ExpeDat apart.
|Performance||Basic Interfaces||Web Integration|
|Easy Setup Server||File Meta Data||Preconfigured Clients|
|Balancing & Failover||Large Transfers||Streaming Folders|
|Client Scripting||Virtual Storage||Server Automation|
|Client Development||Server Monitoring||More...|
ExpeDat can move data as fast as the underlying systems allow. You can also control performance to meet specific targets or avoid disruption to other traffic. See the Performance section for details.
A familiar "FTP-like" interface is available for Windows and Mac OS X with MTPexpedat.
Drag-and-Drop file upload is available for Windows and Mac OS X with DropDat.
Command line file transfer using syntax similar to "scp" is available for all platforms with movedat.
Easy Setup Server
The ExpeDat server can be installed as a system service or run directly from the command line. It consists of a single small executable consuming minimal resources.
File Meta Data
The unicode name and modification date of each file is preserved across all platforms. Read-only status is preserved for Windows sourced files. Unix mode permissions, user id, and group id are preserved for all other platforms when user permissions allow. When transferring folders using Streaming Folders, the creation date of each file is preserved for those platforms which support it.
Administrators can configure self-contained, customized clients that can then be emailed or otherwise distributed to end-users. DropDat droplets are icons which can be placed a user's desktop for one-step drag-and-drop uploads. Create separate droplets for each destination. MTPexpedat clients can be embedded with performance and configuration settings customized to your environment.
All user credentials are encrypted with AES-128 and content encryption is easily enabled. The server provides integrated system authentication for access to native, Active Directory, LDAP, NIS, and other logon schemes as well as private authentication for ExpeDat only access. See Tech Note 0016 for more details about encryption and authentication security.
Inline content compression is available with the MTPexpedat and movedat clients. See Tech Note 0014 for a discussion of the advantages and disadvantages of compressing your data.
In the unlikely event of an interrupted transfer, individual file transfers can be resumed from the point of interruption. All clients offer automatic retry for network and capacity related errors.
Load Balancing & Failover
Clients can distribute their load across multiple servers and work around down or unreachable servers. See the Host Groups section for details.
ExpeDat can transfer individual files up to 8 exabytes in size. MTPexpedat and DropDat can handle folders containing hundreds of thousands of files, while movedat can transfer millions of files in a single session. Up to 16 exabytes can be transferred in a single session.
Send or receive billions of files at maximum speed. Streaming Folders optimizes the transfer of many small files by automatically packaging them through a single real-time data stream. See one of the "Moving Directories" sections for details.
The movedat command line interface is self-contained and designed for easy scripting and automation. Secure password storage, wildcard matching, and detailed exit codes enable sophisticated scripting and integration. Progress logging allows you to wrap a full featured custom interface around movedat. stdio piping even lets you stream data to or from other applications.
Stream data through the server to external programs or storage without ever touching disk. Server defined Object Handlers allow clients to stream data via stdio directly to server-side applications. Access database storage, perform on-the-fly data processing or transcoding, or even relay data to other systems. Tasks such as listings, deletion, rename, and folder creation can also be performed by an Object Handler, allowing you to create fully functional virtual filesystems out of any back-end data system. Exit codes are passed all the way back to the client to ensure reliable automation and storage.
Clients can trigger server defined scripts to perform notifications, file organization, system ingest, or any other task. Object Handler scripts can run under the system user credentials of an authenticated shell user, and have access to detailed server environment information. Create sophisticated workflows and even interactive applications accessible through ExpeDat clients.
Create your own fully integrated ExpeDat clients using the same APIs used to create MTPexpedat, movedat, and DropDat. The ExpeDat Client SDK (EXP) is a static C library that can be integrated into any modern development environment. It is available as an add-on to any ExpeDat server host license.
Detailed records of transaction starts and stops, progress and performance, and server status are recorded in a machine parseable server log. Server status can be remotely monitored using the mtping utility. Multiple servers can be monitored using a web based Server Dashboard. The status of in-progress and interrupted uploads is recorded in accessible meta-data files.
There are many more features and capabilities for MTPexpedat, DropDat, movedat, and servedat. For technical "under-the-hood" discussions, see the DEI Tech Notes.