Automated FileFeeds
Automated file feeds & cloud SFTP hosting for recurring partner data.
Why Automated FileFeeds
FileFeeds capture files from managed SFTP folders today, then automatically validate, transform, and deliver clean structured data into your systems without cron jobs, polling logic, or custom ETL pipelines.
End-to-End Setup in 7 Steps
Step 1 · Set up Clients
Create a Client to provision a dedicated, secure SFTP space and credentials for each data source.
- • AWS‑hosted SFTP (managed)
- • Per‑client folders and credentials
- • IP allow‑listing
Step 2 · Define a Schema
Model the dataset you expect (fields, types, required, formats) using JSON Schema.
- • String, number, date, enum
- • Required and format checks
- • Reusable versions
Step 3 · Create a Pipeline
Connect a Client + Schema and add field mappings, transforms, and CSV options.
- • Field mappings (source → target)
- • Transform functions
- • CSV options (delimiter, skip header)
Step 4 · Register a Webhook
Receive signed events when files are received, processed, reprocessed, or fail.
- • Events: FILE_RECEIVED, FILE_PROCESSED, FILE_REPROCESSED, FILE_PROCESSING_FAILED
- • HMAC signature headers
- • Retry‑aware delivery with logging
Step 5 · Client uploads files
Clients upload to their SFTP folder manually or via scheduled exports from their systems.
- • SFTP ‘put employees.csv’
- • Scheduled nightly exports
- • Automatic pickup
Step 6 · Monitor Pipeline Runs & Search trough files
Track run status, search files, and download original/processed files.
- • Statuses: pending → processing → completed/failed/acknowledged
- • Full-text document search (query by any word)
- • GET /pipeline-runs
- • Presigned downloads for originals/processed
Step 7 · Handle processed data
Process data in your backend using webhooks + REST API to fetch full JSON.
- • GET /files/pipeline-runs/:id
- • GET /files/json?clientName&fileName&pipelineId
- • PATCH /pipeline-runs/:id/status → acknowledged
Ready to automate your file workflows?
Replace manual file processing and custom ETL scripts with automated, reliable data pipelines that scale with your business.
Start free • No setup fees • Enterprise-grade security