A DataRobot Solution Labs project Also a DataRobot CLI plugin Built for always-on agents Works with DataRobot 11.4+
rsync for the
DataRobot Files API
An always-on agent that forgets everything on restart isn’t always on.
datarobot-sync keeps its skills and memories in DataRobot Files and moves only what changed
Agents keep their memory
Restore skills, memories, and sessions on boot. A restart, a reschedule, or a new node doesn’t wipe what the agent learned.
Roll back a bad write
Nothing in the container is ever overwritten. Retain a day of generations, and a corrupted memory is a rollback, not a loss.
Exit codes a supervisor can act on
Authentication failures, lease conflicts, and integrity errors each get their own code, so an entrypoint knows whether to retry, stop, or alert.
Only the difference moves
The Files API records a SHA-256 for every stored object, so the diff is exact. Unchanged files never leave the disk.
Renames and reverts cost nothing
Content is stored under its own digest. Moving a 5 GB file is a manifest edit, not a transfer.
Idle runs stay fast
The remote manifest records size, mode, and mtime per path, the same baseline rsync gets from its destination.
Packs, not round trips
A thousand small files go up as a handful of xz-compressed packs instead of a thousand requests.
Mirror as files change
dr-sync watch keeps a container current while a busy tree churns, debounced and rate-limited.
Runs as a DataRobot CLI plugin
Use datarobot sync upload ./dir, a standalone binary, or a container. The behavior is identical.