SageMaker AI adds SOCI indexing to cut container image download time for training jobs
AIAWS announces Seekable OCI (SOCI) indexing for Amazon SageMaker AI training and processing jobs, which lazy-loads container images and starts containers without waiting for the full download. In AWS benchmarks on eight images from 1.8 GB to 35.4 GB, lazy loading took 3–11 seconds, against 48 seconds to 7 minutes 17 seconds for standard downloads.
Source details
AWS Machine Learning Blog · Kanwaljit Khurmi · aws.amazon.comPublished · added here
Original title: Announcing SOCI-indexed images for faster SageMaker AI jobs