Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Continuous Training in Sagemaker

I am trying out Amazon Sagemaker, I haven't figured out how we can have Continuous training.
For example if i have a CSV file in s3 and I want to train each time the CSV file is updated.

I know we can go again to the notebook and re-run the whole notebook to make this happen.
But i am looking for an automated way, with some python scripts or using a lambda function with s3 events etc

like image 821
Shiva Kishore Avatar asked Sep 06 '25 16:09

Shiva Kishore


1 Answers

You can use boto3 sdk for python to start training on lambda then you need to trigger the lambda when csv is update.

http://boto3.readthedocs.io/en/latest/reference/services/sagemaker.html

Example python code

https://docs.aws.amazon.com/sagemaker/latest/dg/ex1-train-model-create-training-job.html

Addition: You dont need to use lambda you just start/cronjob the python script any kind of instance which has python and aws sdk in it.

like image 189
Fahri Avatar answered Sep 11 '25 03:09

Fahri