Distributed machine learning training

Here you can find a collection of tutorials for distributing PyTorch and Tensorflow based workflows.

Distributed ML with PyTorch

• 1. Introduction to distributed ML with PyTorch
• 2. Distributed training on MNIST dataset
• 3. Tutorial on TorchTrainer class
• 4. GAN tutorial with PyTorch
• 5. PyTorch scaling test
• 6. itwinai and containers (Docker and Singularity)
• 7. Tutorial on Kubeflow and TorchTrainer class

Distributed ML with TensorFlow

• 1. Introduction on distributed training with TensorFlow
• 2. Tensorflow ImageNet example
• 3. Tensorflow scaling test

Machine learning workflows

Here you can find a collection of tutorials for various complexity ML workflows.

• Simple workflow
• Pipeline and configuration files
• DAG workflows
• Integrating configuration with command line arguments

Hyperparameter Optimization Workflows

This tutorial provides an overview of Hyperparameter Optimization (HPO) workflows.

• Getting Started with Hyperparameter Optimization in itwinai
• Hyperparameter Optimization with RayTorchTrainer on MNIST