.. ============================================================================================ .. Sidenav entries .. toctree:: :maxdepth: 2 :hidden: :caption: ๐Ÿ› ๏ธ Installation installation/user_installation installation/developer_installation installation/uv_tutorial .. toctree:: :maxdepth: 2 :hidden: :caption: ๐Ÿš€ Getting started getting-started/complete-workflow-example getting-started/slurm getting-started/containers getting-started/plugins getting-started/plugins-list getting-started/glossary .. toctree:: :maxdepth: 2 :hidden: :caption: ๐Ÿช„ How it works how-it-works/training/training how-it-works/loggers/explain_loggers how-it-works/workflows/explain_workflows how-it-works/hpo/explain-hpo how-it-works/scalability-report/scalability_report .. toctree:: :maxdepth: 2 :hidden: :caption: ๐ŸŽ“ Tutorials tutorials/tutorials .. toctree:: :maxdepth: 2 :hidden: :caption: ๐Ÿ“š Scientific Use Cases use-cases/use_cases use-cases/eurac_doc use-cases/virgo_doc use-cases/3dgan_doc use-cases/cyclones_doc use-cases/mnist_doc use-cases/xtclim_doc use-cases/radio-astronomy use-cases/latticeqcd_doc .. toctree:: :maxdepth: 2 :hidden: :caption: โšก API reference api/cli_reference api/modules .. toctree:: :maxdepth: 2 :hidden: :caption: ๐ŸŽฏ Github repository itwinai .. ============================================================================================ .. Here the Homepage starts .. raw:: html
GitHub stars   PyPI version   ReadTheDocs

Welcome to **itwinai** ====================== **Accelerate AI & ML workflows** for **Scientific Digital Twins**. **itwinai** streamlines distributed training, hyperparameter optimization, logging, and modular workflows, so you can focus on **science**, not plumbing. Features -------- - ๐Ÿš€ **Seamless Scaling**: Run training and inference on HPC clusters or cloud with a single CLI command. - ๐Ÿ” **Effortless Logging**: Built-in support for MLflow, Weights & Biases, TensorBoard, and more. - ๐Ÿงฉ **Modular Workflows**: Define reusable pipelines for end-to-end experiment management. - ๐Ÿค– **HPO Made Easy**: Native hyperparameter optimization with minimal configuration. - ๐Ÿ”Œ **Extensible Plugins**: Add custom integrations or contribute new features. Quick Start ----------- .. code-block:: bash # Install via pip pip install itwinai # Launch a complete workflow with SLURM integration using the MNIST example itwinai run -c https://raw.githubusercontent.com/interTwin-eu/itwinai/refs/heads/main/use-cases/mnist/torch/run-example.yaml # View logs in MLflow itwinai mlflow-ui --path mllogs/mlflow ๐Ÿš€ Begin Here ============== - :doc:`User Installation (for non-developers) ` - :doc:`Developer Installation ` - :doc:`Submitting jobs to SLURM on HPC ` - :doc:`Using itwinai Container Images ` ๐Ÿ› ๏ธ Core Guides =============== - :doc:`Training a Neural Network ` - :doc:`Logging and Tracking ML workflows ` - :doc:`Defining machine learning workflows ` - :doc:`Hyperparameter Optimization ` ๐ŸŽ“ Tutorials ============= - :doc:`Writing Configuration Files for itwinai ` - :ref:`Distributed Training ` - :ref:`Hyper-parameter Optimization ` - :ref:`ML Workflows ` - :ref:`Code Profiling and Optimization ` ๐Ÿ“š Use Cases & ๐Ÿงฉ Plugins ========================== - :doc:`MNIST โ€” A Toy Use Case Example ` - :doc:`Drought Early Warning in the Alps (EURAC) ` - :doc:`Fast particle detector simulation (CERN) ` - :doc:`Writing Plugins for itwinai ` - :doc:`Current List of itwinai Plugins ` For the full list of scientific use cases refer to the navigation side bar. โšก API Reference ================ - :doc:`CLI Reference ` - :doc:`Python SDK ` Integration with EuroHPC centers ================================ Our code has been run and tested on the following EuroHPC systems: - `LUMI `_ - `JSC `_ - `Vega `_ - `Deucalion `_ (coming soon) Community & Support =================== - `Join our Discord `_ - `GitHub Repository `_ - `Contributors `_ - `interTwin Project `_ **itwinai** is an open-source Python library primarily developed by CERN, in collaboration with Forschungszentrum Jรผlich (FZJ). As the primary contributor, CERN will retain administrative rights to the repository during and after the interTwin project, except in cases where CERN is unable to maintain it. How to contribute ================= Want to help improve **itwinai**? Here are a few good ways to get involved: - **Report a bug / request a feature:** open a `GitHub issue `_. - **Contribute code or docs:** fork the repository and submit a `pull request `_. - **Ask questions or float ideas:** start a `GitHub discussion `_ or join us on `Discord `_. Indices and Tables ================== * :ref:`genindex` * :ref:`modindex` * :ref:`search` Citation ======== If you use **itwinai** in your research, please cite: .. code-block:: text Bunino et al., (2026). itwinai: A Python Toolkit for Scalable Scientific Machine Learning on HPC Systems. Journal of Open Source Software, 11(117), 9409. https://doi.org/10.21105/joss.09409 BibTeX: .. code-block:: bibtex @article{Bunino2026, doi = {10.21105/joss.09409}, url = {https://doi.org/10.21105/joss.09409}, year = {2026}, publisher = {The Open Journal}, volume = {11}, number = {117}, pages = {9409}, author = {Bunino, Matteo and Sรฆther, Jarl and Eickhoff, Linus and Lappe, Anna and Tsolaki, Kalliopi and Verder, Killian and Mutegeki, Henry and Machacek, Roman and Girone, Maria and Krochak, Oleksandr and Rรผttgers, Mario and Sarma, Rakesh and Lintermann, Andreas}, title = {itwinai: A Python Toolkit for Scalable Scientific Machine Learning on HPC Systems}, journal = {Journal of Open Source Software} }