Alpa
0.1.5.dev12

Getting Started

  • Install Alpa
  • Alpa Quickstart

Tutorials

  • Distributed Training with Both Shard and Pipeline Parallelism
  • Differences between alpa.parallelize, jax.pmap and jax.pjit
  • Performance Tuning Guide
  • Serving OPT-175B using Alpa
  • ICML’22 Big Model Tutorial

Architecture

  • Design and Architecture

Developer Guide

  • Developer Guide
Alpa
  • »
  • Alpa Tutorials
  • Edit on GitHub

Alpa Tutorials

Alpa Quickstart

Alpa Quickstart

Distributed Training with Both Shard and Pipeline Parallelism

Distributed Training with Both Shard and Pipeline Parallelism

Differences between alpa.parallelize, jax.pmap and jax.pjit

Differences between alpa.parallelize, jax.pmap and jax.pjit

Download all examples in Python source code: tutorials_python.zip

Download all examples in Jupyter notebooks: tutorials_jupyter.zip

Gallery generated by Sphinx-Gallery

© Copyright 2022, Alpa Developers.

Built with Sphinx using a theme provided by Read the Docs.