Reproduce experiments

Reproduce a teammate’s W&B experiment by downloading the associated code, dependencies, and configuration from a run.

Reproduce an experiment that a team member creates to verify and validate their results. This page explains how to retrieve the code, dependencies, and configuration from a logged run so you can re-execute it in your own environment.

Before you reproduce an experiment, note the:

• Name of the project the run was logged to
• Name of the run you want to reproduce

To reproduce an experiment:

1. Navigate to the project that contains the run.
2. Select the Workspace tab from the project sidebar.
3. Click the run that you want to reproduce. The run page opens with the Overview tab shown by default.

With the run page open, you next need the exact code that produced the experiment. Download the experiment’s code at a given hash, or clone the experiment’s entire repository.

Download Python script or notebook

Download the experiment’s Python script or notebook:

1. On the Overview tab (shown by default), in the Command field, note the name of the script that created the experiment.
2. Select the Code tab on the run page.
3. Click Download next to the file that corresponds to the script or notebook.

GitHub

Clone the GitHub repository your teammate used when they created the experiment. To do this:

1. If necessary, gain access to the GitHub repository that your teammate used to create the experiment.
2. Copy the Git repository field, which contains the GitHub repository URL.
3. Clone the repository:
   git clone https://github.com/[YOUR-REPO].git && cd [YOUR-REPO]
   
4. Copy and paste the Git state field into your terminal. The Git state is a set of Git commands that checks out the exact commit that your teammate used to create the experiment. Replace values specified in the following code snippet with your own:
   git checkout -b "[RUN-NAME]" [COMMIT-SHA]
   

After you have the code, retrieve the dependencies your teammate used so your environment matches theirs:

5. On the run page, select the Files tab.

6. Download the requirements.txt file and store it in your working directory. This directory should contain either the cloned GitHub repository or the downloaded Python script or notebook.

7. Optional: Create a Python virtual environment.

8. Install the requirements specified in the requirements.txt file.

   pip install -r requirements.txt
   

9. Now that you have the code and dependencies, you can run the script or notebook to reproduce the experiment. If you cloned a repository, you might need to navigate to the directory where the script or notebook is located. Otherwise, you can run the script or notebook from your working directory.

Python notebook

If you downloaded a Python notebook, navigate to the directory where you downloaded the notebook and start Jupyter:

jupyter notebook

Python script

If you downloaded a Python script, navigate to the directory where you downloaded the script and run it with python. Replace values enclosed in [] with your own:

python [YOUR-SCRIPT-NAME].py