Team Management in the AI Gateway (Owners Only)

Now that you’ve requested your team, you’re ready to begin setting up and using the AI Gateway.

Add Members to a Team

Once the team is initially created, Team Owners can request changes to Team Membership by contacting it-help@cmu.edu.

Change Team Settings

Once the team is created, Team Owners can request changes to Team Membership by contacting it-help@cmu.edu.

Manage Team Member Permissions

Owners can control what non‑admin team members are allowed to do. To set team member permissions:

1. Visit ai-gateway.andrew.cmu.edu/ui.
2. Log in using your Andrew userID and password, then authenticate with Duo when prompted.
3. Click Dashboard and then Teams.
4. Click the Team ID of the team you want to manage.
5. Click the Member Permissions tab and select the appropriate toggle to control the permissions your team members should have.

What permissions should you enable?

The team's needs should determine permissions. For example:

• Small developer teams might enable all permissions so members can manage their keys without admin intervention.
• Course or instructional settings might require restricted permissions. For example, instructors might generate keys on behalf of students to control rate limits and budgets, but allow students to list or regenerate their own keys.
• Ultimately, Owners should configure permissions to fit the security and operational model of their team.

View Usage and Spend

To monitor how your team members consume the available AI Models, you can use the LiteLLM dashboard.

1. Visit ai-gateway.andrew.cmu.edu/ui.
2. Log in using your Andrew userID and password, then authenticate with Duo when prompted.
3. Click Dashboard and then Usage.
4. Filter your output with the following as desired:
   • Your Usage
   • Team Usage
     Note: Only Team Admin(s) can view the Team Usage tab.
   • Date Range (e.g., Last 7 days, Month‑to‑date).
   • Specific models or API keys.

Pro Tips: Making the Most of Your Data

Some data points we recommend you review are as follows:

• Total spend for the period
• Breakdown by model:
  • Inputs
  • Outputs
  • Calls
  • Cost
• Top users (if available)

If numbers seem off:

• Confirm the date range and timezone.
• Ensure pricing is set for custom models, so spend can be calculated.
  Note: Only owners can report on spending across their entire team. Individual users can only view their own personal usage and spending.

FAQs

Are the models FERPA-Compliant?

Can I change the team budget myself?