Carnegie Mellon University

Ask the AI Architect

Each month, our AI Architect answers real questions from the community, offering practical advice and actionable prompts. We encourage you to submit any questions, from basic to highly technical! Next month, we will choose and highlight one of your questions.

Submit Your Question


Dear Architect

July 2024
In Microsoft Copilot, I can select “precise”, “balanced”, or “creative” mode. How do I know which one to choose?

Precise Mode
- Focus: Accuracy and conciseness.
- Use: Technical tasks, data analysis, coding, factual documentation.

Balanced Mode
- Focus: Mix of precision and engagement.
- Use: General communication, emails, meeting notes.

Creative Mode
- Focus: Imagination and novelty.
- Use: Brainstorming, creative writing, marketing content.

How to choose?
- Precise: When accuracy is critical.
- Balanced: For clear and engaging communication.
- Creative: For idea generation and creative tasks.

Remember, with AI models there is always a risk that the model may hallucinate, or “make up” information, no matter what mode you choose. Try different modes, but always check the quality of the results.

June 2024
I have heard about RAG. What is it? If I use RAG, should I be concerned that I'm training the LLM on my data, which could leak out to others who use the same LLM?

RAG stands for Retrieval-Augmented Generation. It’s like giving your AI a handy library card—it fetches relevant information from a database to help generate more accurate and relevant responses. And no, using RAG doesn't mean your data will get mixed up with everyone else's. Your secrets are safe!