Boosting Developer Productivity with AI

• Chapter 1 – Introduction to Large Language Models
  • What is Generative AI?
  • A Bit of History …
  • … and Then …
  • RNNs
  • Problems with RNNs
  • Transformers
  • Encoders and Decoders
  • Generative AI and LLMs
  • Training the Model to Predict the Next Word Visually
  • The LLMs Landscape
  • The Evolutionary Tree of LLMs
  • The Microsoft 365 Copilot Ecosystem
  • The LLM Capabilities vs LLM Size (in Parameters)
  • Does the Model Size Matter?
  • Inference Accuracy vs LLM Size
  • Open AI GPT Models
  • Llama
  • The LLaMA Family of LLMs
  • LLaMA 2
  • The AI-Powered Chatbots
  • How Can I Access LLMs?
  • Options for Accessing LLMs
  • Cloud Hosting
  • Opinions about LLMs
  • Multimodality of LLMs
  • Infographic of Multimodality Tasks
  • Example of an LLM Explaining a Joke
  • Example of Cause & Effect Reasoning
  • Inferring Movie from Emoji
  • Prompt Engineering
  • The Right People, with the Right Skills, for the Right Time …
  • Context Window and Prompts
  • Zero- and Few-Shot Prompting
  • The Training Datasets
  • The RedPajama Project (OSS LLaMA Dataset)
  • AI Alignment
  • Reinforcement Learning with Human Feedback (RLHF)
  • Problems with RLHF
  • Ethical AI
  • Summary
• Chapter 2 – LLMs, a Technologist’s Perspective
  • LLM Operational Aspects
  • Understanding Model Sizes
  • Physical Model Sizes
  • The Training and Inference Costs
  • The Model Training Phase’s Carbon Footprint
  • Quantization
  • Model Formats
  • LLM Accuracy Benchmarks
  • Open and Closed Book Benchmarks
  • The Perplexity Performance Metric
  • Embeddings
  • Where are Embeddings Used?
  • The Vector Databases
  • LLM Concerns
  • Ways to Interface with Local LLMs
  • Using a Supported Programming API (Binding)
  • UI Options
  • Customization Options for LLMs
  • Customization Options: Top-p and Top-k
  • Customization Options: Temperature and Repetition Penalty
  • Customization Option: The Turn Template
  • Configuration Presets
  • Summary
• Chapter 3 – Introduction to ChatGPT
  • A Stylized OpenAI ChatGPT Logo
  • OpenAI GPT Models
  • OpenAI Models
  • ChatGPT 4.0
  • ChatGPT Prompts
  • ChatGPT Prompts Strategies, Tactics, and Best Practices
  • Prompt Engineering: Dealing with ChatGPT’s Hallucination Syndrome
  • Prompt Engineering: Break Down the Complex Tasks into Smaller Ones
  • Prompt Engineering: Examples of Prompts
  • OpenAI API
  • GPT Embeddings
  • Embedding Models’ Risks and Limitations
  • OK. How Can I Get My OpenAI Embedding
  • Tokens, Take 1
  • Tokens, Take 2
  • The Tokenizer UI
  • Prompts, Embeddings, and Tokens
  • Summary
• Chapter 4 – AI-Powered Developer Productivity
  • Generative AI and LLMs for Developers
  • How to Become a Technologies and Philosopher All in One
  • Gartner on AI-augmented Development Tools
  • Developer-AI Pair Programming Paradigm
  • The Tooling
  • Some Facts …
  • Code Generation: SQL Example
  • Code Generation: Using ThreadLocal Storage in Java
  • Code Generation: Thread-safe Singleton Design Pattern in C#
  • Code Generation: Bash Scripting
  • Code-to-Code Translation
  • Code Llama
  • Fine-Tuning Llama 2 Workflows
  • GitHub Copilot
  • Can I Trust AI-Generated Code?
  • The Safeguards
  • The General Recommendations …
  • Summary
• Chapter 5 – Introduction to GitHub Copilot
  • What is GitHub Copilot?
  • Copilot Chat
  • IDE and REPL Integrations
  • Will Copilot Replace Developers?
  • Can I Trust Code Generated by GitHub Copilot Code?
  • GitHub Copilot’s Modus Operandi
  • The Life of a Code Completion: The Big Picture
  • Code Suggestions are Not Copy & Paste from Other Peoples’ Code
  • The Shebang Prologue Hint
  • Getting Started with GitHub Copilot
  • GitHub Copilot Plans
  • Copilot for Individuals
  • Copilot for Businesses
  • GitHub Copilot Security
  • Responsible Copilot
  • Summary

Lab Exercises

• Lab 1. Learning the Colab Jupyter Notebook Environment
• Lab 2. Hello, AI!
• Lab 3. OpenAI Platform Overview
• Lab 4. Using OpenAI API
• Lab 5. Understanding Embeddings
• Lab 6. OpenAI API Project
• Lab 7. Copilot Environment Setup
• Lab 8. Hello, Copilot!