The AI World · Article 4

Google Gemini 101: from your first chat to the API

Google’s AI story, why Gemini is built multimodal, the app on web and Android, Gems and Deep Research, Workspace, AI Studio, the Gemini API and the Gemini CLI.

By Mrinal Singh Raja19 min read

How to read this

Just want to use Gemini? Follow the green sections — you can be up and running on your phone in five minutes. Curious how it works? Read the amber ones. Building something? The red sections cover AI Studio, the API and the CLI.

BeginnerIntermediateAdvanced

If you have an Android phone, a Gmail account or have searched Google recently, you have probably already met Gemini. It is Google’s AI — a chat assistant you can talk to, point your camera at, and ask to research the web for you — and it is quietly being built into almost everything Google makes.

This guide takes you from your first question to your first program. We begin with where Gemini came from and what makes its design different, pick the right model, then go step by step through the app on the web and on your phone, its most useful features, Gmail and Docs, and finally the developer side: Google AI Studio, the Gemini API and the Gemini CLI.

01Beginner

What is Gemini?

The word Gemini means two things. It is Google’s family of AI models, built by its research lab Google DeepMind. And it is the assistant you use — the Gemini app — along with the AI features inside Android, Chrome, Gmail, Docs and Search that run on those models.

Its biggest strengths come from Google itself: it can search the web with Google Search as it answers, it works inside the apps billions of people already use, and it was designed from the start to understand images, audio and video, not only text.

One family of models, everywhere Google is

For everyone

  • Gemini appgemini.google.com, Android, iPhone
  • On Androidhold the power button or say “Hey Google”
  • Gemini in Chromehelp with the page you are on
  • Google SearchAI Overviews and AI Mode

For work and study

  • Gmail, Docs, Sheets, Slidesside panel in Google Workspace
  • NotebookLMresearch grounded in your own sources
  • Flow and VeoAI video creation

For builders

  • Google AI Studiotry models, get an API key
  • Gemini APIcall Gemini from your code
  • Vertex AIGemini on Google Cloud for companies
  • Gemini CLIan open-source agent in your terminal
  • AntigravityGoogle’s agent-first coding environment
Fig. 1Where Gemini shows up. The same model family powers the consumer apps, Google’s work tools and the developer platform.
02Beginner

Google’s AI story

Google has a special place in this history: the Transformer, the design at the heart of ChatGPT, Claude and Gemini alike, was invented by Google researchers in 2017. Yet it was OpenAI that put a chatbot in front of the public first. Gemini is the result of Google’s push to catch up — and, in areas like multimodality and long context, to lead.

  1. 2017

    Google invents the Transformer

    The paper “Attention Is All You Need”, by Google researchers, introduces the architecture behind every modern chatbot.

  2. 2018–2022

    BERT, LaMDA, PaLM

    BERT improves Google Search; LaMDA is built for conversation; PaLM scales to 540 billion parameters.

  3. Feb–Mar 2023

    Bard

    Google’s first public AI chatbot, answering ChatGPT.

  4. Apr 2023

    Google DeepMind

    Google Brain and DeepMind merge into one lab, the team that builds Gemini.

  5. Dec 2023

    Gemini 1.0

    Ultra, Pro and Nano: a model family built multimodal from the start — text, images, audio and video together.

  6. Feb 2024

    Bard becomes Gemini; 1.5 Pro

    The chatbot takes the model’s name, and Gemini 1.5 Pro can read a million tokens at once.

  7. Dec 2024

    Gemini 2.0 and Deep Research

    Google announces the “agentic era”: models that use tools and act; Deep Research writes cited reports.

  8. 2025

    Thinking models, CLI, Nano Banana, Gemini 3

    Gemini 2.5 thinks before answering (March); Gemini CLI goes open source (June); the “Nano Banana” image model goes viral (August); Gemini 3 arrives in November.

  9. 2026

    The Gemini 3.x generation

    Faster, cheaper Flash models reach frontier quality — Gemini 3.8 Flash is the API’s default today — alongside new voice, video and music models.

Fig. 2From the Transformer to today’s Gemini 3.x models. Only the major milestones are shown.
03Intermediate

How Gemini is built

Like every modern chatbot, Gemini is a large language model based on the Transformer: it turns its input into tokens and predicts, one token at a time, what should come next. (Our first article, Welcome to the world of AI, explains that from scratch.) Two design choices set Gemini apart.

1. Natively multimodal

Early AI assistants handled pictures and sound by bolting on extra systems: one converts speech to text, another writes a caption for an image, and only then does the language model see anything. Gemini was trained from the beginning on text, images, audio and video together, so all of them become tokens in the same stream. That is why it can notice the tone of a voice, read a chart inside a photo, or follow what happens across a video.

Two designs compared. Bolted-on: separate systems turn speech into text and images into captions before a text-only model sees them, losing tone and detail. Natively multimodal, like Gemini: text, images, audio and video are all turned into tokens and read together by one model.Bolted-onNatively multimodal (Gemini)🎙️voicespeech-to-text🖼️photocaption writer📝texttext-onlymodeltone of voice, layout, detailget lost in translation🎙️🖼️🎞️📝everything becomes tokensone modelsees it alltogetherhears the sarcasm,reads the chart
Fig. 3Two ways to handle pictures and sound. Gemini takes the approach on the right.

2. Mixture of experts

Google’s technical reports describe Gemini models using a mixture-of-experts (MoE) design. Instead of one giant block of neurons that all fire for every word, the model contains many smaller “expert” networks and a router that sends each token to just a few of them. The model can be enormous in total while each step stays fast and affordable.

A mixture-of-experts layer. A router looks at each token and sends it to only a couple of the many expert sub-networks, so a huge model spends only a fraction of its compute on each token.a token“def”routerexpert: mathsexpert: codeexpert: grammarexpert: Hindiexpert: biologyexpert: musicexpert: lawexpert: combinedoutputonly 2 of 8 expertsdid any work
Fig. 4A mixture-of-experts layer, simplified. Real experts don’t have tidy labels like “maths” — they learn their own specialities during training.
04Intermediate

The model family

Gemini comes in tiers. Flash-Lite is the cheapest and quickest; Flash balances speed and intelligence and is Google’s recommended starting point; Pro reasons the most deeply. Around them sit specialists for live voice, speech, images (the famous “Nano Banana”), video, music and embeddings.

Cheapest, fastest

Gemini Flash-Lite

gemini-3.5-flash-lite

Huge volumes of simple jobs: tagging, routing, short summaries.

The default

Gemini Flash

gemini-3.8-flash

Google’s recommended starting point: fast, and strong enough for coding and agents.

Deepest reasoning

Gemini Pro

gemini-3.1-pro-preview

Hard analysis, maths and complex agentic work (preview in the API).

faster, cheapersmarter, slower

Specialist models

  • Live: gemini-3.8-live — real-time voice conversations
  • Text-to-speech: gemini-3.8-flash-tts — natural voices
  • Nano Banana: gemini-3.1-flash-image — create and edit images
  • Video: gemini-omni-1.1-flash, Veo 3.1 — generate and edit video
  • Embeddings: gemini-embedding-001 — meaning-based search
Fig. 5The Gemini API lineup, from Google’s models page on 24 September 2026. In the Gemini app you choose between fast and thinking modes rather than model IDs.

Newer Gemini models are thinking models: before answering, they can reason through a problem internally. In the app this appears as a choice between a fast mode and a thinking mode; in the API, developers can control how much the model thinks, trading depth against speed and cost.

05Beginner

Getting started, step by step

  1. Open Gemini

    gemini.google.com or the app

  2. Sign in

    with your Google account

  3. Ask

    a real task, in plain words

  4. Add something

    a photo, PDF or screenshot

  5. Refine

    “shorter”, “as a table”…

Fig. 6Your first five minutes with Gemini.
  1. Open Gemini. Go to gemini.google.com on a computer, or install the Gemini app on iPhone. On most recent Android phones, Gemini is already built in.
  2. Sign in with your Google account. The same account that runs your Gmail. Work and school accounts may need an administrator to switch Gemini on.
  3. Learn the screen. It has only a few parts:
gemini.google.com — illustration
✎ New chat

Gems

💎 Exam coach

💎 Recipe helper

Recent

Monsoon trip to Coorg

Explain SIP returns

Fix Sheets formula

Gemini · Fast ▾

Hello, Arjun

Ask Gemini
Tools 🎙️ Live
  1. New chat — one topic per chat.
  2. Gems — your saved, custom versions of Gemini.
  3. Recent chats — searchable history.
  4. Model menu — a fast mode for everyday asks, a thinking mode for hard ones.
  5. The prompt box — type, paste, or add files and photos with +.
  6. Tools — Deep Research, Canvas, image and video creation.
  7. Live — talk to Gemini out loud, and share your camera or screen.
Fig. 7An illustrated map of the Gemini app on the web. Buttons move between updates, but these seven parts stay.
  1. Ask for something real — a trip plan, an explanation, a draft — and keep going with follow-ups.
  2. Add files and photos with the + button: a bill to explain, a PDF to summarise, a screenshot of an error.
  3. Use “double-check”. Under an answer, the menu offers a check against Google Search that highlights statements with supporting or conflicting sources.
06Intermediate

Gems, Deep Research, Canvas and Live

Gems: your own custom Geminis

A Gem is a saved version of Gemini with its own instructions and, optionally, its own files. Write the instructions once — who it is, what it does, how it answers — and open it whenever you need it: an interview coach, a recipe planner, a writing editor in your house style.

Gem manager → New Gem — illustration

Name

💎 Interview coach

Instructions

You are a friendly but honest interview coach for freshers applying to IT companies in India. Ask one question at a time. After each answer, score it out of 10, say what worked, and show a stronger version. Mix HR and technical questions.

Knowledge

📄 my-resume.pdf · 📄 job-description.pdf

Preview

Let’s begin. Tell me about a project on your résumé you’re proud of — what was your part, and what went wrong?

I built a college attendance app in Flutter…

7/10. Clear and specific. Add a number — how many students used it? — and one thing you’d do differently…

Fig. 8Illustration of building a Gem: instructions and knowledge on the left, a live preview on the right.

Deep Research: a report while you make tea

For questions that need many sources, choose Deep Research. Gemini drafts a research plan you can edit, then browses and reads for several minutes, and returns a structured report with its sources, which you can export to Google Docs.

  1. Your question

    “Compare EV two-wheelers under ₹1.5 lakh for a Pune commute”

  2. Research plan

    Gemini proposes the sub-questions; you can edit them

  3. Browse

    reads dozens of pages over several minutes

  4. Reason

    compares, spots gaps, searches again

  5. Report

    a structured report with sources, exportable to Docs

Fig. 9How Deep Research works. Read the sources that matter before relying on the report.

Canvas and Live

Canvas opens a workspace beside the chat for longer documents and code, which you and Gemini edit together; it can also turn material into web pages, quizzes and audio overviews. Gemini Live is a spoken conversation: tap Live, talk naturally, interrupt whenever you like, and on a phone share your camera or screen so Gemini can see what you see.

07Beginner

Gemini on your phone

On Android, Gemini is the phone’s built-in assistant. Press and hold the power button (or say “Hey Google”, if enabled) to bring it up over whatever you are doing, and ask about what is on screen. On iPhone, install the Gemini app from the App Store. On both, Live with the camera is the stand-out feature: fix a bike, identify a plant, translate a sign, or get help with homework on paper.

Gemini

Ask about screen · Talk Live

Ask Gemini

hold the power button

“That’s a slipped chain. Shift to the smallest rear gear, then lift the chain back on from the top…”

Live · camera on

Fig. 10Illustrations: summoning Gemini over any app on Android, and Gemini Live looking through the camera.
08Intermediate

Gemini in Gmail, Docs and Drive

On eligible plans, a Gemini button appears inside Google Workspace apps and opens a side panel that can see the email, document or folder you are working on. It summarises long threads, drafts replies, turns rough notes into a document, builds formulas and tables in Sheets, and finds files in Drive by what is in them.

Gmail with the Gemini side panel — illustration

Re: Venue for the alumni meet (14 messages)

Rohit: The hall at Dispur can seat 120, ₹40k…

Meena: Can we check the Paltan Bazaar option too?

Rohit: They quoted ₹32k but no parking…

Anita: Dates — 22 Nov or 29 Nov?

Gemini

Summarise this thread and what’s still undecided

  • • Two venues: Dispur (₹40k, 120 seats) and Paltan Bazaar (₹32k, no parking)
  • Undecided: venue, and 22 vs 29 Nov

✎ Draft a reply proposing a vote

Fig. 11Illustration: the Gemini side panel summarising a long Gmail thread and offering to draft a reply.

For deep work across your own sources, Google also offers NotebookLM: upload papers, notes or videos, and ask questions answered only from those sources, with citations — even as a podcast-style audio overview.

09Intermediate

Prompting Gemini well

The prompting habits from ChatGPT 101 — role, task, context, format, examples, limits — work just as well here. A few tips make the most of Gemini’s particular strengths:

  • Show, don’t describe. Gemini reads images, audio and video natively. Instead of typing out a table from a photo, just attach the photo.
  • Refer to parts precisely. With long material, point to where you mean: “in the third section”, “at 12:40 in the video”, “the chart on page 7”.
  • Ask for sources when facts matter. “Use Google Search and link your sources” nudges Gemini to ground its answer.
  • Use the right tool. A quick question goes in chat; a big one goes to Deep Research; a long document goes in Canvas; a repeated job becomes a Gem.
  • Reach into your apps by name. Mentioning Gmail, Drive or Calendar tells Gemini where to look.
10Beginner

Plans and privacy

The Gemini app is free with a Google account, and the free tier is generous: Deep Research, Canvas, Gems, Live and image creation are all included. Paid Google AI plans raise the limits, unlock more of the top models and video tools, add Gemini inside Gmail and Docs, and bundle extra Google storage.

  1. Free

    • Gemini app with a Flash model, and Pro for some asks
    • Deep Research, Canvas, Gems, Live
    • Image creation and editing
  2. Google AI Plus

    • Higher limits
    • Gemini in Gmail and Docs
    • Some video generation
    • More storage
  3. Google AI Pro

    • Higher limits again
    • More access to the Pro model
    • More video and creative credits
    • Lots of storage
  4. Google AI Ultra

    • The highest limits
    • Earliest access to top models and experiments
    • The most credits and storage
Fig. 12The consumer plans at the time of writing, from Google’s subscriptions page. Prices vary by country and change often, so they are not listed here.

Privacy checklist

  • Open Gemini Apps Activity in the app’s settings to see what is saved, set auto-delete, or turn saving off. Some conversations may be reviewed by people to improve Google’s services, so read the notice there.
  • Use temporary chats for anything you would rather not keep.
  • Don’t share secrets: passwords, card and bank numbers, Aadhaar or passport numbers.
  • Work and school accounts follow your organisation’s data terms, which are usually stricter.
11Advanced

Long context and grounding

Gemini made long context famous: Gemini 1.5 Pro was one of the first models to read about a million tokens in one go, and large context windows remain a Gemini strength. That changes what is possible — you can hand over a whole book, an hour-long lecture video or a sizeable codebase and ask questions across all of it.

What fits in a 1,000,000-token context window, very roughly:

about 1,500 pages of text

roughly an hour of video

several hours of audio

a codebase of tens of thousands of lines

…but only one of them at a time. Estimates vary with language, resolution and the model.

Fig. 13Rough sizes of a million tokens, based on Google’s published guidance.

Playground

Will it fit in one prompt?

Drag the sliders to mix your material and see roughly how much of a 1-million-token context window it uses.

300
10
60
5,000

6,45,300 tokens — 65% of the window. ✓ Fits in one go.

Rough estimates: ~667 tokens per page, ~300 per second of video, 32 per second of audio, ~30 per line of code. Real counts depend on language, resolution and the model; the API can count tokens exactly.

Long context is not free: bigger inputs cost more and take longer. Two techniques help. Context caching stores a large, unchanging input — say, a 500-page manual — so repeated questions reuse it at lower cost. And retrieval (RAG) searches your material first and sends only the relevant chunks, which scales to libraries far bigger than any context window.

Grounding with Google Search

A model’s built-in knowledge stops at its training date. Grounding connects Gemini to Google Search so it can look things up while answering and cite what it found. In the API it is a built-in tool you switch on; Gemini decides when a question actually needs a search.

Grounding with Google Search. Gemini decides a question needs fresh facts, runs Google searches, reads the results, and answers with citations linking to the sources, so you can check them.Question“Is the Kazirangapark open this week?”Needs fresh facts?Gemini decidesto searchGoogle Searchqueries run,top pages readGrounded answerwith numberedsource links [1] [2]no search needed → answers directlyin the API, this is one built-in tool you switch on
Fig. 14Grounding with Google Search. The citations are the point: they let you check the answer.
12Advanced

Google AI Studio: the developer’s playground

Google AI Studio (aistudio.google.com) is where developers try Gemini before writing code. Sign in with a Google account, pick a model, write system instructions, attach images or files, switch on tools such as grounding or structured output, and see the result immediately. When it works, Get code produces matching code in several languages, and Get API key creates the key you need.

aistudio.google.com — illustration

System instructions

You write product descriptions for a Jaipur block-print store. Warm, 60 words, no clichés.

📷 [photo of an indigo quilt] Describe this.

Hand-stamped by artisans in Sanganer, this indigo quilt carries tiny marigold motifs across soft mulmul cotton…

</> Get code🔑 Get API key

Run settings

gemini-3.8-flash ▾

Thinking ▸ low

Structured output ☐

Grounding: Google Search ☑

Tokens: 1,204 / 1,048,576

Fig. 15Illustration of Google AI Studio: prompt on the left, model and tool settings on the right.

For company use, the same models are offered on Vertex AI in Google Cloud, with enterprise security, data residency and billing through a Cloud account.

13Advanced

The Gemini API

Install Google’s SDK with pip install -U google-genai, create a key in AI Studio, and set it as GEMINI_API_KEY. Google’s current documentation centres on the Interactions API: each call is an interaction with a model, an input and optional instructions.

first_call.py — Python
from google import genai

client = genai.Client()  # reads your GEMINI_API_KEY

interaction = client.interactions.create(
    model="gemini-3.8-flash",
    system_instruction="You are a patient maths tutor for Class 10 students in India.",
    input="Explain why (a + b)² = a² + 2ab + b² using a picture I can draw.",
)

print(interaction.output_text)
Fig. 16A first call with system instructions, following Google’s current quickstart.

To hold a conversation, pass the previous interaction’s ID and Gemini continues from there — no need to resend the whole history yourself:

chat.py — Python
first = client.interactions.create(
    model="gemini-3.8-flash",
    input="I have ₹20,000 to invest every month for 10 years.",
)

follow_up = client.interactions.create(
    model="gemini-3.8-flash",
    input="Show me what that becomes at 8% a year, as a table.",
    previous_interaction_id=first.id,   # continue the same conversation
)
print(follow_up.output_text)

Structured output

For software, ask for JSON that matches a schema. With Pydantic you define the shape once and get validated objects back:

expense.py — Python
from pydantic import BaseModel

class Expense(BaseModel):
    merchant: str
    amount_inr: float
    category: str

interaction = client.interactions.create(
    model="gemini-3.8-flash",
    input="Paid 1,240 at Big Bazaar for groceries and snacks on Friday.",
    response_format={
        "type": "text",
        "mime_type": "application/json",
        "schema": Expense.model_json_schema(),
    },
)

expense = Expense.model_validate_json(interaction.output_text)
print(expense)  # merchant='Big Bazaar' amount_inr=1240.0 category='Groceries'
Fig. 17Structured output: the response must follow the schema. The final comment shows a sample result.

And the same basic call over plain HTTP:

Terminal — curl
curl -X POST "https://generativelanguage.googleapis.com/v1beta/interactions" \
  -H "x-goog-api-key: $GEMINI_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "gemini-3.8-flash",
    "input": "Give me three names for a momo stall in Shillong."
  }'

What else the API can do

  • Multimodal input: send images, audio, video and PDFs alongside text.
  • Function calling: describe your own functions; Gemini asks you to run them and uses the results.
  • Built-in tools: Google Search grounding, code execution and URL reading.
  • Live API: real-time, two-way voice and video for conversational apps.
  • Generation: images with Nano Banana, video with Veo and Omni, speech, and music.
  • Embeddings: turn text and media into vectors for semantic search.
14Advanced

Gemini CLI: an agent in your terminal

Gemini CLI is Google’s open-source AI agent for the command line. It reads and edits files, runs shell commands with your permission, searches the web with Google Search, and connects to other tools through the Model Context Protocol (MCP). Signing in with a personal Google account includes a free allowance — at the time of writing, 60 requests a minute and 1,000 a day.

Terminal — install Gemini CLI
# run without installing
npx @google/gemini-cli

# or install it
npm install -g @google/gemini-cli
brew install gemini-cli        # macOS / Linux

gemini                          # start, then sign in with Google
~/photos — gemini — illustration
$ gemini
✦ Gemini CLI  · signed in with Google · GEMINI.md loaded

> Rename every photo in this folder by the date it was taken, like 2026-09-14_001.jpg

✓ ReadFolder . — 214 .jpg files
✓ Shell exiftool -DateTimeOriginal IMG_0001.jpg

I’ll write a small script that reads each photo’s EXIF date and renames it.
3 photos have no date — I’ll leave those unchanged and list them.

? Allow execution of: python rename_by_date.py --dry-run
  › Yes, allow once   Always allow   No

✓ Shell dry run: 211 renames, 3 skipped — no clashes

Looks right. Run it for real?
Fig. 18Illustration of a Gemini CLI session: explore, plan, ask permission, dry-run, confirm.

Put a GEMINI.md file in your project to give the CLI lasting context — how to build and test, conventions, things to avoid — and it will read it every session. The same ideas power Google’s Antigravity, an agent-first development environment where several agents can work on tasks in parallel.

15Beginner

Your 30-day path

Small steps, one week at a time, from first chat to first program.

  1. Week 1 · Everyday

    • Use the Gemini app daily for real tasks
    • Try Live with your camera
    • Ask it about a photo you take
  2. Week 2 · Research

    • Run one Deep Research report
    • Draft something long in Canvas
    • Check three of its sources yourself
  3. Week 3 · Personalise

    • Build a Gem you’ll reuse
    • Connect Gmail, Drive or Calendar
    • Summarise a long email thread
  4. Week 4 · Build

    • Prototype in Google AI Studio
    • Make your first API call
    • Install Gemini CLI and add GEMINI.md
Fig. 19Four weeks through every part of the Gemini world. Skip ahead wherever you are already comfortable.

Quick quiz

Tap a question to check your answer.

Q1What does “natively multimodal” mean?

The model was trained on text, images, audio and video together, so they all become tokens in one stream — rather than separate systems converting sound or pictures into text first.

Q2You ask the same assistant setup every week. What should you build?

A Gem: a saved version of Gemini with its own instructions and files.

Q3Your 3-hour lecture video doesn’t fit in one prompt. What are your options?

Split it into parts, summarise sections first, or use retrieval to send only the relevant pieces. For repeated questions on a big fixed input, context caching cuts cost.

Q4In the Interactions API, how do you continue a conversation?

Pass previous_interaction_id with the ID of the earlier interaction, and Gemini continues from it.

That is Gemini, from holding the power button to your first line of code. Start with the door closest to you — probably the phone in your pocket — and build from there. ✦

Gemini, Google AI Studio, Gemini CLI, NotebookLM and Android are products of Google; this article is independent and not affiliated with or endorsed by Google. Model IDs and API code follow the Gemini API documentation, CLI details follow the Gemini CLI repository, and plan features follow Google’s subscriptions page, all as of 24 September 2026. Interface screens are illustrations and sample outputs are examples. Spotted something out of date? Tell us.