🦫 PIKMAT Gemini Tutor

gemini-tutor Edge Function • Chat action: chat (default JSON) • Chat action: chat-stream (SSE) • Chat action: chat-json (JSON + code exec) • Chat action: chat-native-audio • speak Edge Function (TTS) • transcribe-audio Edge Function (STT) • classify Edge Function • solve-problem Edge Function • JWT Auth (manual inside function) • Service Account JWT (Google) • CORS headers • Error handling (429, 500, auth) • Rate limit handling • Sentence buffer (streaming TTS)

Identity & Personality (Capybara teacher) • Student Context Injection (name, gender, grade) • Gender Adaptation (male/female/other) • Nikud Rules (vocalization for TTS) • Hebrew Math Orthography • Socratic Method (3 Levels) • Iron Rule: Show Exercise First • Growth Mindset • Error Handling (pedagogical) • Warm Challenging • Edge Cases Protocol • Israeli Slang (Active) • Gen Alpha Slang (Passive) • Gaming Terminology • Real-World Context (Israeli) • Response Length Limit (15-20 words) • TIR Protocol (code execution mandate) • Interaction Protocols (Lesson/Auditor/Bridge) • BiDi Rendering Rules • Code Block Prohibition • Drawing Board Instructions • Curriculum Injection • Curriculum Restrictions • Grade-Specific Refusals • Bucket-Specific Prompts (A/B/C) • Bucket B: English Internal Thinking • Bucket C: Medium Thinking • Native Audio Style Section • JSON Output Format • Long-term Memory • Student Misconceptions Injection

Grade 4 Curriculum XML • Grade 5 Curriculum XML • Grade 6 Curriculum XML • Comprehensive XMLs (new format) • Curriculum Caching (in-memory) • Curriculum Fallback • Restrictions Extraction • Gemini Prompt Caching (token cost) • Topic-specific examples • Curriculum version control

Gemini 2.5 Flash TTS via Vertex AI (speak endpoint, Schedar voice, he-IL) • Director Prompt (warm teacher tone) • Nikud Preservation • Hebrew Abbreviation Fix (achi) • Smart Hebrew Chunking • TTS Prefetch (first chunk on render) • Playback Queue (sequential chunks) • Playback Lock (one message at a time) • ChatterBox Integration (DEAD CODE) • StyleTTS2 Voice Server (DEAD CODE) • Native Audio (gemini-2.5-flash-native-audio-preview-12-2025) • LaTeX to Hebrew Words (for TTS) • Prosody Control (pauses, emphasis) • TTS Busy Tooltip • Audio Decode (MP3/WAV/PCM) • ChatterBox Dead Code Cleanup • Two TTS Paths (speak endpoint vs native-audio action)

OpenAI Whisper (transcribe-audio) • Hebrew Vocabulary Hints • MIME Type Detection • Browser SpeechRecognition API • Phone Call Mode (auto-listen) • Echo Cancellation • STT Error Messages

Shared Drawing Board • Free-form Pencil • Straight Line Tool • Eraser • Color Picker • Clear Canvas • Background Image (matplotlib) • Send Drawing to Pikmat • AI Drawing Commands • Responsive Canvas

Camera Capture Modal • Photo Preview + Retake • Gemini Vision OCR • Back Camera Default (mobile) • Camera Permission Handling

Practice Mode UI • Topic: Multiplication Table • Topic: Word Problems • Topic: Fractions • Topic: Geometry/Polygons • Topic: Math Terminology • Topic: Numbers • Scoring System (XP + Coins) • Streak Multiplier • Sound Effects • TTS for Questions • Hints per Question • Results Screen • Ask Pikmat for Explanation • Backend Progress Tracking • Adaptive Difficulty • More Question Banks

5-Level Progression • Gender-Adapted Level Names • XP from Practice • XP from Chat • Level Up Modal • XP Persistence (database) • Leaderboard

GeminiTutorPage (main) • ChatMessageBubble • MathKeyboard • PikmatAvatar • ToolsMenu • Onboarding Component • LaTeX Renderer • Loading Messages (Hebrew) • Suggestions (starter prompts) • Mobile Responsive

SSE Streaming (chat-stream) • JSON Mode (chat-json) • useStreamingWithTTS hook • useStreamingChat hook • useHybridTTS hook • Unified Abort • Sentence Detection (Hebrew)

Supabase Auth • Child User (no JWT) • Google Service Account • OpenAI API Key • Settings Page

System Prompt Unit Tests • Smoke Tests (real API) • Comprehensive Smoke Tests • E2E Tests (Playwright) • curl Smoke Tests • TTS E2E Tests • Practice Mode Tests • Mobile Viewport Tests

Gemini Prompt Caching • Long-term Student Memory • XP/Progress Persistence • Adaptive Difficulty • Parent Reports • Payment / Paywall • Landing Page • Tamagotchi Merge • React 19 Upgrade • 3D World (Animal Crossing) • MCP Calculator • Sequential Thinking • FastMCP • Videos / Comics • Multi-child Support • Badges / Achievements • CI/CD for Edge Functions • Comprehensive Curriculum XMLs