Job Title

Generative AI Engineer

South Africa, Gauteng
Back to jobs
Market Related
Area: South Africa, Gauteng
Sector: Banking
Posted: 14 June 2025

Job Details

Overall Purpose of the Role

Join a high-performing four-person Generative AI pod that designs and ships lightweight micro-apps, intelligent copilots, and decision-support tools for two high-impact departments. Work on real-world projects spanning both divisions local and international, taking code from prototype to production with direct business impact.

You’ll experiment with cutting-edge LLMs, build scalable tools that save time and boost decision quality, and showcase what’s possible when AI is applied creatively and responsibly in a regulated environment.

Key Responsibilities

Prompt Engineering & Experiments

  • Craft and iterate on prompts for LLMs like GPT-4o, Claude 3, Gemini, and Llama 3.
  • Identify and document failure modes such as hallucinations, bias, or latency.
  • Create internal best-practice guidelines and contribute to the team knowledge base.

Rapid Prototyping

  • Build quick to market tools like summarizers, chatbots, and data extractors using Python or TypeScript.
  • Use LangChain, Databricks, or other frameworks for orchestration.
  • Spin up simple UIs with React or vanilla JS for same-day feedback from end-users.

 Integration & MLOps-Lite

  • Wrap models with REST/gRPC endpoints and connect to internal APIs, message queues, or RPA flows.
  • Apply Git-based CI workflows and containerize your solutions using Docker.
  • Follow secure coding standards and build for maintainability and scale.

Monitoring & Iteration

  • Track solution performance (latency, cost, accuracy, feedback) and adjust for quality.
  • Automate telemetry, logging, and alerts to surface issues before they affect users.

Collaboration & Knowledge-Sharing

  • Work closely with Product, Ops, and Risk to turn business pain points into technical solutions.
  • Demo new features, lead internal sessions, and write concise, accessible documentation for non-engineers.

Experience & Skills Required

Must-Haves

  • BSc/MSc in Computer Science, Engineering, Data Science, or related field.
  • Strong Python skills plus familiarity with at least one GenAI SDK (OpenAI, Anthropic, Gemini, Hugging Face Transformers, etc.).
  • Working knowledge of HTML/CSS and basic React or JavaScript.
  • Experience with REST APIs, Git workflows, and data handling (SQL or Pandas).
  • Evidence of initiative through shipped side-projects, coursework, or personal experimentation.
  • Excellent verbal and written communication in English.

Nice-to-Haves

  • Experience with Hugging Face, PyTorch/TensorFlow, or vector databases (e.g., Pinecone, FAISS, Chroma).
  • Exposure to cloud platforms (AWS, GCP, Azure), CI/CD pipelines, or basic MLOps tools.
  • Participation in internships, hackathons, or academic/industry projects especially in fintech, banking, or other regulated sectors