About

Abu Bakar Siddik

I'm an AI engineer and researcher in Rajshahi, Bangladesh. I co-founded and lead AI engineering at an early-stage legal-AI company, where I build agent workflows for legal research, drafting, and review.

Before that I led the Core RAG & AI team at AskTuring.ai, where the platform grew from 100 to 10,000+ concurrent users, and shipped private, air-gapped LLM systems for enterprise clients at Sazim Tech. I maintain open-source agent infrastructure, mainly Golem and Herbie, and I'm writing a free book on training LLMs from scratch.

Alongside the engineering work, I'm doing an MSc at RUET on agent security and alignment: how agents fail at their boundaries, and how fine-tuning can shift a model's behaviour.

Experience

From ML research to leading production AI systems.

Apr 2026 – Present

Colorado, USA · Remote

Stealth · Legal AI

Current

Co-founder & Lead AI Engineer

Co-founding and leading AI engineering at an early-stage legal tech venture. Building agentic AI software for lawyers, covering retrieval over case law and contracts and multi-step legal reasoning workflows.

  • Design agent workflows that automate legal research, drafting, and review
  • Own the AI architecture: retrieval, agent orchestration, evaluation, and production deployment
  • Set the technical direction of the product and the engineering team

Apr 2026 – Sep 2026

Rajshahi, Bangladesh

Chorcha

AI Consultant

AI consulting for an education platform serving Bangladeshi students.

  • Designed AI learning systems for the Bangladeshi curriculum
  • Advised on LLM integration, curriculum design, and responsible AI adoption

Jul 2025 – Apr 2026

La Jolla, CA, USA · Remote

AskTuring.ai

Applied AI Engineer (L-2)

Led the Core RAG & AI Team, owning the architecture of a production RAG platform: retrieval, agent orchestration, evaluation, and a provider layer with no vendor lock-in.

  • Scaled the platform from 100 to 10,000+ concurrent users at ChatGPT-level latency, without vendor lock-in
  • Reduced hallucinations by 98% via hybrid search, reranking, citation extraction, and strict source-grounding
  • Designed multi-agent workflows with explicit state management, improving system throughput by 30%
  • Built agentic RAG with multi-layer memory (short-term, long-term, semantic) and time-aware retrieval, lifting contextual accuracy by 45%
  • Implemented a citation system with cross-source referencing across documents, web sources, and memory layers
  • Optimized chat hot paths via prepare-then-query pre-computation, parallelized resolution, and fewer database round-trips, reducing end-to-end latency
  • Built persistent user memory end-to-end: extraction service, schemas, CRUD APIs, and chat-flow integration
  • Refactored the LLM provider/model layer into modular configs and rolled out new model tiers behind feature flags
  • Built an internal evaluation benchmark and RAG suite management tooling, cutting evaluation time by 99%
  • Built image generation and editing pipelines with pixel-level control, integrated into agent workflows as first-class tools
  • Migrated the backend to async SQLAlchemy and restructured conversation, message-source, and repository layers for scale

Oct 2023 – Jul 2025

Dhaka, Bangladesh · Remote

Sazim Tech Ltd

Machine Learning Engineer

Joined as Trainee Engineer and promoted to ML Engineer (L-1) after 4 months. Built production-grade LLM integrations and private AI deployments for enterprise clients.

  • Designed Port and Adapter (Hexagonal) architecture for multi-provider LLM integration (OpenAI, Anthropic, local LLMs)
  • Deployed LLM evaluation pipeline with source-based fact-checking, improving response reliability by 35%
  • Reduced jailbreak and safety risk by 45% with layered guardrails and prompt hardening
  • Delivered private on-premise AI solution for enterprise client, air-gapped, reducing cloud dependency and latency by ~30%
  • Used Docker and self-hosted GPU infrastructure, cutting model startup time by 20–25%
  • Built full RAG application (3M+ sample database) using open-source LLMs, Next.js, LangChain, and FastAPI as Trainee

Sep 2022 – Sep 2023

Dhaka, Bangladesh · Remote

Intelsense AI

ML Researcher & Engineer

Joined as intern, progressed to Researcher & Engineer. Built conversational AI systems and contributed to Bengali language NLP research.

  • Built Rasa-based chatbots for financial services and mobile operator industries (PoC and pilot deployments)
  • Developed multilingual restaurant chatbot supporting English, Banglish, and Bangla natural language inputs
  • Collaborated on Bengali Automatic Speech Recognition (ASR) tool
  • Researched Voice Activity Detection (VAD) technologies to improve system efficiency and responsiveness
  • Served as Data Annotation Team Lead, managing NLP dataset collection, labeling, and quality assurance

Nov 2021 – Apr 2022

Dhaka, Bangladesh

Cramstack

Data Science Apprentice

Early-career data science role working on OCR, text summarization, data visualization, and analytical reporting across client projects.

  • Evaluated and compared OCR libraries, contributing to a real-world document processing tool
  • Researched and applied modern text summarization algorithms to real-world client data
  • Built custom Google Data Studio dashboards for client data communication and stakeholder reporting
  • Pre-processed and cleaned complex datasets, designed interactive dashboards, and performed web scraping

Volunteer

Mar 2019 – May 2024

Rajshahi, Bangladesh

Robotic Society of RUET (RSR)

Technical Secretary → IT Manager → Executive Member

5 years 3 months of progressive leadership in RUET's robotics and engineering society. Grew from Executive Member to Technical Secretary, organizing technical events and managing digital infrastructure.

  • Technical Secretary (Nov 2023 – May 2024): Led technical initiatives and workshop programs for the society
  • IT Manager (Dec 2022 – Nov 2023): Managed society's digital infrastructure, website, and technical operations
  • Executive Member (Mar 2019 – Dec 2022): Contributed to robotics competitions, events, and member activities
Approach

How I work.

Three habits that carry from prototype to production.

Built for production

I design for uptime, latency, and cost from the first version. At AskTuring I scaled a RAG platform from 100 to 10,000+ concurrent users.

Secure the boundaries

Most agent failures happen where a model meets tools, memory, or untrusted text. Golem sanitizes untrusted history and can cancel runs inside tools; Quicksilver treats in-game chat as data, not instructions.

Measure first

I test claims about model behaviour before making them. Golem ships with a 19-check live harness, and my research starts by reproducing a published result before testing a new one.

Education

Mechatronics, then graduate research.

Both degrees at Rajshahi University of Engineering & Technology (RUET).

Nov 2025 – Present

Rajshahi, Bangladesh

MSc in Computer Science & Engineering

Ongoing

Rajshahi University of Engineering & Technology (RUET)

Graduate research on agent security and alignment, done part-time alongside engineering work.

Research
Agent security and LLM alignment
Supervisor
Dr. Md. Rabiul Islam
Thesis
Alignment drift in language models after domain-specific fine-tuning (in progress)
  • Thesis studies how narrow fine-tuning can shift a model's behaviour outside its target domain, and which mitigations hold
  • Published a review of cyber-capable AI agents on arXiv (2026): vulnerabilities, evaluation containment, and defensive response
  • Building Jontro, a replayable tool-use dataset for Bangla-language agents

Jan 2019 – Jan 2024

Rajshahi, Bangladesh

BSc in Mechatronics Engineering

Rajshahi University of Engineering & Technology (RUET)

An engineering degree spanning control systems, robotics, signal processing, and programming, which became the base for later work in machine learning.

Thesis
Deep learning for medical applications
Coursework
Artificial Intelligence · Machine Learning Algorithms · Software Engineering · Robotics · Numerical Analysis & Statistics · Digital Signal Processing & Machine Vision · Automation
  • Three applied machine learning papers (2023–2024), on genetic-disorder classification, detecting AI-generated images, and patient monitoring
  • Competed in ML challenges, including Mayo Clinic STRIP AI on Kaggle and a top 0.5% finish in Analytics Vidhya's Dataverse Hack
Open source

Other open-source work.

Smaller tools I maintain, and merged contributions to other projects.

Maintained

claude-skills-collection (1.1k stars) · zdr, a guide to zero-data-retention LLM providers · whisperx-transcribe, a Claude Code skill · the-truth-serum, an AI fact-checker · releasebot-ai

Contributed

open-code-review (Alibaba): Refactored the telemetry summary path into a typed struct.

Contributed

Atlas (pacifio): Fixed agents not inheriting the configured permission mode, and polished git-status indicators in the file explorer.

Stack

What I build with.

Languages, frameworks, and infrastructure I use for agent systems.

Agent Systems

Orchestration, tool use, and multi-step execution.

Agent Orchestration · Multi-Agent Systems · Tool Integration · Structured Output · Self-Correction & Recovery · Agent Evaluation · Model Context Protocol (MCP) · LangGraph · Pydantic AI · Claude Agent SDK · OpenAI Agent SDK

LLM Engineering

Low-level control over models in production.

Function Calling · Streaming · Provider Abstraction · Fallbacks & Retries · Usage & Cost Control · Prompt Systems · LLM Fine-Tuning · Evaluation Frameworks · Hybrid Search & Reranking

Backend Engineering

APIs, databases, and scalable architecture.

Python · TypeScript · Go · Rust · FastAPI · NestJS · PostgreSQL · Redis · REST & GraphQL · Hexagonal Architecture · Connection Pooling

Infrastructure

Deployment, observability, and scale.

Docker · Kubernetes · AWS EC2 / S3 · GCP Vertex AI · GitHub Actions · Observability & Tracing · Private AI Deployments · Air-Gapped Infrastructure