Applied AI Engineer - Data Quality Systems

Other Jobs To Apply

No other job posts for this day.

<p>Firmable is the market-leading B2B sales intelligence platform in Asia pacific — and we're scaling that success globally at pace. Backed by leading investors and growing 2,000+ customers strong, we exist to give sales teams an unfair advantage: the deepest company and people data of any platform, enriched with real-time signals, served at the right moment by intelligent agents.</p><p>We're not building another search box. We're building the engine that tells a salesperson exactly who to call, why, and what to say — before they even ask.</p><h2>The Role</h2><p>This isn't a traditional QA role where you write test plans and chase tickets. As an <strong>Applied AI Engineer</strong> at Firmable, you'll own data quality across our platform end-to-end — designing the systems that decide whether the data flowing in is trustworthy enough to ship.</p><p>You'll spend your time deep in Snowflake, Python, and LLMs — architecting LLM-based quality checks, building the eval harnesses that hold them accountable, designing the skills library that other agents and teammates depend on, and shipping agentic remediation pipelines where rules, LLMs, and humans each do what they're best at.</p><p>This role has <strong>deep technical ownership</strong>. You'll make the hard rule-vs-LLM calls, build the production systems behind them, and translate findings into recommendations that change what we build.</p><h2>What You'll Own</h2><h3>Data Analysis & Product Intelligence</h3><ul><li><p>Investigate complex datasets using SQL, Snowflake, Python, and LLMs — directing agents to do the heavy lifting while you frame the question and judge the answer</p></li><li><p>Unlock insights in large-scale B2B datasets that shape product direction and commercial strategy</p></li><li><p>Build scalable, reusable datasets — and the <strong>skills</strong> that make them queryable by any agent or teammate</p></li><li><p>Translate findings into recommendations that move metrics, not slides that summarise what happened</p></li></ul><h3>Data Quality & Source Management</h3><ul><li><p>Own data quality end-to-end across rule-based and LLM-based checks, side by side — design the checks, run the evals, monitor drift, fix root causes</p></li><li><p>Make the <strong>rule-vs-LLM judgement call</strong> on every check: deterministic logic where rules win, LLMs where semantic, contextual, or entity-resolution nuance is needed — and justify the split</p></li><li><p>Assess and onboard new data sources: coverage, freshness, accuracy, and where LLM judges add lift over deterministic profiling</p></li><li><p>Track down the hardest data bugs and fix them at the root, partnering with engineering and product</p></li><li><p>Scrape or source supplementary data when it sharpens insights or enriches the product</p></li></ul><h3>AI-Powered Analysis & Automation</h3><ul><li><p>Architect <strong>LLM-based quality checks</strong> with explicit rubrics, structured outputs, and labelled eval sets — precision/recall measured, not vibed</p></li><li><p>Build and maintain the <strong>skills library</strong> (<a target="_blank" href="http://SKILL.md">SKILL.md</a> specs) that powers recurring workflows — quality checks, remediation proposals, dataset onboarding — versioned, documented, and invocable by any agent or teammate</p></li><li><p>Ship <strong>agentic remediation pipelines</strong>: triage with rules, escalate to LLMs, propose fixes, log every call (prompt version, model, cost, latency, decision), surface human-review queues</p></li><li><p>Own the <strong>eval and observability scaffolding</strong> — prompt versioning, traces, drift detection when a vendor silently updates claude-sonnet-latest, cost ceilings with token math behind them</p></li><li><p>Set the model-choice playbook — Haiku for cheap classification, Sonnet for nuanced judgement, frontier models for hard edge cases — and revise it as model economics shift</p></li></ul><h3>Cross-Functional Support</h3><ul><li><p>Be the technical point of escalation for data quality across product, engineering, and go-to-market — the person trusted when a number is questioned</p></li><li><p>Partner with product and engineering on architecture decisions where data quality is in the loop</p></li><li><p>Build the monitoring surface stakeholders operate against: DQ trend by check type (rule vs. LLM), top failing reasons surfaced by LLM judges, cost and latency over time, human-review backlog</p></li></ul><h2>What We're Looking For</h2><h3>Must Haves</h3><ul><li><p><strong>6+ years</strong> in data quality, data engineering, or analytics, with a strong focus on data quality systems</p></li><li><p><strong>Expert-level SQL and Snowflake</strong> — complex queries, performance tuning, warehouse design, daily comfort across very large datasets</p></li><li><p><strong>Strong Python skills</strong> — pandas, numpy, scripting, automation, and production-grade code. You write systems, not notebooks.</p></li><li><p><strong>Shipped real work with agentic IDEs</strong> — Claude Code, Cursor, or equivalent. Not "tried it" — built and merged real systems with it.</p></li><li><p><strong>Deep, demonstrable expertise building agents, skills, and tool-calling pipelines</strong> — you've architected agent workflows, written <a target="_blank" href="http://SKILL.md">SKILL.md</a> specs others depend on, and built tool-calling systems running in production. You can show us the repos.</p></li><li><p><strong>You operate LLMs as production systems</strong> — you've designed eval harnesses, run labelled eval sets, versioned prompts, logged traces, debugged judges on precision/recall, and detected drift on vendor model updates</p></li><li><p><strong>Sharp judgement on rules vs. LLMs</strong> — you reach for deterministic logic when it's the right tool and don't default to an LLM because it feels modern</p></li><li><p><strong>Deep knowledge of data quality principles</strong> — validation, monitoring, observability, lineage, and the instinct to chase issues from symptom to root cause across pipelines</p></li><li><p><strong>Proven skill with BI and data visualisation</strong> — Tableau, Looker, Power BI, or equivalent</p></li><li><p>Comfort working <strong>cross-functionally</strong> with product, engineering, sales, and marketing</p></li><li><p>A <strong>product mindset</strong> — you care about how data drives customer value and revenue, not just whether the pipeline ran</p></li></ul><h3>Highly Valued</h3><ul><li><p>Experience with <strong>data warehousing and relational modelling</strong>; NoSQL familiarity a plus</p></li><li><p>Experience with <strong>web scraping</strong> frameworks and best practices</p></li><li><p>Familiarity with <strong>cloud platforms</strong> — AWS, GCP, or Azure</p></li><li><p>Experience assessing and onboarding third-party data sources at scale</p></li><li><p>Background in <strong>B2B data, entity resolution, or structured/semi-structured datasets</strong></p></li><li><p>Understanding of data privacy and compliance considerations</p></li></ul><h2>How We Build</h2><h3>AI-Native, Not AI-Assisted</h3><p>Firmable is built on an AI-native engineering philosophy — and we mean it literally. AI is not a productivity tool bolted onto traditional analyst work. <strong>AI is the workflow.</strong> Every analyst at Firmable operates with fully agentic development, evals, traces, and AI-powered review pipelines as their default mode of working.</p><p>This means:</p><ul><li><p><strong>Agentic development</strong>: checks, datasets, and pipelines are designed, scaffolded, and iterated with AI agents doing the heavy lifting — you direct, review, and elevate</p></li><li><p><strong>Skills over scripts</strong>: recurring workflows are packaged as versioned <a target="_blank" href="http://SKILL.md">SKILL.md</a> specs that any teammate or agent can load and run</p></li><li><p><strong>Evals as a default, not an afterthought</strong>: every LLM check ships with a labelled eval set, measured precision/recall, and a prompt version you can roll back</p></li><li><p><strong>Traces and observability from day one</strong>: every LLM call is logged with prompt version, model, cost, latency, and decision — retrofitting this later is not the plan</p></li><li><p><strong>Continuous AI feedback loops</strong>: model drift, prompt regression, and cost ceilings are monitored the same way pipeline health is</p></li></ul><p>If you're not already working this way, this role will require a rapid and genuine mindset shift. We're not looking for people who are <em>open to</em> AI-native work — we're looking for people who already <strong>live it</strong>.</p><h3>The Operating Environment</h3><p>Firmable runs lean and ships fast — intentionally small teams, no layers, minimal process, and a weekly release cadence moving toward daily. Teams own their stack end to end: you design it, you build it, you ship it, you run it.</p><p>This is a <strong>startup-to-scaleup environment</strong> and it comes with real expectations. There are no fixed hours. The pace is high, the team is always building, and when something matters it gets done. In return, you get genuine ownership, a seat at the table on every major architecture decision, and the opportunity to build something that doesn't exist anywhere else in the market.</p><h2>Why This Role</h2><ul><li><p><strong>Own data quality at the heart of one of the fastest-growing B2B intelligence platforms in APAC</strong> — every check you build, every skill you ship, every dataset you onboard reaches every Firmable customer</p></li><li><p><strong>Greenfield AI-native scaffolding</strong> — the eval harnesses, skills library, and agentic quality pipelines are largely unbuilt; you'll shape them</p></li><li><p><strong>Work at the frontier</strong> — LLM-as-judge at production scale, agentic remediation, drift detection on vendor models, and rule-vs-LLM orchestration are genuinely hard, genuinely novel problems</p></li><li><p><strong>Small team, massive leverage</strong> — your work reaches every Firmable customer, every day</p></li><li><p><strong>Competitive base + meaningful equity</strong> — we balance strong compensation with a share in the upside we're building toward</p></li></ul>

Back to blog

Common Interview Questions And Answers

1. HOW DO YOU PLAN YOUR DAY?

This is what this question poses: When do you focus and start working seriously? What are the hours you work optimally? Are you a night owl? A morning bird? Remote teams can be made up of people working on different shifts and around the world, so you won't necessarily be stuck in the 9-5 schedule if it's not for you...

2. HOW DO YOU USE THE DIFFERENT COMMUNICATION TOOLS IN DIFFERENT SITUATIONS?

When you're working on a remote team, there's no way to chat in the hallway between meetings or catch up on the latest project during an office carpool. Therefore, virtual communication will be absolutely essential to get your work done...

3. WHAT IS "WORKING REMOTE" REALLY FOR YOU?

Many people want to work remotely because of the flexibility it allows. You can work anywhere and at any time of the day...

4. WHAT DO YOU NEED IN YOUR PHYSICAL WORKSPACE TO SUCCEED IN YOUR WORK?

With this question, companies are looking to see what equipment they may need to provide you with and to verify how aware you are of what remote working could mean for you physically and logistically...

5. HOW DO YOU PROCESS INFORMATION?

Several years ago, I was working in a team to plan a big event. My supervisor made us all work as a team before the big day. One of our activities has been to find out how each of us processes information...

6. HOW DO YOU MANAGE THE CALENDAR AND THE PROGRAM? WHICH APPLICATIONS / SYSTEM DO YOU USE?

Or you may receive even more specific questions, such as: What's on your calendar? Do you plan blocks of time to do certain types of work? Do you have an open calendar that everyone can see?...

7. HOW DO YOU ORGANIZE FILES, LINKS, AND TABS ON YOUR COMPUTER?

Just like your schedule, how you track files and other information is very important. After all, everything is digital!...

8. HOW TO PRIORITIZE WORK?

The day I watched Marie Forleo's film separating the important from the urgent, my life changed. Not all remote jobs start fast, but most of them are...

9. HOW DO YOU PREPARE FOR A MEETING AND PREPARE A MEETING? WHAT DO YOU SEE HAPPENING DURING THE MEETING?

Just as communication is essential when working remotely, so is organization. Because you won't have those opportunities in the elevator or a casual conversation in the lunchroom, you should take advantage of the little time you have in a video or phone conference...

10. HOW DO YOU USE TECHNOLOGY ON A DAILY BASIS, IN YOUR WORK AND FOR YOUR PLEASURE?

This is a great question because it shows your comfort level with technology, which is very important for a remote worker because you will be working with technology over time...