Lead AI Systems Engineer · AI Agent Platforms

Jordan
Carson

Architect of a cloud-native AI coding agent platform serving thousands of engineers at J.P. Morgan Chase. Built telemetry infrastructure powering AI attribution at scale — consuming tens of thousands of events/sec and peaking at multi-million tokens/min.

View DevGPT ↗ Read Writing →
Impact
6,500+
Users on Platform
Engineers, product & senior management
90%
Prompt cache hit rate
Anthropic models
20M
Peak cache reads / min
AI4Tech · DevGPT
5
Publications & Talks
Medium + FINOS 2025
Technical Skills

Hover for details

Career
2025–Present
Current
Lead Architect & AI Systems Engineer — AI4Tech
J.P. Morgan Chase
  • Architect of AI4Tech, a dedicated platform org with its own SEAL, AWS accounts, and cost center
  • DevGPT powers Technology Lifecycle Management (TLM) — firm-wide agentic software maintenance across Terraform, Python, Java, and Golang codebases
  • Supervisor agent reviews patches on a dedicated maintenance branch and routes changes to owning teams for merge
  • Anthropic SRT + bubblewrap sandbox (early 2026)
  • Temporal-backed durable agent orchestration
  • Multi-layer memory system (Org / Team / User / Session)
  • 2-week AWS org migration with 30-minute planned outage — zero data loss
2021–2025
Senior Applied AI Engineer — Asset & Wealth Management
J.P. Morgan Chase
  • Built DevGPT from the ground up within AWM's Architecture & Investment Technology team
  • ~90% prompt cache hit rates on Anthropic models; 20M peak cache reads/min against a 30M TPM budget
  • Hybrid model routing — Anthropic via AWS Bedrock, OpenAI via Azure OpenAI
  • Kubernetes API gateway on EKS using Cilium with per-LOB auth, rate limiting, load shedding
  • 65% AWS cost reduction — Karpenter/EKS node group migration + smart prompt engineering & context caching
  • Knowledge Graphs & Event-Driven News Analytics Platform — entity resolution at ~900ms/article
  • Sm@rt RFP — weeks to minutes for client proposal generation (patent pending)
2015–2021
Data Scientist & Analytics Developer
BNP Paribas · Global Markets
  • Lead Americas data scientist
  • Salesperson 360 dashboard adopted org-wide
  • Contributor to pyGCA internal ML library
2013–2015
Software Engineer / Analyst
UBS Securities · Group Data Services
  • Client Onboarding, KYC, & Data Warehousing
  • Chief Economics Office intern — cubic spline interpolation for defined benefit pension plan valuation