Jason Paladini

Data Engineer

About

Analytics engineer and software developer. I build data applications and BI platforms on both on-prem infrastructure and cloud environments (Databricks, Snowflake, Fabric).

Experience

Data Engineer

2017 - Present

Horizon Blue Cross Blue Shield of New Jersey

  • Built an end-to-end call intelligence lakehouse pipeline that automates ingestion, transcription, analysis, and semantic search across customer service recordings using Bronze/Silver/Gold + embeddings architecture
  • Designed a prompt control plane powered by a database table—new LLM workflows deploy via data configuration only, no code changes, with versioned prompts and production promotion paths
  • Launched a dual-index RAG agent combining transcript retrieval and prior LLM analysis through vector search, grounding answers with citations for high-trust investigation of call center activity
  • Established an MLflow-based evaluation framework with deterministic schema checks, LLM-as-judge scoring, and A/B comparison across prompts and models for repeatable GenAI quality measurement
  • Migrated legacy SQL Server and DB2 systems to cloud platforms (Databricks, Snowflake, Fabric) while maintaining production reporting pipelines for a 25-person analytics team

Corporal

2005 - 2010

US Marine Corps · Marine Aircraft Logistics Squadron 16

Led supply chain operations for Marine aviation. Managed a 25-person team, 12,000+ line items, and multiple satellite inventories supporting aircraft readiness.

Platforms & Tools

Cloud Lakehouse

Microsoft Fabric (Lakehouse, Pipelines, PySpark, Direct Lake), Databricks (Lakeflow, dbt, Streamlit), Snowflake (dbt, Streamlit, Snowpark)

Traditional Systems

SQL Server, DB2, SSIS

Reporting Platforms

Tableau Server, Power BI

Governance & Documentation

Alation, Microsoft Purview, Confluence

Languages & Practices

SQL, Python, dbt, Azure DevOps, version control, CI/CD

Automation & AI

Power Automate, Copilot Studio

What I Do

  • Own all data products in my domain—models, transforms, semantic layers, and governance entries
  • Review and approve all analyst contributions through CI/CD pipelines and PR checks
  • Set and enforce best practices for a team of analysts shipping to production
  • Build production RAG systems on governed enterprise data with real access controls
  • Modernize ingestion and platform architecture without breaking what's already running

Education

Stony Brook University

2012 - 2016

Computational Modeling, Bioinformatics, Mathematical Biology

Contact