Praveen Kumar Kancharla - Data & Analytics Engineering Leader

About Me

My background is a bit unconventional. I started in civil engineering before transitioning into data and analytics at Amazon in 2017. That career pivot taught me how to learn fast, ask the right questions, and stay focused on outcomes.

Over the past 9+ years at Amazon and AWS, I've grown from an individual contributor into a senior manager leading a team of data and analytics engineers. I define and execute multi-year data and AI roadmaps spanning domain-driven architecture, semantic layers, enterprise metrics systems, and AI-powered self-service analytics.

Today I lead petabyte-scale analytics ecosystems serving 5,000+ users, integrating governed data architecture with production-grade LLM capabilities to drive cost, product, and operational intelligence. I delivered LLM-powered data catalogs, text-to-SQL platforms, knowledge graphs, and agentic workflows that reduced analyst dependency by 60% and cut approval cycle times by 95%.

I also care deeply about growing engineers. Coaching and mentoring across teams has resulted in 5 promotions across organizations, including 2 within my direct team to senior and lead roles.

Career Journey

Now

Senior Cost Analytics Manager

AWS - Sydney, Australia

2024

Cost & Compliance Analytics Manager

AWS - Sydney, Australia

2020

Senior BI Engineer

Amazon.com - Hyderabad, India

2017

MIS Specialist

Amazon.com - Hyderabad, India

2016

B.Tech Civil Engineering

Vignan Institute of Technology, Hyderabad

What I Work On

I focus on building enterprise data and AI platforms that make cost intelligence, operational analytics, and decision-making accessible at scale. My work spans:

Enterprise analytics and self-service platforms - designing governed data architectures with semantic layers and metrics systems, delivering self-service dashboards and KPI frameworks that empower 5,000+ users across 12+ data domains to derive insights independently
LLM-powered data products - launching production data catalogs, text-to-SQL systems, and agentic automation workflows that reduced analyst dependency by 60% and approval cycles by 95%
Data centralization - consolidating fragmented cost and operational data from 10+ disparate systems into unified, analytics-ready repositories enabling benchmarking, trend analysis, and forward-looking cost models
Enterprise data governance - implementing fine-grained security (RLS/CLS), role-based access controls for downstream data consumers, Lake Formation governance, and GDPR/CCPA compliance across self-service analytics ecosystems
Process automation and CI/CD modernisation - automating manual workflows in contract administration, compliance tracking, and approval routing, while modernising deployment pipelines processing 10+ TB daily with 4-hour to 15-minute cycle reduction
Knowledge graphs and AI chatbots - building ontology-driven knowledge systems and onboarding assistants that cut information retrieval from 30 minutes to 2 minutes
Stakeholder enablement - training and onboarding hundreds of stakeholders across engineering, construction, finance, and design on new platforms, analytics tools, and standardised processes
Program management and team development - leading cross-functional delivery programs, managing roadmap execution aligned to executive priorities, and coaching engineers across teams resulting in 5 promotions to senior and lead roles

Deliverables by Role

Click a role to see specific achievements and projects.

Senior Cost Analytics Manager AWS, Sep 2024 - Present

Petabyte-Scale Analytics Platform

Lead a team of 6 engineers operating petabyte-scale analytics platforms serving 5,000+ users with 99.9% reliability. Established engineering standards, architectural governance, and domain-driven data architecture including semantic layers and governed metrics systems enabling trusted executive decision-making across 12+ data domains.

Redshift S3 Airflow CDK QuickSight

LLM-Powered Data Catalog & Text-to-SQL

Launched production LLM-powered data catalog, text-to-SQL analytics systems, and agentic automation workflows integrating 10+ internal services. Reduced time-to-insight by 95% and analyst dependency by 60%.

Bedrock RAG NLP Text-to-SQL

Secure Self-Service Analytics Ecosystem

Architected compliant self-service analytics ecosystem supporting 1,000+ users with fine-grained Row and Column-Level Security, Lake Formation governance, and GDPR/CCPA alignment.

Lake Formation IAM RLS/CLS GDPR

CI/CD Data Warehouse Modernisation

Drove full-stack platform automation through CI/CD-enabled data warehouse modernisation processing over 10 TB daily. Reduced deployment cycles from 4 hours to 15 minutes while improving resiliency, auditability, and security posture.

CI/CD CDK Lambda 10TB/day

AI Extension Onboarding Chatbot

Built a custom guided chatbot for onboarding non-technical users to RooCode, an AI coding extension requiring complex 2-3 hour setup on Windows within Amazon's compliance ecosystem. The chatbot adapts to each user's pace, troubleshoots issues in real time, and guides through advanced configuration including custom modes, skills, rules, and MCP server integration.

RooCode Chatbot Onboarding MCP

Cost & Compliance Analytics Manager AWS, Jun 2024 - Sep 2024

Ontology-Driven Knowledge Graph

Designed ontology-driven knowledge graph mapping 500+ operational artifacts across 8 teams, powering AI chatbots that reduced information retrieval time from 30 minutes to 2 minutes.

Knowledge Graphs Ontology AI Chatbot

Agentic LLM Compliance Workflows

Deployed agentic LLM workflows integrating 6 enterprise service endpoints to automate compliance approvals, change management, and ticketing processes. Achieved 95% reduction in manual processing time.

LLM Agents Workflow Compliance

Enterprise Data Quality Framework

Led architecture of scalable data models and batch pipelines processing 5 TB daily across 8 data sources with 99.95% reliability. Instituted data quality framework improving accuracy from 94% to 99.7% and reducing data-related incidents by 85%.

Glue Lambda S3 Redshift

Senior Business Intelligence Engineer Amazon, Feb 2020 - Jun 2024

Enterprise BI Migration Program

Directed enterprise-wide BI migration transitioning 850+ dashboards from Oracle-based tools to AWS QuickSight using Python and Boto3. Completed rollout 6 months ahead of schedule with zero data loss. Built 3 QuickSight environments with SSO, AD federation, and automated dataset promotion.

QuickSight Boto3 SSO Migration

$600K Infrastructure Cost Optimisation

Optimised large-scale data infrastructure reducing annual costs by $600K while improving query performance by 12%, processing 8 TB daily across 20+ pipelines serving 2,000 analytics customers.

Cost Optimisation Redshift 8TB/day

Fail-Safe Resiliency Architecture

Implemented fail-safe resiliency architecture achieving 99.99% availability using load balancing, health checks, and Route 53 routing. Maintained uninterrupted operations during 3 regional infrastructure outages.

Route 53 Load Balancing 99.99%

Event-Driven Architecture & ETL Modernisation

Led design of resilient event-driven data architecture on AWS with CI/CD and CDK for automated zero-downtime deployments. Migrated ETL pipelines to orchestrated frameworks using Lambda, Airflow, SNS, and SQS, improving transformation performance by 55%.

CDK Lambda Airflow SQS

MIS Specialist Amazon, Mar 2017 - Feb 2020

De-Duping Rule Automation

Implemented de-duping rule automation identifying duplicate tasks across 5 regions, saving 3,158 hours monthly (27 FTE equivalent) and improving operational efficiency by 35%.

Automation SQL 27 FTE saved

Consolidated Metrics Dashboard

Built consolidated metrics dashboard enabling 4 teams to track 15+ KPIs through a single interface. Reduced reporting time from 4 hours to 15 minutes daily and improved decision-making speed by 60%.

QuickSight KPIs ETL

Technical Toolkit

Data Platforms

Amazon Redshift Snowflake Data Lakes Semantic Layers Metrics Systems

Cloud & Infrastructure

AWS S3 AWS Glue Athena Lake Formation Lambda SNS CDK / CloudFormation CloudWatch IAM & KMS VPC & PrivateLink EMR ECS Docker

Programming

SQL Python PySpark TypeScript Shell Scripting

AI & Machine Learning

LLM Agents Agentic Workflows Amazon Bedrock RAG Knowledge Graphs Text-to-SQL NLP Ontology Design

Engineering & DevOps

Apache Airflow (MWAA) CI/CD Pipelines Infrastructure as Code Event-Driven Architecture Stream & Batch Processing Data Quality Frameworks SDLC Governance Git

Visualization & Analytics

AWS QuickSight Tableau Self-Service Analytics KPI Dashboards

Governance & Security

Data Governance GDPR / CCPA Compliance Row & Column-Level Security IAM-based Access Controls Secure AI Data Patterns

Leadership & Strategy

Data & AI Roadmapping Program Management Cross-Functional Leadership Engineering Coaching Executive Engagement Budget & Cost Governance Agile Delivery Risk Management Lean Six Sigma (Green Belt)

What Drives Me

Growing Engineers

Coaching people into the best version of themselves as engineers and leaders. Nothing beats seeing someone you mentored get that well-earned promotion or crack a problem they thought was impossible. I've helped 5 engineers across organizations advance into senior and lead roles, and that's the work that sticks with me the most.

Turning Chaos into Clarity

I'm drawn to messy, fragmented data landscapes where information is scattered across a dozen systems and nobody trusts the numbers. The challenge of unifying that into a single, governed source of truth that people actually rely on for real decisions is deeply satisfying. Project Pandora was born from exactly this kind of problem.

Applied AI in the Real World

Not AI for the sake of AI, but applied intelligence that solves actual problems people face every day. Text-to-SQL so a finance manager can get answers without writing a query. Agentic workflows so an engineer doesn't spend 4 hours clicking through approval forms. Knowledge graphs so someone new to the team can find what they need in 2 minutes instead of 30.

Building at Scale

There's something about systems that serve thousands of users across the globe that keeps me coming back. The engineering discipline required, the edge cases, the performance tuning, the governance at scale. I find the constraints of enterprise-scale systems more interesting, not less.

Continuous Learning

I went from civil engineering to building petabyte-scale data platforms. That career pivot taught me that the ability to learn and adapt matters more than any single skill on a resume. I stay curious about new technologies, read widely, and believe the best engineers are the ones who never stop being students.

Open Source & Community

Building tools that make other people's lives easier, then sharing them openly. AsanaFlow started as a personal productivity tool and grew into a full MCP server specification. Contributing to the broader developer ecosystem matters to me because I've benefited from it myself.

By the Numbers

0 + Platform Users Served

0 + Dashboards Migrated

0 K Annual Cost Savings ($)

0 % Analyst Dependency Reduced

0 % Approval Cycle Time Cut

0 Engineers Promoted

0 Technical Interviews Conducted

Let's Connect

Always happy to connect with others working on hard problems in data engineering, analytics, or applied AI.

Email prvnkumar710@gmail.com LinkedIn Praveen Kumar K

Location Sydney, Australia

Praveen KumarKancharla