Khushbu Agrawal

About Me

Seasoned engineering leader with 17 years of experience driving innovation through data-driven solutions. Proven expertise in managing teams, architecting scalable data platforms, and delivering impactful, enterprise-grade solutions. Adept at aligning technology strategies with business objectives to achieve measurable results.

Professional Summary

As a Senior Manager, Data Engineering, I specialize in:

• Strategic Leadership: Defining and executing strategic visions for developing robust and scalable data engineering solutions, aligning data initiatives with overall business objectives
• Platform Architecture: Architecting innovative solutions leveraging Medallion and Data Mesh frameworks to enhance scalability and optimize data management
• Real-time Systems: Championing streaming and API-first approaches to building scalable, real-time transactional platforms using microservice-based architectures
• Team Development: Continuously coaching teams to foster deep understanding of business problems and align technology solutions effectively
• Best Practices: Establishing standards and guidelines for design, development, deployment, support, and analytics across data platforms

Technical Expertise

Cloud & Data Platforms: AWS techstack, Databricks, Snowflake, Teradata, DynamoDB
Big Data & Processing: Spark, Airflow, Kinesis/Kafka
Languages: Python, TypeScript, SQL (DBT)
Infrastructure: Docker, CI/CD
Analytics & Search: Tableau, ElasticSearch/Opensearch
Architecture: Micro-services, Data Modeling, Streaming Architecture

Experience Highlights

• Atlassian - (Dec 2020 - Dec 2025) Architect/Manager, Data Engineering
  • Led strategic data engineering initiatives and platform development
  • Featured speaker at Real-time Analytics Summit, USA
  • Established culture of innovation through best practices and mentorship
• Groupon, Bangalore (Feb 2017 - Dec 2020) - Lead Data Engineer
  • Led migration of 10+ PB data warehouse with 200+ pipelines from on-premise Teradata to AWS
  • Optimized Teradata queries resulting in 45% reduction in query execution time
  • Improved data accuracy by 25%, empowering faster data-driven decisions
• LTI, Bangalore (July 2012 - Feb 2017) - Lead Data Engineer
  • Worked as domain architect for US-based media partner (TimeWarner)
  • Optimized 50+ ETL pipelines, reducing processing times by 40%
  • Improved data accuracy by 30% through quality controls
• TESCO HSC, Bangalore (Apr 2008 - July 2012) - Senior Software Engineer
  • Specialized in ETL Data Pipeline development using Teradata, Linux Shell Scripts, and Mainframe
  • Contributed to Data Warehouse development and Data Migration projects

Achievements

• Featured speaker at Real-time Analytics Summit, USA
• Successfully led migration of 10+ PB data warehouse to AWS
• Optimized data processing pipelines resulting in 40-45% performance improvements
• Improved data accuracy by 25-30% across multiple projects
• Established best practices and innovation culture at Atlassian

Blogs

• Blog Title 1
• Blog Title 2

Recommended Books

Technical

• Book Title 1 by Author Name - Brief description
• Book Title 2 by Author Name - Brief description
• Book Title 3 by Author Name - Brief description

Non-Technical

• Book Title 1 by Author Name - Brief description
• Book Title 2 by Author Name - Brief description
• Book Title 3 by Author Name - Brief description

Conferences/Talks/Meetups

• Real-time Analytics Summit, USA - Featured speaker on cutting-edge real-time architecture
• Talk/Conference Title - Brief description
• Meetup Title - Brief description

Conference Links

• Dev Events - EU Tech Conferences

My Philosophy

"Your philosophy statement goes here. This could be about your approach to engineering, leadership, problem-solving, or life in general."

Connect

• LinkedIn: khushbu-agrawal-1407bb10
• Schedule a call in topmate: topmate-link